Writing Edtech / Learning Systems

The real product in edtech is the practice environment

Content is how most learning products describe themselves. What actually teaches the learner is the environment they work inside, the place they have to do the thing and find out whether they can. That's the real product, and it's the hardest part to build.

November 2025 5 min read

A company buys a training program. The library is beautiful and the videos are polished, and six months later nobody on the team is doing anything differently. The program didn’t fail at what it was built to do. It was built as a content product, the buyer assumed they were buying a capability product, and the two aren’t the same thing.

In a serious learning system, the product is the environment in which the learner has to act, while the content does the work it can and no more. The content itself is the entry point, often also the pitch. Whether the learner can actually do the thing is decided in the place where they are asked to perform the work, under conditions close enough to the real task to matter, with feedback that tells them whether what they did was any good. Everything else around that environment, the catalog and the video player and the platform shell and the certificate at the end, is packaging. Sometimes expensive packaging, sometimes useful packaging, but it doesn’t produce capability on its own.

People in this space routinely collapse four different things into one. There is the platform layer, which is infrastructure and the surface the learner touches. There is the content layer, which is the lessons and the videos and the readings and the reference material. There is the assessment layer, which is how the system reads whether the learner understood or performed what it asked of them. And there is the practice environment, which is where the learner actually does the work, repeatedly, under some version of the conditions the work will later be done in. Most products describe themselves through the first two layers and invest too little in the fourth. That is where learning gets turned into capability.

The practice environment looks different in different domains, but the shape is the same. An infrastructure engineer works inside a cloud lab where they SSH into a broken cluster and have to recover it, with a real terminal and a real failure mode. There is no shortcut that doesn’t involve understanding what went wrong. A pilot works inside a simulator that puts them into a stall at low altitude and asks whether their hands do the right thing before their mind has caught up. A sales rep sits in a scripted scenario with a plausible customer and a plausible objection, with a colleague listening in. A medical trainee runs a protocol on a mannequin that responds to what they do, while a clock runs and a team is expected to coordinate around them. In each case the learner is doing a version of the work, and the system is watching closely enough to respond to what they did.

Products that lead with their catalog look impressive for the same reason a lecture hall looks impressive. Catalog size is easy to show and easy to market, and it tells you almost nothing about whether anyone got better at anything. Exposure has to become practice, and practice has to become performance. Those transitions only happen when the environment forces them to happen. Most of what goes wrong in learning programs goes wrong at those transitions, where the environment work is missing. A buyer looking at a usage dashboard is usually looking at exposure and assuming the rest.

The practice environment is also where the part of the business that is hard to copy lives, for anyone building in this space. A content library can be built once and left alone for a while. Taken on its own, the platform shell tends to commoditise into whatever the browser, the LMS, and the video player already do well. The environment is the part that has to track the real task as the real task moves, the actual cloud tooling an engineer would touch this quarter, the actual objection customers are raising in the market you sell into now. That is hard to clone from the outside and it doesn’t show up on a screenshot, which is usually what makes it the moat. The part that isn’t on the home page tends to be the part that is worth something.

An operator evaluating a learning product, whether buying it or running it, is asking a small number of concrete questions. Where does the learner actually perform the task? What does an attempt look like end to end? How specific is the feedback when they fail, and how many attempts does the system expect before it decides they are ready? What is the system actually reading to make that decision, and is that read a reasonable proxy for being able to do the thing later, under pressure? A product that can answer those questions probably has a serious practice environment. A product that can’t answer them but has a very large content library is a content product with a learning promise attached to it.

Assessment only becomes meaningful when there is a serious environment for it to read. Without that, assessment collapses into recall checks and satisfaction signals. The same is true in corporate training. What looks like a measurement problem is often an environment problem first: there was nowhere the learner was ever required to perform the work in a form the system could observe.

Learners keep far more of what they practised under conditions close enough to the real task to matter. Much of the rest decays faster than most buyers like to admit. That is why, in a serious learning system, the environment is the product and the content is what gets the learner into the work.

Subscribe

A roughly monthly dispatch from karlbaz.com. Links to the month's memos, plus a short note on what matters now.

Roughly monthly · No promo · I do not sell or share your address · Unsubscribe anytime