Three terms, one spectrum
Virtual reality, augmented reality and mixed reality are often used loosely, and different companies use them differently. A helpful way to sort them is to picture a spectrum with the real world at one end and a fully computer-generated world at the other.
- Virtual reality is at the computer-generated end. You see only a digital scene, and the real room is blocked out.
- Augmented reality sits closer to the real end. You see the real world, and digital information is added on top, such as labels, arrows or simple shapes.
- Mixed reality is the middle ground, where digital objects do not just sit on top of the view but appear to interact with the physical space. A virtual ball might roll along your real floor and stop at a real wall.
The key idea is that mixed reality involves the system understanding your surroundings well enough for digital and physical things to relate to each other. The boundary between augmented and mixed is fuzzy, and some use the terms almost interchangeably. When you read a product description, it is worth checking what it actually does rather than relying on the label.
What it takes to blend
For a virtual object to look like it belongs in your room, several things have to happen.
Seeing the room. Mixed reality devices use cameras and often depth sensors to measure the space. Depth sensing estimates how far away surfaces are, which lets the system build a rough 3D map of walls, floors, tables and furniture. The same kind of positional awareness is behind headset tracking, and it also resembles how robots sense their surroundings.
Staying put. An object placed on a table should remain on that table when you walk around it. This is called anchoring. The device uses its tracking to keep the object fixed in the room’s coordinate system, so any error in tracking shows up as a floating or sliding object.
Handling occlusion. If you place a virtual vase behind a real chair, part of it should be hidden by the chair. Doing this requires knowing where the chair is in depth. Without it, digital objects appear to sit in front of everything, which looks wrong. Occlusion is one of the harder parts to get right.
Matching light. Real scenes have shadows and highlights. Objects look more convincing when their lighting roughly matches the room’s, though this is difficult and often simplified.
Two ways of showing the room
There are two main technical approaches.
Optical see-through. You look through transparent lenses at the actual room, and a display adds light to your view. The advantage is that the real world is seen directly. The drawbacks are that digital content can look faint in bright light, and that it can be hard to make virtual objects appear solid or to fully block parts of the real view.
Video passthrough. The device is closed like a virtual reality headset but has outward-facing cameras. It displays the camera feed of your room with digital content added. This makes it easier to blend things convincingly and to switch between fully virtual and mixed views. The tradeoffs are that you are looking at a screen version of the room, so image quality, delay and slight distortions matter, and that cameras are pointed at your home, which raises privacy questions.
Some products are designed for one approach and some for the other. Lighter, glasses-like devices, including smart glasses, tend to be closer to the augmented end of the spectrum, because showing rich, room-aware content in a small frame is difficult.
What people use it for
Uses that are discussed include:
- Visualizing furniture or a design at full size in a real room.
- Training that mixes real equipment with digital instructions.
- Collaboration, where a shared model sits on a real table, often alongside digital twins of machines or buildings.
- Games that use your living room as the play space.
- Education, where augmented reality classrooms are the closest existing use.
Most of these exist in some form, but they remain niche, and it is not clear which will become everyday tools.
Limits and open questions
Comfort is a recurring one: headsets can be heavy, and wearing a screen for long periods tires some people. Field of view is another, since many devices show digital content in a window smaller than your natural vision. Battery life, cost and the amount of processing required also limit design.
Privacy is arguably the biggest social question. A device that continuously maps rooms and watches the people in them collects intimate information. How that information is stored, who can access it, and how bystanders are treated are open issues that fall under broader debates about data privacy.
A short summary
Mixed reality is best understood not as a separate product category but as a position on a spectrum: digital content that is aware of, and responds to, the physical space around you. Because the vocabulary is inconsistent, the most reliable approach is to ask what a device actually senses and how it shows the world.