The short answer
Mixed reality (MR) on Meta Quest 3 and Quest 3S shows the real world through the headset's colour cameras and places interactive virtual content in it. Developers can now read the shape of the room, anchor content to real surfaces, share that space between players in the same room and, with the user's permission, access the camera feed to recognise objects. That makes MR the most practical form of XR for many business uses, because people stay aware of their surroundings and can use it for longer.
What the platform gives you
Scene understanding
Meta's Mixed Reality Utility Kit (MRUK) provides a model of the user's room: walls, floor, ceiling, furniture and a mesh of surfaces. Your app can place a virtual pet on the real sofa, bounce a ball off the real wall or hide a target behind the real table. MRUK also handles raycasts against real geometry, so placement feels physical.
Anchors and shared spaces
Spatial anchors keep content fixed to the same real-world spot between sessions. Shared anchors let several headsets in one room agree on where things are, which makes colocated multiplayer and group training possible.
Camera access
The Passthrough Camera API gives apps access to the headset's forward cameras on Quest 3 and 3S, after the user grants a camera permission. In Unity it is used through MRUK's PassthroughCameraAccess component. Meta's samples pair it with Unity's on-device inference engine to detect objects and find their position in the room, for example recognising a piece of equipment and showing instructions on it.
Know the limits
- Camera speed. When the API launched, Meta quoted up to 1280×960 per camera at 30 frames per second with about 40–60 milliseconds of latency. Fine for recognising objects and reading signs, not for tracking a fast-moving ball.
- Privacy. Camera access requires explicit permission and a clear explanation. Design the app to work, in a reduced way, if the user says no.
- Lighting and clutter. Scene understanding and recognition work best in reasonably lit, tidy rooms. Test in real homes and workplaces, not just the office.
- Battery and heat. Running passthrough, scene mesh and on-device AI together is demanding. Budget performance from day one.
Where mixed reality wins
| Use case | Why MR beats full VR here |
|---|---|
| Games in your living room | Real furniture becomes the level; players stay safe and social |
| Training on real equipment | Step-by-step guidance overlaid on the actual machine |
| Retail and product visualisation | See a product at true scale in your own space; see our AR furniture work for the same idea on phones |
| Fitness and wellbeing | Longer sessions with less discomfort because the room stays visible |
| Education | Shared 3D models in a real classroom with the teacher still visible |
Design rules for MR
- Respect the room. Never place content inside furniture or block exits. Use the room model to find clear space.
- Make onboarding part of the experience. Room setup and permissions are the moment users drop off. Explain why and keep it short.
- Blend, do not cover. Match lighting and shadows to the room so virtual objects look grounded.
- Plan for every room size. Content must adapt from a small bedroom to an open office.
Business context in 2026
Meta ended its Quest for Business offering, which changed how companies buy and manage headsets; our article on what that means for enterprise VR covers the alternatives. Google's Android XR platform also supports mixed reality, so building on OpenXR where possible keeps a second platform open.
What an MR project costs
A focused single-scene MR experience starts at $999 and a full application at $2,999 under our current VR and AR packages. Projects with object recognition, colocated multiplayer, custom 3D content or enterprise device management are quoted individually; typical market ranges are in the VR development cost guide.
Sources: Meta: Passthrough Camera API overview · Meta: on-device ML with camera access · UploadVR on the Passthrough Camera API. Checked October 12, 2026.
Related: VR game development · VR and AR packages · AR development
Quick answers ❓
What is mixed reality on Meta Quest 3?
Mixed reality shows the real world through the Quest 3 or 3S colour cameras and places interactive virtual objects into it, anchored to real walls, floors and furniture.
Can Quest apps access the headset cameras?
Yes. The Passthrough Camera API gives apps access to the forward cameras on Quest 3 and 3S after the user grants a camera permission. In Unity it is used through the PassthroughCameraAccess component in the Mixed Reality Utility Kit.
Can a Quest 3 recognise real objects?
Yes, with camera access and an on-device machine-learning model. Meta's samples use Unity's inference engine to detect objects in the camera feed and locate them in the room. The camera stream suits recognising objects, not tracking fast motion.
Is mixed reality better than VR for training?
Often, when the training involves real equipment or a real space. Learners see the actual machine with guidance overlaid and stay aware of their surroundings. Full VR is better for dangerous, rare or expensive scenarios that cannot be staged in reality.
How much does a Quest mixed reality app cost?
A focused single-scene experience starts at $999 and a full application at $2,999 on the studio's current packages. Object recognition, colocated multiplayer and enterprise deployment are quoted individually.
Related guides
Android XR app development guide → VR training ROI →Have a mixed reality idea? 🪟
Tell us what you want people to see in their room. You'll get a plan and a fixed quote within 48 hours.