Yeovil College needed a new way to teach engineering assembly – one that goes beyond textbooks and demonstration videos. We built a dual-mode VR/XR training application for Meta Quest 3 that lets students learn to assemble a vehicle gearbox using hand tracking and mixed reality passthrough, with virtual guidance overlaid on real components.
Passthrough view – hands assembling a metal chassis with holographic bolt placement guides and step-by-step instructions overlaid in the college workshop
Dailyuse in the college’s engineering training
The challenge
Yeovil College is a top-performing further education college in Somerset, delivering engineering and manufacturing courses including T Levels and apprenticeships. Teaching precise assembly procedures – like building a vehicle gearbox – presents a real problem: parts are expensive, mistakes are costly, and each student needs hands-on practice time that's difficult to scale.
The college wanted something better: a training tool that gives every student guided, hands-on assembly practice – repeatably, safely, and without queueing for equipment.
Our approach
In full VR mode, students work with a completely virtual gearbox – learning the assembly sequence, understanding how parts fit together, and building confidence before touching real components. In XR passthrough mode, the headset's cameras show the real workshop while virtual instructions and part highlights overlay the physical gearbox in front of them.
The critical design decision was hand tracking over controllers. Engineering assembly involves small fixings, precise placement, and dexterity – skills that don't translate through a controller. Students use their actual hands throughout, building the same muscle memory they'll use on the job.
The results
Yeovil College now has an engineering training tool that every student can access simultaneously – no waiting for equipment, no risk of damaging expensive parts during early learning. The dual-mode approach lets students progress naturally from virtual practice to guided real-world assembly.
The project demonstrated that mixed reality passthrough training is genuinely practical for hands-on technical education – not just a concept, but a working tool in daily use. It's attracted interest from other education providers exploring immersive learning for practical skills.
Technical highlights
Dual-mode VR/XR application
full virtual training and passthrough-guided real-world assembly in a single build
Controller-free hand tracking
natural hand interaction for precise assembly tasks involving small fixings
Bespoke spatial tracking
custom methodology locking virtual models to physical components at runtime
Zero-onboarding UX
intuitive interaction design requiring no tutorials or instruction screens
Meta Quest 3 standalone
runs entirely on-device with passthrough, no PC or external hardware required
First-of-its-kind system
combining runtime part tracking with passthrough-guided assembly training
VR mode – tracked hands picking up a gear component from a virtual workbench with step-by-step assembly instructions
Choosing XR or VR assembly in the headset, captured on Quest 3
Gearbox parts laid out in the virtual workshop, captured in the headset
Have a project in mind, or want to explore what’s possible? Talk to us.
Hello, I’m Lucy. What would you like to build, or what can I help you with?
Conversations are stored for up to 180 days to follow up on your enquiry. See the privacy policy.
Cookies
We’d like to use cookies to see how the site is used and to measure our advertising. Nothing is set unless you agree. Our own visit counting is cookieless. Cookies policy