“Someone can take a HoloLens, start a Guides session, and literally have a trainer in their head,” he said. “If they need help, they can call an expert right from the app.”

Toyota’s feedback also helped improve other aspects of the Guides’ experience. For example, technicians would place a QR code on the hood of a vehicle, scan it, and then follow the holographic instructions.

But those holograms might appear to drift as a worker moves around the car. Toyota worked with Microsoft to develop “object understanding.” That meant Toyota technicians could scan the entire vehicle, which helped lock a hologram into place and eliminate the parallax problem. A hologram pointing towards a bolt would always point to the exact location, no matter the viewer’s angle.

About him…