Unbound XR visits the KLM VR Centre of Excellence

How exciting is this: being invited by KLM to take a look inside their high-tech XR Lab! On Monday, 26 April 2021, Remco de Jong,Managing Director of Unbound VR/XR, visited the lab and spoke with Werner Soeteman (Sr IT-manager KLM) and Chris Koomen (Virtual Reality Specialist). With years of experience as a former pilot (Remco himself spent years working as a pilot for a development organisation in Noord-Australië), this visit to KLM was, of course, twice as interesting!

KLM has been developing VR and XR-software for many years. They have their own software-ontwikkelaarsteam dedicated to creating specific VR-trainingsapplicaties for aviation (more on this later in the blog). What is also interesting is that KLM's software can be used outside the airline. For instance, schools like Deltion College in Zwolle are actively running pilots to integrate VR-training into their curriculum. The "Aviation Technology" course, among others, uses KLM's VR-software to familiarise and train students in various aspects of aviation.

Werner Soeteman,Manager XR Center Of Excellence at KLM IT, indicates that KLM Cityhopper is the first airline to integrate VR into the pilot training programme for the Embraer planes (specifically the Embraer 175 and 190). These are smaller aircraft used for European flights.

In the VR-training, there are three different applications, all part of the Type Rating Course in which pilots are introduced to the specific features of the aircraft type they will be flying.

• Virtual cockpit: the pilot is in the cockpit, which consists of an interactive computer-gegenereerd image of the control panels.
• Instructional video: the pilot can watch a flight from the cockpit in a 360-graden film.
• VR Walk-around: the pilot can walk through and around a Boeing 787-10 thanks to 360-graden static photos.

“These are also the three different ways you can capture content used to create Virtual Reality-toepassingen,” explains Werner Soeteman. "The interactive virtual cockpit was entirely created by our team of VR-developers and 3D-designers using computers. For the 360-degree film and -fotos, one of our VR engineers flew in the cockpit with an advanced 360-graden camera. All this was done in close collaboration with the pilots of KLM Cityhopper. Our developers themselves have no idea how a Embraer-vliegtuig works, although they've come a long way."

The interactive virtual cockpit was entirely created by our team of VR-developers and 3D-designers using computers. For the 360-degree film and -fotos, one of our VR engineers with an advanced360-graden camera flew

Remco de Jong also had the pleasure of trying out the virtual cockpit himself. Despite it being over ten years since he last flew in a cockpit, he really enjoyed getting hands-on with the controls once again.

The VR-applicatie was built for the Oculus Quest 2 and uses Facebook Workplace, the software management platform of Oculus for Business. Want to learn more about Oculus for Business? Then read our blogOculus for Business: Everything You Need to Know 

Like many other companies and organisations, KLM has also explored which standalone VR-bril is most suitable for the application. Ultimately, the Pico Neo 2 and the Oculus Quest 2 (for Business) remained in consideration. The choice fell on the Oculus Quest 2 because it ultimately provided the most comfort for the user. A common complaint against the Pico Neo 2 is the occurrence of drift over time. This is a disturbing effect that becomes increasingly problematic during a user session. It means there is a discrepancy between the physical location where you are at that moment and the virtual location. Unconsciously, this effect also introduces a feeling of nausea in the user (also known as motion-sickness). With the Oculus Quest 2, this effect is virtually absent, providing a better user experience. For more information on this, we refer you to our other blog:Oculus Quest 2 vs. Pico Neo 2.

For centralised HMD-management, kiosk mode, and other development options, KLM has access to Facebook Workplace and Application Management. These functions are only available with the Oculus Quest 2 for Business-variant. An additional advantage of working with Oculus is that the Oculus-ontwikkelaars are easily accessible and have even added requested features and capabilities for KLM, according to Werner.

Together with Chris Koomen, VR-specialist of the KLM XR Center of Excellence, Remco received a further tour of the XR-lab. In addition to flight-crew training, a bridge training was created, allowing staff to learn how tooperate the passenger bridge. This is a moveable bridge, attached to the terminal via hinges and then swung vertically and horizontally, and extended (or shortened) to be coupled to an aircraft. This training prevents staff from having to practise on a real aircraft, saving costs and, of course, preventing potential damage to the aircraft.

Finally, the gentlemen spoke about the deployment of the newVarjo XR-3 for KLM's VR training. The latest headsets from Varjo deliver unmatched visual fidelity in industries where absolute precision is needed, such as training and simulation, design, engineering, medical, and research. Varjo has already created several applications for aviation, including an eye-tracking demo for air traffic control and a flight simulation training. All in all, it was a wonderful and constructive day at KLM, where Remco also felt his old pilot's blood boiling again. Thanks to Werner Soeteman and Chris Koomen.

Unbound XR is the dedicated XR hardware partner of KLM. We distinguish ourselves through our focus on hardware. With this specialism, we are a reliable partner for many organisations like KLM, providing all XR-related hardware from our catalogue and beyond. More info or can we assist your company with something? Then get incontact touch with us.