System aligns objects in HUD to appear correctly

September 20, 2021 // By Christoph Hammerschmidt
System aligns objects in HUD to appear correctly
Belgian chipmaker Melexis and emotion3D, a Vienna-based provider of camera-based automotive in-cabin analysis software, have joined forces to offer a unique 3D Time-of-Flight (ToF) demonstrator. The solution combines the driver monitoring system (DMS) with high-precision driver localization, to dynamically align augmented reality head-up displays (AR HUD) objects.

The novel DMS from Melexis and emotion3D covers all basic functions such as driver drowsiness and attention warning to conform to the EU’s General Safety Regulation and Euro NCAP’s new testing protocols. In addition, the demonstrator provides 3D locations of the driver’s facial landmarks. These are relevant for an optimal augmented reality head-up display (AR HUD) user experience. The objects projected by the HUD require precise alignment with real-world objects, following the dynamic position changes of the driver.

The demonstrator consists of a camera built around Melexis’ recently improved MLX75027 3D ToF sensor and emotion3D’s advanced in-cabin analysis software (E3D ICMS). The software can be integrated in any automotive SoC of choice, the vendors promise.

“Regulatory requirements make it necessary to integrate DMS into new vehicles and augmented reality head-up displays become more and more popular. Our combined system offers a highly precise and cost-efficient solution for automotive manufacturers”, explains Florian Seitner, CEO of emotion3D.

The system combines accurate and robust 3D eye position detection for HUD with sunlight invariant eye gaze and eye openness detection for leaner DMS algorithm implementations. In this context, the use of ToF technology is key. “It is very easy to get accurate depth data from the 3D ToF sensor with low processing effort. The result is that the DMS and HUD algorithms work impressively well with wide-field of view lenses and VGA resolution ToF sensors,” explains Gualtiero Bagnuoli, Product Marketing Manager at Melexis.

 www.melexis.com

https://emotion3d.ai/

Related articles:

Time-of-flight sensor has QVGA resolution

Omnivision, Smart Eye roll comprehensive interior sensing solution

ST, Eyeris team up for in-cabin monitoring

Camera-based DMS fights distracted driving

 


Vous êtes certain ?

Si vous désactivez les cookies, vous ne pouvez plus naviguer sur le site.

Vous allez être rediriger vers Google.