industry news
Subscribe Now

Melexis and emotion3D combine DMS and HUD dynamic object alignment in a single camera

Tessenderlo, Belgium, 20 September 2021 – Melexis, a global leader in automotive semiconductors, and emotion3D, a leading provider of camera-based automotive in-cabin analysis software, have joined forces to offer a unique 3D Time-of-Flight (ToF) demonstrator. The solution combines the driver monitoring system (DMS) with high-precision 3D driver localization, to dynamically align augmented reality head-up displays (AR HUD) objects.

Melexis and emotion3D’s novel DMS covers all basic functions such as driver drowsiness and attention warning to conform to the EU’s General Safety Regulation and Euro NCAP’s new testing protocols. In addition, the demonstrator provides 3D locations of the driver’s facial landmarks. These are relevant for an optimal augmented reality head-up display (AR HUD) user experience. The objects projected by the HUD require precise alignment with real-world objects, following the dynamic position changes of the driver.

The demonstrator consists of a camera built around Melexis’ MLX75027 3D ToF sensor and emotion3D’s advanced in-cabin analysis software (E3D ICMS). The software can be flexibly integrated in any automotive SoC of choice.

“Regulatory requirements make it necessary to integrate DMS into new vehicles and augmented reality head-up displays become more and more popular. Our combined system offers a highly precise and cost-efficient solution for automotive manufacturers”, notes Florian Seitner, CEO of emotion3D.

Gualtiero Bagnuoli, Product Marketing Manager at Melexis, comments on the benefits of ToF technology: “We combine accurate and robust 3D eye position detection for HUD with sunlight invariant eye gaze and eye openness detection for leaner DMS algorithm implementations. Use of ToF technology is key. It is very easy to get accurate depth data from the 3D ToF sensor with low processing effort. The result is that the DMS and HUD algorithms work impressively well with wide-field of view lenses and VGA resolution ToF sensors.”

For more information on the system and demo/evaluation opportunities, please contact Melexis or emotion3D:

Elcke Vercruysse
Marketing Communications Manager at Melexis
eve@melexis.com

Benedikt Spannocchi
Head of Business Development at emotion3D
bsp@emotion3D.ai

About Melexis:
Combining a passion for technology with truly inspired engineering, Melexis designs, develops and delivers innovative micro-electronic solutions that enable designers to turn ideas into applications that support the best imaginable future. The company’s advanced mixed-signal semiconductor sensor and actuator components address the challenges of integrating sensing, driving and communication into next-generation products and systems that improve safety, raise efficiency, support sustainability and enhance comfort. Melexis is headquartered in Belgium and employs around 1,500 people in 18 locations worldwide. The company is publicly traded on Euronext Brussels (MELE).

For more information, visit www.melexis.com

About emotion3D:
emotion3D is a leading provider of software for camera-based automotive in-cabin analysis. This analysis enables a comprehensive understanding of humans and objects inside a car. It is the basic building block for intelligent vehicle safety and advanced driving experience functions. Currently, emotion3D works with some of the largest automotive companies on new generations of in-cabin analysis systems.

For more information, visit www.emotion3d.ai

Leave a Reply

featured blogs
Jul 25, 2025
Manufacturers cover themselves by saying 'Contents may settle' in fine print on the package, to which I reply, 'Pull the other one'”it's got bells on it!'...

featured paper

Agilex™ 3 vs. Certus-N2 Devices: Head-to-Head Benchmarking on 10 OpenCores Designs

Sponsored by Altera

Explore how Agilex™ 3 FPGAs deliver up to 2.4× higher performance and 30% lower power than comparable low-cost FPGAs in embedded applications. This white paper benchmarks real workloads, highlights key architectural advantages, and shows how Agilex 3 enables efficient AI, vision, and control systems with headroom to scale.

Click to read more

featured chalk talk

Smarter Isolation for Smarter Power Systems
Sponsored by Mouser Electronics and Bourns
Today’s smarter power systems demand smarter gate drive isolation. In this episode of Chalk Talk, Kritika Murari from Bourns and Amelia Dalton explore the hidden complexities of gate drive isolation, how reinforced gate drive isolation can improve a variety of design parameters, and how you can take advantage of Bourns push pull isolation transformers for your next design.
Jul 14, 2025
15,428 views