industry news
Subscribe Now

A smart radar system for gesture recognition and non-contact vital signs monitoring.

Imec adds machine learning to its 140GHz radar technology to enable intuitive man-machine interactions

LEUVEN (Belgium) and EINDHOVEN (The Netherlands), May 13, 2019 — This week, at FutureSummits 2019, imec, a world-leading research and innovation hub in nanoelectronics and digital technologies, presents a compact highly-sensitive 140GHz MIMO  (multiple-input multiple-output) radar system. The MIMO setup is demonstrated for gesture recognition, supporting intuitive man-machine interactions. In addition, the ultra-fine resolution of this radar allows the detection micro-skin movements related to vital signs serving applications like non-contact driver monitoring or patient monitoring.

Key differentiators of imec’s 140GHz radar-on-chip prototype system are its small size and high radar performance – in terms of resolution and motion sensitivity. The radar operates up to 10m range, with 15mm range resolution and 10GHz of RF bandwidth. Multiple antenna paths are incorporated to enable a complete (virtual) 1×4 MIMO configuration to achieve angular target separation. The transceiver chip features on-chip antennas, and are integrated in 28nm bulk CMOS technology, ensuring a low-cost solution at high volume production. These properties make the radar system particularly appealing for applications where high-precision, small-motion based detection is key.

By adding machine learning capabilities, imec has now demonstrated the feasibility of the radar to detect and classify small motions based on Doppler information. “This opens new opportunities, for example, enabling gesture recognition for intuitive man-machine interactions”, adds Barend van Liempd, R&D manager at imec. “Think about the AR/VR space, where the new radar can support intuitive interaction with virtual objects. Gesture recognition can potentially also enable intuitive device control – complementary to existing interfaces such as voice control or smart touch screens.” Being insensitive to lighting conditions and preserving privacy (a radar can so far not recognize humans), a radar solution has particular advantages over other types of motion sensors, for example time-of-flight-based infrared cameras. And, being extremely compact, imec’s 140GHz radar system can be integrated invisibly in almost every device, such as laptops, smartphones or screen bezels.

Imec has developed a specific machine learning algorithm based on a multi-layer neural network including an LSTM layer and using supervised learning to train the inference model by using in-house labeled recordings of more than 25 people, including several captures for each of 7 different gestures. Against the experimental dataset, the model classifies the recorded 7 gestures and predicts the right gesture at least 94% of the time.

Aside from gestures, vital signs can also be measured with very high precision thanks to the high radio frequency. Therefore, the radar is an excellent candidate for in-car vital sign monitoring systems, to enable non-contact tracking of the driver’s state, e.g. to detect falling asleep, abnormal stress levels or possibly to prevent accidents due to acute health hazards, e.g. heart or epilepsy attacks. Another possible application is to monitor small children using motion and vital signs detection, even when the infant is covered by a blanket and asleep, e.g. to provide an alert in case a child is unintentionally left in a vehicle.

To enlarge data richness and spatial information, imec is currently building a 4×4 MIMO radar system, for which a new generation of radar chips is under development – incorporating the TX and RX as separate chips. This will allow a greater flexibility in distributing the MIMO array elements across the available area. It will also be explored if the functionality of the standalone radar chips can be increased, to enable MIMO systems with even larger arrays of chips.

Imec’s 140GHz radar was developed in its open innovation R&D collaborative program on radar technology. Interested companies can partake in the program, or in a bilateral R&D project, or license the technology building blocks.

About imec

Imec is a world-leading research and innovation hub in nanoelectronics and digital technologies. The combination of our widely acclaimed leadership in microchip technology and profound software and ICT expertise is what makes us unique. By leveraging our world-class infrastructure and local and global ecosystem of partners across a multitude of industries, we create groundbreaking innovation in application domains such as healthcare, smart cities and mobility, logistics and manufacturing, energy and education.

As a trusted partner for companies, start-ups and universities we bring together more than 4,000 brilliant minds from over 97 nationalities. Imec is headquartered in Leuven, Belgium and has distributed R&D groups at a number of Flemish universities, in the Netherlands, Taiwan, USA, and offices in China, India and Japan. In 2018, imec’s revenue (P&L) totaled 583 million euro. Further information on imec can be found at www.imec-int.com.

Leave a Reply

featured blogs
Jan 21, 2020
For many years computer systems have augmented CPUs with special purpose accelerators that are targeted at specialized tasks. Examples of these co-processors include special purpose graphics and digital signal processors. Lately there has been an interest and significant rese...
Jan 21, 2020
My mother is convinced that I'm a prodigy (for some reason she spells it "i-m-b-e-c-i-l-e"), but it may be that innate genius lies dormant in all of us....
Jan 20, 2020
As you probably know, discrete wire component data is quite a bit different than just standard socket and terminal mating relationships. When we look at how Samtec approaches discrete wire products, there are several components involved. We not only sell the assemblies, but w...
Jan 17, 2020
[From the last episode: We saw how virtual memory helps resolve the differences between where a compiler thinks things will go in memory and the real memories in a real system.] We'€™ve talked a lot about memory '€“ different kinds of memory, cache memory, heap memory, vi...

Featured Video

RedFit IDC SKEDD Connector

Sponsored by Wurth Electronics and Mouser Electronics

Why attach a header connector to your PCB when you really don’t need one? If you’re plugging a ribbon cable into your board, particularly for a limited-use function such as provisioning, diagnostics, or testing, it can be costly and clunky to add a header connector to your BOM, and introduce yet another component to pick and place. Wouldn’t it be great if you could plug directly into your board with no connector required on the PCB side? In this episode of Chalk Talk, Amelia Dalton chats with Ben Arden from Wurth Electronics about Redfit, a slick new connector solution that plugs directly into standard via holes on your PCB.

Click here for more information about Wurth Electronics REDFIT IDC SKEDD Connector