editor's blog
Subscribe Now

Sensor Fusion Sea Change

As I have observed and listened to the things that folks in the sensor fusion business (whether purveyors of sensors or sensor-agnostic) have been saying, there’s something of a change in the air, and it was reinforced at CES. The focus of fusion is shifting.

At the very bottom of the fusion stack are complex mathematical relationships that turn, for example, individual sensor readings into higher-level orientation information. Clearly, there’s been a period where getting that right and getting it all to be computed in real time was an effort. But that time appears to be over. Things are moving up in abstraction, but there’s a big qualitative change that’s coming with that.

The math, however, complex, more or less provides a “right answer” that’s not subject to judgment. All sensor fusion implementations would presumably agree on the answer.

The bigger effort now is not on getting the math right. Now the issue is: which sensor should I listen to? For example, if the mag sensor shows movement but the accelerometer hasn’t budged, should the mag data be ignored? Or, more perniciously, if a gyro indicates movement but the mag doesn’t, then ignore the gyro… but if the mag indicates movement and the gyro doesn’t then ignore the mag?

As will be evident in various stories I’ll elaborate on over the next little while, the challenge these days seems to be on comparing various inputs and then deciding whom to believe. And this feeds into a higher-level concept that I heard mentioned numerous times at CES: context.

Context has implications far beyond simple questions of, for instance, orientation. But judging which sensors to acknowledge and which to ignore is really a primitive context exercise.

And here’s where it’s qualitatively different from what’s come before: There is no right answer. Well, I mean, I guess there is a right answer (or, perhaps stated more accurately, any of us that have had our devices try to be too clever and guess what we’re doing, there are many wrong answers). But this is not a math problem: It’s a heuristic problem. Which means that ten different fusions algorithms may approach the problem ten different ways.

This is actually good for competition in that there can be true differentiation. It also means that several completely different approaches may all work well, which suppresses that differentiation.

The bottom line to me is that it all feels slightly more messy and complex than the complex math. Structuring an algorithm replete with heuristics can be tough – if you want to make it flexible enough to accommodate frequent changes and refinements to the algorithm. Over time, I wouldn’t be surprised to see this be a strong contributing factor in determining who wins and who loses in the long term.

Leave a Reply

featured blogs
Sep 23, 2020
The great canning lid shortage of 75, the great storm of 87, the great snow of 54, the great freeze of 48... will we one day be talking about the great toilet roll shortage of 2020?...
Sep 23, 2020
CadenceLIVE 2020 India, our first digital conference held on 9-10 September and what an event it was! With 75 technical paper presentations, four keynotes, a virtual exhibition area, and fun... [[ Click on the title to access the full blog on the Cadence Community site. ]]...
Sep 22, 2020
I am a child of the 80s.  I grew up when the idea of home computing was very new.  My first experience of any kind of computer was an Apple II that my Dad brought home from work. It was the only computer his company possessed, and every few weeks he would need to cr...
Sep 18, 2020
[From the last episode: We put the various pieces of a memory together to show the whole thing.] Before we finally turn our memory discussion into an AI discussion, let'€™s take on one annoying little detail that I'€™ve referred to a few times, but have kept putting off. ...

Featured Video

DesignWare MIPI C-PHY/D-PHY IP Performance at 24 Gbps

Sponsored by Synopsys

This video features the DesignWare MIPI C-PHY/D-PHY IP interoperating with an image sensor in C-PHY mode up to 3.5 Gsps per trio and D-PHY mode up to 4.5 Gbps per lane, available in FinFET processes for camera and display applications.

More information about Synopsys DesignWare MIPI C-PHY/D-PHY IP

Featured Paper

Helping physicians achieve faster, more accurate patient diagnoses with molecular test technology

Sponsored by Texas Instruments

Point-of-care molecular diagnostics (PoC) help physicians achieve faster, more accurate patient diagnoses and treatment decisions. This article breaks down how molecular test technology works and the building blocks for a PoC molecular diagnostics analyzer sensor front end system.

Read the Article

Featured Chalk Talk

Magnetics for High Voltage

Sponsored by Mouser Electronics and Bourns

With today’s trend toward ever-increasing voltages in energy systems, choosing the right transformer for the job has become an engineering challenge. High voltages demand careful attention to insulation, clearance, and creepage. In this episode of Chalk Talk, Amelia Dalton chats with Cathal Sheehan of Bourns about choosing magnetics for high-voltage applications.

More information about Bourns Magnetics for High Voltage Applications