A while back, when looking at Elliptic Labs ultrasonic gesture recognition, we mentioned that they were able to do this based on the fact that Knowles microphones worked in the ultrasonic range. But they weren’t willing to say much more about the microphones.
So I checked with Knowles; they had announced their ultrasonic microphone back in June. My first question was whether this was just a tweak of the filters or if it was a completely new sensor. And the answer: the MEMS is the same as the one used for their regular audio microphones; they’ve changed the accompanying ASIC. The packaging is also the same.
The next obvious question is, what is this good for, other than gesture recognition? Things got a bit quieter there – apparently there are some use cases being explored, but they can’t talk about them. So we’ll have to watch for those.
But with respect to the gesture thing, it turns out that, in theory, this can replace the proximity sensor. It’s low enough power that the mic can be operated “always on.” Not only can it detect that something is nearby, in the manner of a proximity sensor, it can go it one better: it can identify what that item is.
From a bill-of-materials (BOM) standpoint, at present you still need to use a separate ultrasonic transmitter, so you’re replacing one component (the proximity detector) with another (the transmitter). But in the future, the speakers could be leveraged, eliminating the transmitter.
It occurred to me, however, that, for this to become a thing, the ultrasonic detection will really need to be abstracted at the OS (or some higher) level, separating it from the regular audio stream. The way things are now, if you plugged a headset into the phone or computer, all the audio gets shunted to the headset, including the ultrasonic signal. Which probably isn’t useful unless you’re trying to teach your dog to use the phone (hey, they’re that intuitive!).
For this really to work, only the audible component should be sent to the headset; the ultrasonic signal and its detection would need to stay in the built-in speaker/mic pair to enable gesture recognition. Same thing when plugging in external speakers.
I’m sure that’s technically doable, although it probably disturbs a part of the system that’s been fixed for years. Which is never fun to dig into. But sometimes you’ve just got to grit your teeth and shed some of the legacy hardware in order to move forward.
You can find out more about Knowles’ ultrasonic microphone here.
[Editor’s note: For anyone clicking in through LinkedIn, I changed the title. It was supposed to be light, but, too late, I realized it could be taken as negative, which wasn’t the intent.]
(Image courtesy Knowles)
