editor's blog
Subscribe Now

Sensory Listens to Your Voice

Today we’ve put up a piece on designing audio subsystems, but there’s more news than that in the audio world. If you read our earlier piece on QuickLogic’s EOS device, and if you were paying attention to details, you might recall a quick mention of a company called Sensory that had partnered with QuickLogic for audio algorithms. Sensory subsequently released a product called TrulyHandsFree, and I connected with them to find out more about who they are and what they do.

In fact, they’ve been at this game for 21 years, so they’re not newcomers. They even sold (and still sell) neural-network-based chips with their algorithms, but their current focus is the algorithms themselves, sold as IP. In fact, they have both software and hardware IP (the latter of which featured on the QuickLogic part).

One of their important applications is biometric authentication: using voice as a security mechanism. It’s mostly for verification – given examples of authorized personnel, confirming by your voice that you’re who you say you are. They can also do some limited identification – that is, listening to your voice and coming up with who you are without your giving them any hints as to who you are. If they have, like, 10 people or so to choose from, they can do this. If they have to identify someone amongst thousands, though, they’re not there. (Yet, anyway.)

They’ve got three levels of product:

  • TrulyHandsFree: this is for low-end consumer products, requiring the least resources to get the job done. Low power, small footprint, always on. Small vocabulary, used for command and control. This is what was incorporated into the QuickLogic part.
  • TrulyNatural: This includes state-of-the-art algorithms for higher-end consumer devices like phones. Can handle a large vocabulary and continuous speech.
  • TrulySecure: this combines audio with video for authentication.

In general, authentication happens through a passphrase (ignoring the video in the last product). It can be a fixed passphrase, but that runs the risk that someone records the authorized person saying the passphrase and then replays it to fool the authentication. It’s better if the system issues random passphrases for the supplicant to utter. Then no one knows ahead of time exactly what will be required to pass.

Of course, with anything like this, you have to deal with false accepts (unauthorized person gets through) and false rejects (authorized person can’t get through). They actually have a dial that lets them set these rates, and the best balance will depend on the application, weighing the risk of unauthorized entry to the inconvenience (or worse) of not being able to get into your own system. There are no testing standards for this. They always assume that the user has done a reasonable training job, and they then look across a variety of noise and environmental conditions that might affect how the sound is perceived by the algorithms.

Of course, with small devices, the challenge is power, since you need this system always to be on. They say that, on average, TrulyHandsFree uses about 1 mA of current. Sound detection requires less than 1 MIPS and runs a couple hundred microamps or less. Once triggered, the recognition part runs 1.5 – 2.5 mA. Processing is staged, with each level ramping up as the prior level directs.

Speech_Graphic_6-3-15_600dpi_red.jpg

(Image courtesy Sensory)

They do as much processing locally as possible – for example, having a wearable work with a phone to do this if there’s not enough oomph in the wearable. That keeps things working even when there’s no connection, and it’s better for privacy. They can escalate to the cloud for more horsepower if necessary, which works particularly well if the thing being requested requires cloud access anyway.

Their latest announcement has them adding deep learning capabilities to their TrulyHandsFree product. They say that this increases their word accuracy by up to 80% while shrinking the size of their acoustic models by a factor of 10. This also lowers their power consumption to the levels discussed above. You can read more in their announcement.

Leave a Reply

featured blogs
Apr 4, 2020
That metaphorical '€œboing'€ sound you hear, figuratively speaking, is a symbolical ball allegorically landing on Chewy'€™s side of the illusory net....
Apr 3, 2020
Mentor’s Xpedition® IC Packaging design tools bridge the gap between engineering teams for IC layout, package substrate design, and PCB layout with solutions for Chip/Package/PCB prototyping and co-design. They also deliver a complete solution for High Density Advan...
Apr 3, 2020
[From the last episode: We saw some of the mistakes that can cause programs to fail and to breach security and/or privacy.] We'€™ve seen how having more than one program or user resident as a '€œtenant'€ in a server in the cloud can create some challenges '€“ at leas...
Apr 2, 2020
There are many historical innovations that are the product of adversity, and the current situation is an extreme example.  While it is not the first time that humanity has faced a truly global challenge like the COVID-19 pandemic, this time the world is connected by tech...

Featured Video

Automotive Trends Driving New SoC Architectures -- Synopsys

Sponsored by Synopsys

Today’s automotive trends are driving new design requirements for automotive SoCs targeting ADAS, gateways, connected cars and infotainment. Find out why it is essential to use pre-designed, pre-verified, reusable automotive-optimized IP to meet such new requirements and accelerate design time.

Drive Your Next Design to Completion Today with DesignWare IP® for Automotive SoCs