feature article
Subscribe Now

Living In the Shadows

isiQiri Detects Touch with Light

It’s funny… You’d think that, with touchscreens now in the hands of so many consumers, touch technology has to be a done deal. Moving on to the next thing. (Of course, then I see my own phone’s touchscreen get a life of its own, with phantom touches dancing all over the screen faster than I could ever do, calling people and adding nonsense contacts all without any involvement on my part, and it feels like touch has a long way to go.)

Late last year we took a look at touch technology, and, while projected capacitive (P-cap) touchscreens are seeing their age of dominance now, there are still a surprising number of different approaches being explored. This is particularly true for large-format surfaces – whiteboards and such – where, as we saw, some of the common technologies that work on a small scale peter out. The ability to handle multiple simultaneous touches – so-called multi-touch – is really where the action is. Got a new technology that will detect only one touch? It’s likely to be viewed as a “meh-too” approach.

One company, isiQiri, recently announced use of “frequency encoding” in large-format touch displays. That sounded unlike anything else I’d heard about, so I engaged with them to figure out what they’re doing.

It starts with something other than touch. They would take a semi-transparent projection screen and put a matrix of photo-diodes behind it. These photo-diodes include a dye that accepts blue light (and turns it into green light – color shifting is apparently a characteristic of this class of dye, but that aspect isn’t critical for our story).

If someone shines a blue laser pointer at the screen, the diodes can figure out where that point is located. In fact, if multiple laser pointers are aimed at the screen, all of them can be detected. The only challenge is, if you care about which point is which, well, they’re all made out of blue ticky-tacky and they all look just the same.

This is where the frequency encoding makes its initial entrance. By pulsing the blue lasers, with each laser having a distinct pulsing pattern, they can now tell which pointer is which.

All of which probably seems to have little to do with touch technology. But wait… it gets better.

While a photo-diode detects light, it can give you information not only about where light is, but also about where light isn’t. It can dwell in the light and in the shadows. For the projection screen application, it detects where light is. But it can be used in a touch application to detect shadows.

In this case, rather than having an array of diodes behind the surface, they create a perimeter of diodes that encloses the LCD. This border doesn’t affect the LCD itself, but rather goes into the bezel. They then put a laser in each corner of the display. They put a lens in front of the laser that fans the light in a 90° swath.

That light travels through the glass surface, remaining trapped unless some discontinuity is encountered. So the photo-diodes will, in general, gather back up all the light being emitted, and an observer may not notice anything at all since none of the light escapes through the surface.

But one way to create a discontinuity is to touch the screen. Now a few of the blue photons get curious about this thing on the surface and go to investigate, leaving the comfort of the glass much the way ant scouts go to investigate that eighth-inch dot of honey you didn’t notice you spilled on the counter so that they can invite 10,000 of their closest friends to come share in the bounty of the universe.

In fact, if it were dark and you were touching the screen, you might just see a faint blue glow as these photons sacrifice themselves in the name of figuring out who goes there.

The absence of these intrepid soldiers does not go unnoticed by the photo-diodes, and they duly record the existence of a shadow of sorts in the vicinity of the touch and call it in. And so a touch is registered.

Detecting more than one touch, however, isn’t quite as easy. If two fingers touch, one may be behind the other with respect to one of the lasers, and then the existence of the second touch couldn’t be detected. This is referred to as “occlusion,” And it’s where having a laser in each corner helps. But there are a couple of challenges that must be addressed:

  • What’s hidden to one laser may be visible to another, but the photodiodes simply see the sum total of light showing up. If the lasers are simply on, then there’s no way for the photo-diodes to know which light is coming from which laser. So the lasers have to be discriminated from each other. You might think that the laser pointer application provides the answer, and it does, kind of, but not as directly as you might think.
  • Unlike a darkened room with a screen, a room with a display will likely have the lights on, and those lights will emit light of many different colors, including the color emitted by the lasers in the corner of the display. Which means that the photo-diodes could have a hard time discriminating laser light from the ambient light.
  • It turns out that there are laser safety standards that have to be met. More than just, “Don’t shine them up at airplanes in the middle of the night because, believe it or not, they will figure out who you are, and they will get you and prosecute you with great vengeance and furious anger.” Simply blasting four lasers away can run afoul of those considerations.

So isiQiri uses a two-layered approach. On one layer, they pulse the lasers, somewhat like they do with the laser pointers, but the pulsing itself is the “code”; there is no difference between the coding of the four lasers. This pulse frequency can be selectively filtered to exclude ambient light. So this is how they discriminate between laser light and any other light that happens to be the same color.

The next layer both allows discrimination of the lasers from each other and adherence to the power restrictions. Instead of all four lasers simply being on, pulsing away, they are “rotated.” So only one is on at a time; it then blanks and the next one goes on and pulses; and so on, round-robin around the display. Since the circuitry knows which laser is on at any given time, it can figure out which shadows are caused by which lasers.

In addition, because each laser has a 25% duty cycle (and is pulsing, for a further 50% off-time), the power limits are met. These two elements  – pulsing and rotation – constitute the “frequency encoding.” There’s not much real coding in the pulsing, but the name somewhat reflects its pedigree.

There is a theoretical (and possibly practical) limitation for multi-touches involving more than four simultaneous touches. If we initially limit ourselves to considering static touches, imagine the two diagonals from corner to corner. Now imagine four touches, one along each diagonal, surrounding the center. All four of those touches can be detected. Now add one more touch, right in the center. That fifth touch will be occluded by the other four, since the surrounding touches are in the line of sight of all four lasers.

I asked isiQiri about this, and they agreed that, in theory, this is possible, although statistically very unlikely in reality, even for a static situation. (As you can imagine, setting this experiment up would involve careful placement of fingers, and if the middle finger were larger than the others, it still might be detected – in other words, you have to work hard to implement this corner case, reducing, if not eliminating, the chance that it happens by accident.)

It becomes even less of an issue for swipe gestures. If the four fingers are set up, for example, and the fifth is swiped through the center, it’s entirely likely that the motion-tracking algorithm will be able to patch the gap by interpolation, and any momentary occultation would not be noticed.

Their focus is large displays: they’re starting at 55” and can go to hundreds of inches. The lasers currently in use are strong enough to handle the extra size. It’s not a technology challenge to go bigger; it’s simply a market question. And because the lasers, lenses, and detectors go in the border, it doesn’t affect the actual manufacturing of an LCD (it could, frankly, be any surface that has a glass layer or a medium for carrying and containing the laser light).

Their hope is that this can make it easy to add touch capabilities to existing large-format surfaces with minimal disruption.

 

More info:

isiQiri

One thought on “Living In the Shadows”

Leave a Reply

featured blogs
Dec 8, 2023
Read the technical brief to learn about Mixed-Order Mesh Curving using Cadence Fidelity Pointwise. When performing numerical simulations on complex systems, discretization schemes are necessary for the governing equations and geometry. In computational fluid dynamics (CFD) si...
Dec 7, 2023
Explore the different memory technologies at the heart of AI SoC memory architecture and learn about the advantages of SRAM, ReRAM, MRAM, and beyond.The post The Importance of Memory Architecture for AI SoCs appeared first on Chip Design....
Nov 6, 2023
Suffice it to say that everyone and everything in these images was shot in-camera underwater, and that the results truly are haunting....

featured video

Dramatically Improve PPA and Productivity with Generative AI

Sponsored by Cadence Design Systems

Discover how you can quickly optimize flows for many blocks concurrently and use that knowledge for your next design. The Cadence Cerebrus Intelligent Chip Explorer is a revolutionary, AI-driven, automated approach to chip design flow optimization. Block engineers specify the design goals, and generative AI features within Cadence Cerebrus Explorer will intelligently optimize the design to meet the power, performance, and area (PPA) goals in a completely automated way.

Click here for more information

featured paper

Universal Verification Methodology Coverage for Bluespec RISC-V Cores

Sponsored by Synopsys

This whitepaper explains the basics of UVM functional coverage for RISC-V cores using the Google RISCV-DV open-source project, Synopsys verification solutions, and a RISC-V processor core from Bluespec.

Click to read more

featured chalk talk

Advancements in Motor Efficiency Enables More Sustainable Manufacturing
Climate change is encouraging the acceleration of sustainable and renewable manufacturing processes and practices and one way we can encourage sustainability in manufacturing is with the use of variable speed drive motor control. In this episode of Chalk Talk, Amelia Dalton chats with Maurizio Gavardoni and Naveen Dhull from Analog Devices about the wide ranging benefits of variable speed motors, the role that current feedback plays in variable speed motor control, and how precision measurement solutions for current feedback can lead to higher motor efficiency, energy saving and enhanced sustainability.
Oct 19, 2023
6,045 views