editor's blog
Subscribe Now

Simultaneous alternative views

Embedded vision systems are providing more opportunities for machines to see the world in the same way that our eyes see them (and our brains interpret them), but variants of these technologies are also enabling systems to see things in ways we can’t.

Imec has just announced a new “hyperspectral” camera system for use in medical and industrial inspection systems or anywhere specific filters are needed to understand specific characteristics of whatever is being viewed. In such situations, simply looking at one bandwidth of light may not be enough; a complement of filters may be needed either to provide a signature or to evaluate multiple characteristics at the same time.

One way this is done now is to take separate images, each with a different filter, time-domain multiplexed. This slows the overall frame rate, divided down by the number of filters. The new approach allows full-frame-rate images with all filters simultaneously.

There are actually two versions of this, which imec calls “shapshot” and “linescan.” We’ll look at snapshot first, as this is particularly new. It’s intended for image targets that are either stationary or moving in a random way (or, more specifically, not moving in a line as if on a conveyor belt). The imaging chip is overlaid with tiles, each of which is a different filter.

The filters are the last masked layers of the chip – this is monolithic integration, not assembly after the fact. The filter consists of two reflecting surfaces with a cavity between; the size of the cavity determines the frequency. This means that the final chip will actually have a non-planar surface because of the different cavity sizes – and therefore different heights – of the filter layer. Because these make up the last layers to be processed, it’s convenient for staging base wafers for final processing with custom filter patterns.

The camera lens then directs, or duplicates, the entire scene to every tile. Perhaps it’s better to think of it as an array of lenses, much like a crude plenoptic lens. This gives every filter the full image at the same time; the tradeoff against time-domain multiplexing filters over the lens instead is that you get the resolution of one tile of the imaging chip, not the entire imaging chip.

A camera optimized for linescan applications doesn’t use the plenoptic approach; instead, the tiles are made very small and, as the image moves under the camera at a known rate, multiple low-resolution images are captured and then stitched back together using computational photography techniques.

The lensing system determines the bandwidth characteristics, since you can design this with filters having wider or narrower bandwidths and with or without gaps between the filters. This allows a range from continuous coverage to discrete lines. A collimating lens will direct light in straight lines onto the filters, providing narrow bandwidth; a lens that yields conical light will give wider bandwidth due to interference from the different filters with this light. The aperture size then acts as a bandwidth knob.

Imec has put together a development kit that allows designers to figure out which filters to use for a given linescan application; they’ll be providing one for snapshot cameras as well. Each filter configuration is likely be very specific to its application, making this something of a low-volume business for now. Because of that, and in order to grow the market, imec will actually be open for commercial production of these systems.

You can find more details in their release.

Leave a Reply

featured blogs
Jun 6, 2023
Learn about our PVT Monitor IP, a key component of our SLM chip monitoring solutions, which successfully taped out on TSMC's N5 and N3E processes. The post Synopsys Tapes Out SLM PVT Monitor IP on TSMC N5 and N3E Processes appeared first on New Horizons for Chip Design....
Jun 6, 2023
At this year's DesignCon, Meta held a session on '˜PowerTree-Based PDN Analysis, Correlation, and Signoff for MR/AR Systems.' Presented by Kundan Chand and Grace Yu from Meta, they talked about power integrity (PI) analysis using Sigrity Aurora and Power Integrity tools such...
Jun 2, 2023
I just heard something that really gave me pause for thought -- the fact that everyone experiences two forms of death (given a choice, I'd rather not experience even one)....

featured video

Synopsys Solution for Comprehensive Low Power Verification

Sponsored by Synopsys

The growing complexity of power management in chips requires a holistic approach to UPF power-intent generation and low power verification. Learn how Synopsys addresses these requirements with a comprehensive solution for low-power verification.

Learn more about Synopsys’ Energy-Efficient SoCs Solutions

featured paper

EC Solver Tech Brief

Sponsored by Cadence Design Systems

The CadenceĀ® Celsiusā„¢ EC Solver supports electronics system designers in managing the most challenging thermal/electronic cooling problems quickly and accurately. By utilizing a powerful computational engine and meshing technology, designers can model and analyze the fluid flow and heat transfer of even the most complex electronic system and ensure the electronic cooling system is reliable.

Click to read more

featured chalk talk

What are the Differences Between an Integrated ADC and a Standalone ADC?
Sponsored by Mouser Electronics and Microchip
Many designs today require some form of analog to digital conversion but how you implement an ADC into your design can make a big difference when it comes to accuracy and precision. In this episode of Chalk Talk, Iman Chalabi from Microchip and Amelia Dalton investigate the benefits of both integrated ADC solutions and standalone ADCs. They discuss the roles that internal switching noise, process technology, and design complexity play when choosing the right ADC solution for your next design.
Apr 17, 2023
6,388 views