industry news
Subscribe Now

Imagination unveils industry’s most scalable Image Signal Processing architecture

London, UK – 18 November, 2013 – Imagination Technologies (IMG.L) announces a ground-breaking new camera Image Signal Processing (ISP) architecture codenamed ‘Raptor.’ Imagination designed the PowerVR Series2 ‘Raptor’ imaging pipeline architecture from the ground-up to be optimized for integration into next-generation System-on-Chips (SoCs) for a broad range of imaging and vision applications.

‘Raptor’ is also the first ISP designed to operate as a cooperative part of a heterogeneous computing platform for advanced functions and next-generation applications. The ‘Raptor’ architecture takes ISP to the next level, providing the basis for context-aware applications such as facial and gesture recognition, augmented reality and more.

Highly power-efficient, and with a comprehensive configurable pipeline, ‘Raptor’ is ideal for low-power products such as mobile and wearables, and can seamlessly scale to provide the performance needed for UltraHD video, multi-megapixel photography and higher pixel depth sensors. Because it was built for efficient extensibility, the ‘Raptor’ architecture easily extends to address these high-end products with higher pixel counts without impacting the efficiency of the base architecture.

Says Martin Ashton, EVP engineering, PowerVR Visual IP, Imagination: “‘Raptor’ offers the ultimate in performance within the power envelope of a mobile device, providing a unique solution for next-generation applications. Vision systems will be a major driver for future consumer technologies, and a primary differentiator for products such as smartphones, tablets, IoT and emerging automotive applications. With our PowerVR graphics and video processors and MIPS CPUs, Imagination already powers these types of products. ‘Raptor’ adds a critical component which will allow our licensees to implement entire multimedia systems where the whole is much more than the sum of the parts.”

“With its Raptor ISP, which has features such as simultaneous multi-sensor support, 16-bit capability, and a path to 4K, Imagination is demonstrating that it knows what is needed for next generation imaging. This is how you leap the crowd,” says Jon Peddie, president, Jon Peddie Research.

Taking ISP to the next level 

The ‘Raptor’ architecture provides the features and functionality needed for optimal integration with utilization of modern CMOS camera sensors, including features such as:

  • Support for up to 16bit pixel depth to provide appropriate dynamic range for automotive, security and other challenging real-world applications
  • Ability to configure the pixel depth of the pipeline to match the sensor, conserving power compared to DSPs with fixed datapath widths
  • Multiple sensor support with fast context switching, enabling stereo, multi-cam and vision array support for volumetric imaging, with single ISP
  • Ability to output image statistics and meta data to an Imagination hardware video encoder for bestin-class encode quality and real-time bitrate control
  • Support for emerging 10-bit sensor outputskey for 4K/Ultra-HD TV
  • Full support for CMOS sensors from all major vendors

Optimized for SoC integration 

Today’s HD video cameras are expected to be small enough to be mounted on equipment such as helmets and skateboards, and DSLR (Digital Single-Lens Reflex) functions are migrating into compact and mirrorless format cameras. Smartphones and tablets are increasingly required to integrate full HD video and DSC (digital still camera) capabilities, and specialist technologies such as robotic vision for visually-aware apps. With these trends, companies are challenged to meet size, cost and power constraints. By integrating ISP functionality onto the SoC, companies can achieve high performance while saving cost and power.

Imagination takes a whole system approach to design of IP, creating optimizations between and within IP blocks to allow implementation of ultra-efficient subsystems. ‘Raptor’ provides flexible access to both programmable and hard wired system resources, enabling optimizations such as:

  • Zero memory output to video encode and vision accelerators for low-power, low-latency applications; fast, low power vision systems; and flexible sensor array support
  • Image analysis to produce metadata for improved video encode bitrate and quality control
  • Optimized software to implement zero copy computational photography via standards extensions
  • Re-entrant streaming port to allow image data to be streamed to custom hardware vision processors and then re-inserted to the ISP pipe

Close connections between ‘Raptor’ IP cores and other SoC resources can break down the barriers to enabling full support of Ultra-HD video and high pixel count photography in mobile devices and tablets. Close coupling to Imagination’s PowerVR VXE core reduces memory traffic and enables better allocation of bitrate to produce superior image quality for a given bitrate.

Small-format sensor limitations today mean that high pixel count photography requires a significant amount of additional processing. By enabling hardware-based computational photography on a core such as the PowerVR Series6 GPU, the ‘Raptor’ architecture can overcome the 13Mpixel barrier for mobile devices, providing better non-bayer pattern demosaicing, noise reduction and more.

Tools and Software Support 

Imagination is providing comprehensive software for ISP, lens and sensor tuning to enable customers to support a wide variety of industry-leading sensors and lenses such as those from Aptina, Omnivision, Sony and ST. Also included are software drivers to support Linux, Android and other operating systems including real-time operating systems.

Vision and imaging expertise 

In developing ‘Raptor’, Imagination leveraged its deep and proven vision technology experience, gained through the acquisition of Nethra’s class-leading ISP solution (Series1). Imagination’s vision technologies have shipped in millions of products, including sports cameras and high-end cinema cameras, over multiple generations. Imagination’s unique expertise in tuning image pipelines for specific sensor and lens combinations is vital to enabling the next generation of products.

PowerVR ‘Raptor’ IP cores from Imagination 

As part of its portfolio of market-leading PowerVR video and vision IP, Imagination will offer a range of synthesizable ISP intellectual property (IP) cores based on ‘Raptor.’ Targeting specific market segments, the new ISP cores will begin rolling out in the first quarter of 2014, and are available for licensing to lead partners today.

About Imagination Technologies 

Imagination Technologies – a global leader in multimedia, processor, communication and cloud technologies – creates and licenses market-leading processor solutions including graphics, video, vision, CPU and embedded processing, multi-standard communications, cross-platform V.VoIP and VoLTE and cloud connectivity. These silicon and software intellectual property (IP) solutions for systems-on-chip (SoC) are complemented by an extensive portfolio of software, tools and ecosystems. Target markets include mobile phone, connected home consumer, mobile and tablet computing, in-car electronics, networking, telecoms, health, smart energy and connected sensors. Imagination’s licensees include many of the world’s leading semiconductor manufacturers, network operators and OEM/ODMs. Corporate headquarters are located in the United Kingdom, with sales and R&D offices worldwide. See: www.imgtec.com.

Leave a Reply

featured blogs
Mar 28, 2024
'Move fast and break things,' a motto coined by Mark Zuckerberg, captures the ethos of Silicon Valley where creative disruption remakes the world through the invention of new technologies. From social media to autonomous cars, to generative AI, the disruptions have reverberat...
Mar 26, 2024
Learn how GPU acceleration impacts digital chip design implementation, expanding beyond chip simulation to fulfill compute demands of the RTL-to-GDSII process.The post Can GPUs Accelerate Digital Design Implementation? appeared first on Chip Design....
Mar 21, 2024
The awesome thing about these machines is that you are limited only by your imagination, and I've got a GREAT imagination....

featured video

We are Altera. We are for the innovators.

Sponsored by Intel

Today we embark on an exciting journey as we transition to Altera, an Intel Company. In a world of endless opportunities and challenges, we are here to provide the flexibility needed by our ecosystem of customers and partners to pioneer and accelerate innovation. As we leap into the future, we are committed to providing easy-to-design and deploy leadership programmable solutions to innovators to unlock extraordinary possibilities for everyone on the planet.

To learn more about Altera visit: http://intel.com/altera

featured chalk talk

PIC32CX-BZ2 and WBZ451 Multi-Protocol Wireless MCU Family
Sponsored by Mouser Electronics and Microchip
In this episode of Chalk Talk, Amelia Dalton and Shishir Malav from Microchip explore the benefits of the PIC32CX-BZ2 and WBZ45 Multi-protocol Wireless MCU Family and how it can make IoT design easier than ever before. They investigate the components included in this multi-protocol wireless MCU family, the details of the software architecture included in this solution, and how you can utilize these MCUs in your next design.
May 4, 2023
37,876 views