industry news
Subscribe Now

Imagination unveils industry’s most scalable Image Signal Processing architecture

London, UK – 18 November, 2013 – Imagination Technologies (IMG.L) announces a ground-breaking new camera Image Signal Processing (ISP) architecture codenamed ‘Raptor.’ Imagination designed the PowerVR Series2 ‘Raptor’ imaging pipeline architecture from the ground-up to be optimized for integration into next-generation System-on-Chips (SoCs) for a broad range of imaging and vision applications.

‘Raptor’ is also the first ISP designed to operate as a cooperative part of a heterogeneous computing platform for advanced functions and next-generation applications. The ‘Raptor’ architecture takes ISP to the next level, providing the basis for context-aware applications such as facial and gesture recognition, augmented reality and more.

Highly power-efficient, and with a comprehensive configurable pipeline, ‘Raptor’ is ideal for low-power products such as mobile and wearables, and can seamlessly scale to provide the performance needed for UltraHD video, multi-megapixel photography and higher pixel depth sensors. Because it was built for efficient extensibility, the ‘Raptor’ architecture easily extends to address these high-end products with higher pixel counts without impacting the efficiency of the base architecture.

Says Martin Ashton, EVP engineering, PowerVR Visual IP, Imagination: “‘Raptor’ offers the ultimate in performance within the power envelope of a mobile device, providing a unique solution for next-generation applications. Vision systems will be a major driver for future consumer technologies, and a primary differentiator for products such as smartphones, tablets, IoT and emerging automotive applications. With our PowerVR graphics and video processors and MIPS CPUs, Imagination already powers these types of products. ‘Raptor’ adds a critical component which will allow our licensees to implement entire multimedia systems where the whole is much more than the sum of the parts.”

“With its Raptor ISP, which has features such as simultaneous multi-sensor support, 16-bit capability, and a path to 4K, Imagination is demonstrating that it knows what is needed for next generation imaging. This is how you leap the crowd,” says Jon Peddie, president, Jon Peddie Research.

Taking ISP to the next level 

The ‘Raptor’ architecture provides the features and functionality needed for optimal integration with utilization of modern CMOS camera sensors, including features such as:

  • Support for up to 16bit pixel depth to provide appropriate dynamic range for automotive, security and other challenging real-world applications
  • Ability to configure the pixel depth of the pipeline to match the sensor, conserving power compared to DSPs with fixed datapath widths
  • Multiple sensor support with fast context switching, enabling stereo, multi-cam and vision array support for volumetric imaging, with single ISP
  • Ability to output image statistics and meta data to an Imagination hardware video encoder for bestin-class encode quality and real-time bitrate control
  • Support for emerging 10-bit sensor outputskey for 4K/Ultra-HD TV
  • Full support for CMOS sensors from all major vendors

Optimized for SoC integration 

Today’s HD video cameras are expected to be small enough to be mounted on equipment such as helmets and skateboards, and DSLR (Digital Single-Lens Reflex) functions are migrating into compact and mirrorless format cameras. Smartphones and tablets are increasingly required to integrate full HD video and DSC (digital still camera) capabilities, and specialist technologies such as robotic vision for visually-aware apps. With these trends, companies are challenged to meet size, cost and power constraints. By integrating ISP functionality onto the SoC, companies can achieve high performance while saving cost and power.

Imagination takes a whole system approach to design of IP, creating optimizations between and within IP blocks to allow implementation of ultra-efficient subsystems. ‘Raptor’ provides flexible access to both programmable and hard wired system resources, enabling optimizations such as:

  • Zero memory output to video encode and vision accelerators for low-power, low-latency applications; fast, low power vision systems; and flexible sensor array support
  • Image analysis to produce metadata for improved video encode bitrate and quality control
  • Optimized software to implement zero copy computational photography via standards extensions
  • Re-entrant streaming port to allow image data to be streamed to custom hardware vision processors and then re-inserted to the ISP pipe

Close connections between ‘Raptor’ IP cores and other SoC resources can break down the barriers to enabling full support of Ultra-HD video and high pixel count photography in mobile devices and tablets. Close coupling to Imagination’s PowerVR VXE core reduces memory traffic and enables better allocation of bitrate to produce superior image quality for a given bitrate.

Small-format sensor limitations today mean that high pixel count photography requires a significant amount of additional processing. By enabling hardware-based computational photography on a core such as the PowerVR Series6 GPU, the ‘Raptor’ architecture can overcome the 13Mpixel barrier for mobile devices, providing better non-bayer pattern demosaicing, noise reduction and more.

Tools and Software Support 

Imagination is providing comprehensive software for ISP, lens and sensor tuning to enable customers to support a wide variety of industry-leading sensors and lenses such as those from Aptina, Omnivision, Sony and ST. Also included are software drivers to support Linux, Android and other operating systems including real-time operating systems.

Vision and imaging expertise 

In developing ‘Raptor’, Imagination leveraged its deep and proven vision technology experience, gained through the acquisition of Nethra’s class-leading ISP solution (Series1). Imagination’s vision technologies have shipped in millions of products, including sports cameras and high-end cinema cameras, over multiple generations. Imagination’s unique expertise in tuning image pipelines for specific sensor and lens combinations is vital to enabling the next generation of products.

PowerVR ‘Raptor’ IP cores from Imagination 

As part of its portfolio of market-leading PowerVR video and vision IP, Imagination will offer a range of synthesizable ISP intellectual property (IP) cores based on ‘Raptor.’ Targeting specific market segments, the new ISP cores will begin rolling out in the first quarter of 2014, and are available for licensing to lead partners today.

About Imagination Technologies 

Imagination Technologies – a global leader in multimedia, processor, communication and cloud technologies – creates and licenses market-leading processor solutions including graphics, video, vision, CPU and embedded processing, multi-standard communications, cross-platform V.VoIP and VoLTE and cloud connectivity. These silicon and software intellectual property (IP) solutions for systems-on-chip (SoC) are complemented by an extensive portfolio of software, tools and ecosystems. Target markets include mobile phone, connected home consumer, mobile and tablet computing, in-car electronics, networking, telecoms, health, smart energy and connected sensors. Imagination’s licensees include many of the world’s leading semiconductor manufacturers, network operators and OEM/ODMs. Corporate headquarters are located in the United Kingdom, with sales and R&D offices worldwide. See:

Leave a Reply

featured blogs
Jan 27, 2023
Wow, it's already the last Friday in January, so time for one of my monthly update posts where I cover anything that doesn't justify its own full post or which is an update to something I wrote about earlier. Automotive Security I have written about automotive secur...
Jan 26, 2023
By Slava Zhuchenya Software migration can be a dreaded endeavor, especially for electronic design automation (EDA) tools that design companies… ...
Jan 24, 2023
We explain embedded magnetoresistive random access memory (eMRAM) and its low-power SoC design applications as a non-volatile memory alternative to SRAM & Flash. The post Why Embedded MRAMs Are the Future for Advanced-Node SoCs appeared first on From Silicon To Software...
Jan 19, 2023
Are you having problems adjusting your watch strap or swapping out your watch battery? If so, I am the bearer of glad tidings....

featured video

Synopsys 224G & 112G Ethernet PHY IP OIF Interop at ECOC 2022

Sponsored by Synopsys

This Featured Video shows four demonstrations of the Synopsys 224G and 112G Ethernet PHY IP long and medium reach performance, interoperating with third-party channels and SerDes.

Learn More

featured chalk talk

Chipageddon: What's Happening, Why It's Happening and When Will It End

Sponsored by Mouser Electronics and Digi

Semiconductors are an integral part of our design lives, but supply chain issues continue to upset our design processes. In this episode of Chalk Talk, Ronald Singh from Digi and Amelia Dalton investigate the variety of reasons behind today’s semiconductor supply chain woes. They also take a closer look at how a system-on-module approach could help alleviate some of these issues and how you can navigate these challenges for your next design.

Click here for more information about DIGI ConnectCore 8M Mini