industry news
Subscribe Now

Khronos and EMVA Collaborate to Gather Requirements for Embedded Camera and Sensor API Standards

Call for Exploratory Group participation to all sensor and camera manufacturers, silicon vendors, and software developers working on vision and sensor processing
Beaverton, OR — February 22, 2021 — Today, The Khronos® Group, an open consortium creating graphics and compute interoperability standards, and the European Machine Vision Association (EMVA), the leading European industry association dedicated to vision technology, jointly announce the formation of an Embedded Camera API Exploratory Group, open to all at no cost, to explore industry interest in the creation of open royalty-free API standards for controlling embedded cameras and sensors. All participants will be able to discuss use cases and requirements for new interoperability standards to accelerate market growth and reduce development costs in embedded markets using vision and sensor processing and associated acceleration. If the Exploratory Group reaches significant consensus then Khronos and EMVA will work to initiate the proposed standardization projects at the appropriate organizations.
All sensor and camera manufacturers, silicon vendors, and software developers working on vision and sensor processing are invited to participate in this initiative. More details and instructions for joining the group are here.
The Embedded Camera API Exploratory Group has been created in response to industry requests. Increasingly, camera sensors are being tightly integrated with image, vision and inferencing accelerators in self-contained systems. Innovation and efficiency in the embedded vision market is becoming constrained by the lack of open cross-vendor camera control API standards to reduce development and integration costs of multiple advanced sensors and cameras. A consistent set of interoperability standards and guidelines for embedded cameras and sensors could streamline deployment by manufacturers and system integrators by enabling control of a wide range of camera sensors, depth sensors, camera arrays and ISP hardware to generate sophisticated image streams for downstream processing by diverse accelerators.
This Exploratory Group will use Khronos’ proven framework for new initiatives in collaboration with the EMVA. Any companies, universities, consortiums, open-source participants, and industry experts who are willing to sign an NDA are welcome to join, at no cost. All participants will have an equal voice in exploring industry needs for, and benefits of, creating a consensus to develop a Scope of Work (SOW) document describing the objectives and high-level direction of standardization initiatives of value to the industry. The Exploratory Group is expected to meet online over a period of several months starting on March 25, 2021.
All Exploratory Group discussions will be covered by a simple project NDA to encourage open discussions. The Group is open to all proposals and relevant topics but will not discuss detailed technical design contributions to protect participants intellectual property (IP). If a SOW is agreed, Khronos and EMVA will work to initiate the standardization work at the most suitable host organizations or open source projects, using those organizations’ normal collaborative agreements and IP frameworks.
Many industry leaders have indicated an interest in joining the Exploratory Group, including ALL3D, Almalence, AMD, Apertus, AREA, Arm, Cadence, Codeplay, Collabora, EA, Facebook, Google, Holochip, HP, Huawei, LunarG, Mobica, NVIDIA, Oculus, OPPO, Qualcomm, RedHat, Texas Instruments, Ultraleap, and Valve from Khronos; as well as EMVA members and machine vision players such as Allied Vision, Basler AG, Baumer, MVTec, and Stemmer Imaging AG.
“Judging by the significant industry interest, the time seems right to organize an effort around identifying and aligning on the need for interoperability APIs for embedded cameras and sensors. This is a topic that is very relevant to Khronos as our acceleration APIs, such as OpenCL™, SYCL™, and OpenVX™ are often used to accelerate sophisticated sensor stream processing,” said Neil Trevett, Khronos Group president. “Our work is also very complementary to EMVA, and we are delighted that the two organizations are working together to bring a meaningful quorum from diverse parts of the industry into this cooperative exploratory process.”
”We are delighted to work with Khronos on this initiative to commonly understand the industry needs for the future of embedded vision,” said Dr. Chris Yates, EMVA president. “Both the EMVA and the Khronos group have a well-established history of standardization developments which enable industry to develop new products more simply, whilst ensuring friction is reduced in the market. This Exploratory Group is an excellent approach to understanding broader industry needs and will bring together many companies and views in an open forum. We look forward to working closely with the Khronos Group and welcoming all new and existing participants to this important initiative for the vision community.”
Supportive Quotes from the Industry
“Embedded vision is a natural progression from full-sized PC-based vision systems to systems on a chip and is critically important to the future of the vision industry. The industry has seen great benefits from digital interface/interoperability standards such as GigE Vison and USB3 Vision in expanding markets, reducing costs, and simplifying technology application. It makes great sense to continue these standardization concepts at the embedded level,” shared Jeff Burnstein, president of the Association for Advancing Automation (A3), parent association to AIA – Advancing Vision+Imaging.
“Lack of API standards for advanced use of embedded cameras and sensors is an impediment to industry growth, collaboration and innovation. Enterprise AR customers and systems integrators/value added providers will benefit from greater clarity, open interfaces between modular systems and innovation in the component provider ecosystem. Standards for camera and sensor control will increase opportunities for powerful new combinations of sensor and AR compute resources, integration with existing IT, and lower cost and complexity of future solutions,” said Christine Perey, interoperability and standards program leader for the Augmented Reality for Enterprise Alliance (AREA).
“The establishment of this Exploratory Group provides a great opportunity to connect with the Khronos Group, EMVA and industry partners to ensure that together we can create the best experience for embedded cameras on all Linux platforms,” explained Laurent Pinchart, lead architect of libcamera®. “The Linux camera community has seen a need for standardisation and interoperability in the embedded camera space for more than a decade. We launched the libcamera project two years ago to address that need, initiating an ambitious effort to reach out to the industry and improve Linux camera support for mobile, embedded and desktop systems. We are eagerly looking forward to actively participating in the Exploratory Group and deepening our collaboration with all the involved parties.”
About EMVA
The European Machine Vision Association is a non-for-profit and non-commercial association representing the Machine Vision industry in Europe. The association was founded in 2003 to promote the development and use of vision technology in all sectors, and represents members from within Europe, North America, and Asia. The EMVA is open for all types of organizations having a stake in machine vision, computer vision, embedded vision or imaging technologies: manufacturers, system and machine builders, integrators, distributors, consultancies, research organizations and academia. All members – as the 100% owners of the association – benefit from the networking, cooperation, standardization, and the numerous and diverse activities of the EMVA. The EMVA is the host of four global machine vision standards: The two widely established standards GenICam and EMVA 1288 as well as the two standardization initiatives Open Optics Camera Interface (OOCI) and Embedded Vision Interface Standard (emVision).
About Khronos 
The Khronos Group is an open, non-profit, member-driven consortium of over 150 industry-leading companies creating advanced, royalty-free, interoperability standards for 3D graphics, augmented and virtual reality, parallel programming, vision acceleration and machine learning. Khronos activities include 3D Commerce™, ANARI™, glTF™, NNEF™, OpenCL™, OpenGL®, OpenGL® ES, OpenVG™, OpenVX™, OpenXR™, SPIR-V™, SYCL™, Vulkan®, and WebGL™. Khronos members drive the development and evolution of Khronos specifications and are able to accelerate the delivery of cutting-edge platforms and applications through early access to specification drafts and conformance tests.

Leave a Reply

featured blogs
Feb 26, 2021
OMG! Three 32-bit processor cores each running at 300 MHz, each with its own floating-point unit (FPU), and each with more memory than you than throw a stick at!...
Feb 26, 2021
In the SPECTRE 20.1 base release, we released Spectre® XDP-HB as part of the new Spectre X-RF simulation technology. Spectre XDP-HB uses a highly distributed multi-machine multi-core simulation... [[ Click on the title to access the full blog on the Cadence Community si...
Feb 25, 2021
Learn how ASIL-certified EDA tools help automotive designers create safe, secure, and reliable Advanced Driver Assistance Systems (ADAS) for smart vehicles. The post Upping the Safety Game Plan for Automotive SoCs appeared first on From Silicon To Software....
Feb 24, 2021
mmWave applications are all the rage. Why? Simply put, the 5G tidal wave is coming. Also, ADAS systems use 24 GHz for SRR applications and 77 GHz for LRR applications. Obviously, the world needs mmWave tech! Traditional mmWave technology spans the 30 – 300 GHz frequency...

featured video

Silicon-Proven Automotive-Grade DesignWare IP

Sponsored by Synopsys

Get the latest on Synopsys' automotive IP portfolio supporting ISO 26262 functional safety, reliability, and quality management standards, with an available architecture for SoC development and safety management.

Click here for more information

featured paper

Authenticating Remote Automotive Peripherals Using GMSL Tunneling

Sponsored by Maxim Integrated

Authentication can be applied to automotive environments to protect peripheral components from third-party counterfeits. This application note details how to implement automotive authentication with the use of gigabit multimedia serial link (GMSL).

Click here to download the whitepaper

Featured Chalk Talk

Benefits of FPGAs & eFPGA IP in Futureproofing Compute Acceleration

Sponsored by Achronix

In the quest to accelerate and optimize today’s computing challenges such as AI inference, our system designs have to be flexible above all else. At the confluence of speed and flexibility are today’s new FPGAs and e-FPGA IP. In this episode of Chalk Talk, Amelia Dalton chats with Mike Fitton from Achronix about how to design systems to be both fast and future-proof using FPGA and e-FPGA technology.

Click here for more information about the Achronix Speedster7 FPGAs