With the augmented, virtual, and mixed reality (AR/VR/MR) market predicted to grow to a whopping $521.28 billion dollars by 2031, OEMs are seeking low-cost image sensors with high efficiency and performance to keep up with demand. Recently, OmniVision, STMicroelectronics, and Onsemi announced innovations and additions to their image sensor portfolios aimed at AR/VR/MR and industrial applications. 

OmniVision Launches “World’s Smallest, Lowest-Power” Image Sensor

OmniVision recently introduced the OG0TC global shutter image sensor for eye and face tracking, specifically targeted at AR/VR/MR applications. Global shutter is digital camera technology that reads all pixels in the image sensor at once, unlike a rolling shutter, which reads pixel data from top to bottom. Global shutter is particularly useful for capturing fast-moving objects without the distortion or artifacts caused by using a rolling shutter in a camera.

OG0TC image sensor

Image sensor manufacturers are targeting ultra-small packaging for AR/VR wearables. Image used courtesy of OmniVision

The OG0TC is a low-power image sensor packed in a 1.64 mm x 1.64 mm package, which OmniVision says makes it suited for AR/VR/MR headsets and glasses. The OG0TC consists of an image sensor array, an image sensor processor, and an image output interface. It also includes an SCCB interface for external communication. The image sensor array contains the image array, gains control, and a 10-bit ADC to send pixel data to the image processor. A MIPI interface enables external transmission of the image data.

Block diagram of the OG0TC

Block diagram of the OG0TC. Image used courtesy of OmniVision

The OG0TC incorporates OmniVision’s proprietary dual conversion gain (DCG) HDR technology, a technique that optimizes every pixel based on the light input to that particular pixel. In DCG pixels, photoelectrons from a photodiode are read out twice in different gains: low-conversion gain for high light and high-conversion gain for low light. The result is an extended dynamic range of up to 140 decibels. OmniVision says DCG technology is particularly useful for eliminating effects such as glare and ghosting, which can cause distortion when capturing fast-moving images. Omnivision also says that the OG0TC consumes 40% less power at 30 FPS than previous image sensors in the family. 

ST Builds Out Its Development Ecosystem for Image Sensors 

Other manufacturers in the arena have also announced ecosystem development and acquisitions to enhance their image-sensing portfolios. STMicroelectronics recently announced it has released a set of plug-and-play hardware kits, evaluation camera modules, and software for use with its ST BrightSense global-shutter image sensors.

ST's BrightSense global-shutter image sensors

ST’s BrightSense global-shutter image sensors. Image used courtesy of STMicroelectronics

ST designed these kits to easily integrate the sensors into various applications. They come in various compact form factors, offer multiple lens options, and feature connectors that simplify sensor installation. The CAM-55G0, for example, is a compact camera module designed for evaluating the VD55G0 0.38-megapixel monochrome image sensor. It includes essential components like the sensor, lens, and plug-and-play connection for vision applications.

ST also offers complementary software tools like PC-based GUI and Linux drivers to help developers integrate the sensors with popular processing platforms. The evaluation software, STSW-IMG501, is free to download from the STMicroelectronics website. 

Onsemi Acquires SWIR Vision Systems

Onsemi has acquired SWIR Vision Systems, integrating SWIR’s colloidal quantum-dot-based short wavelength infrared (SWIR) technology into its portfolio. This technology is based on colloidal quantum dots (CQD), which use crystals or nanoparticles with unique electronic or optical properties to absorb an extended wavelength of light. It extends detection capabilities beyond standard CMOS sensors, enhancing visibility through materials like gases, plastics, and fabrics.

SWIR Vision Systems’ thin-film colloidal quantum dot photodiode array

SWIR Vision Systems’ thin-film colloidal quantum dot photodiode array technology. Image used courtesy of SWIR Vision Systems

SWIR technology has faced obstacles to widespread adoption because of the manufacturing complexity and expense of the indium gallium arsenide (InGAas) process upon which it is built. This acquisition will allow Onsemi to bypass these challenges by applying its manufacturing experience and silicon CMOS sensors to SWIR’s CQD technology for low-cost, high-volume SWIR sensors. Integrated into Onsemi’s offerings, these SWIR sensors aim to deliver more compact imaging solutions for commercial, industrial, and defense applications. 


Have you recently employed image sensors in an interesting way? Tell us about it in the comments below.