Image sensors from OmniVision Technologies are compatible with Nvidia’s Drive AGX artificial intelligence (AI) computing platform for autonomous vehicles and advanced driver assistance systems (ADAS).
The company announced that it has joined the Nvidia Drive autonomous vehicle development system at the (virtual) Nvidia GTC21.
The first three qualified image sensor families offer unique benefits to automotive system designers. The OV2311 features 2Mpixel resolution for driver monitoring systems (DMS) applications, and was the industry’s first automotive-grade imager to offer a global shutter for minimal driver-motion artefacts. The new 5Mpixel version of the image sensor also adds OmniVision’s Nyxel near-infrared (NIR) technology, for the best image captures in low- to no-light conditions, says Omnivision. Nyxel technology is claimed to achieve the world’s highest quantum efficiency for DMS of 36 per cent at the invisible 940nm NIR light wavelength, providing the clearest driver images for use by AI software algorithms.
The second family is the OX08B40, believed to be the industry’s first automotive image sensor with 140dB HDR, LED flicker mitigation (LFM) and 8.3Mpixel resolution. The image sensor enables superior front view captures, regardless of external lighting conditions, claims OmniVision. OmniVision’s on-chip HALE (HDR and LFM engine) combination algorithm simultaneously provides industry-leading LFM and HDR over the entire automotive temperature range, claims the company.
The OX03C10 and OX03F10 are claimed to be the only automotive viewing camera image sensors to combine a large 3.0 micron pixel with the HALE algorithm for minimised motion artefacts and the best LFM performance. The OX03C10 also has the lowest power consumption of any 2.5MP LFM image sensor, says OmniVision. It is also the industry’s smallest package size, enabling cameras that continuously run at 60 fps to be fitted in even the tightest confines of automotive design.
The OX03F10 widens the vertical resolution to 1920x1536p, for image quality appropriate for which provides the high image quality needed when feeding surround view system (SVS) captures into autonomous machine vision systems. The OX03F10’s wider array is also essential in e-mirror applications, for greater coverage and to eliminate blindspots.
OmniVision’s OV2311 and a new 5Mpixel sensor are the exclusive driver monitoring system (DMS) image sensors for the Nvidia Drive Hyperion evaluation architecture.
“Paul Wu, automotive staff marketing manager at OmniVision, said: “We are excited to become an Nvidia Drive ecosystem partner, with three of our premium automotive image sensor families and many more to be added. Our goal is to accelerate time to market for autonomous and ADAS applications by reducing the development effort and cost”. The company will also provide sensors for the driver and occupant monitoring systems on the next-generation Nvidia Drive Hyperion platform which combines hardware and software.
The Nvidia Drive AGX AI computing platform offers automotive designers the flexibility to use Nvidia hardware with its full stack Drive software, or develop custom software. The platform can be used for in-cabin or for autonomous driving applications, or for both. OmniVision offers platform software drivers for its image sensors, as well as complete camera modules that customers can connect to the Nvidia Drive platform for immediate evaluation. OmniVision also provides custom tuning services.
“Adding innovative suppliers like OmniVision to our open AV development platform is a key element of accelerating automotive breakthroughs with Nvidia Drive,” said Glenn Schuster, senior director of sensor ecosystems at Nvidia.
All three initial Nvidia Drive AGX platform-compatible sensor families are available now for sampling and mass production, featuring advanced ASIL functional safety and AEC-Q100 Grade 2 certification. The platform drivers and evaluation camera modules are also available now.
