Image sensors for computer vision use ST’s die-stacking technology

Two high-speed image sensors released by STMicroelectronics use global shutter to capture images. Global shutter mode captures distortion-free images when the scene is moving or when near-infrared illumination is needed. This makes the sensors suitable for use in the next generation of smart computer vision applications, says ST.

Global-shutter sensors save all pixel data in each frame simultaneously, contrasting with rolling-shutter operation that captures pixel data sequentially, which makes moving images vulnerable to distortion or in need of additional corrective processing.

The company’s image sensor process technologies are claimed to enable class-leading pixel size while offering both high sensitivity and low crosstalk. The silicon process innovation and advanced pixel architecture allows a smaller sensor pixel array on the top die, while keeping more silicon area on the bottom die to increase digital-processing capabilities and features.

ST’s advanced pixel technology, including full deep trench isolation (DTI), enables extremely small 2.61 x 2.61 micron pixels that combine low parasitic light sensitivity (PLS), high quantum efficiency (QE), and low crosstalk in a single die layer.

The VD55GO sensor has 640 x 600 pixels and the VD56G3 sensor has 1.5Mpixels (1124 x 1364). The VD55GO measures 2.6 x 2.5mm and the VD56G3 measures 3.6mm x 4.3mm, making them the smallest image sensors available today, in relation to resolution, says ST.

They also have low pixel-to-pixel crosstalk at all wavelengths, specifically near-infrared, which ensures high contrast for image clarity. Embedded optical-flow processing in the VD56G3 calculates movement vectors, without the need for host computer processing.

The sensors are intended for a wide range of applications including augmented reality / virtual reality (AR/VR), simultaneous localisation and mapping (SLAM), and 3D scanning.

According to Eric Aussedat, imaging sub-group general manager and executive vice president of the Analog, MEMS and Sensors Group, STMicroelectronics: “They are enabling another step forward in computer-vision applications, empowering designers to create tomorrow’s smart, autonomous industrial and consumer devices.”

Samples are shipping now to lead customers.

http://www.st.com

> Read More

ETSI announces step towards AR interoperability

The ETSI Industry Specification Group on the Augmented Reality Framework (ISG ARF) has announced ETSI GS ARF 003, describing it as a key specification towards the interoperability of augmented reality (AR) components. Rather than a single provider to deploy AR applications and services, the ETSI framework makes provision for components from different providers to interoperate via the defined interfaces, allowing broader and quicker adoption of AR technology.

The ETSI GS ARF 003 introduces the characteristics of an AR system and describes the functional building blocks of a generic AR reference architecture and their relationships. The global architecture gives an overview of an AR system which is based on a set of hardware and software components and data describes the real world and virtual content. The functional architecture applies to both fully embedded AR systems and implementations spread over IP networks in a scalable manner with sub functions. These sub functions can either be deployed on the AR device or be provided via cloud technology.

Muriel Deschanel, chair of the ETSI ISG ARF, said: “AR can be a real asset for many use cases in industry 4.0 or in the medical sector. With the significant improvement to network performance brought by 5G, in particular in terms of bandwidth and latency, cloud services will become essential to a larger number of AR use cases,” she said.

An example of AR for industry 4.0 will be if extra staff are employed to cope with peak activity, they may not have the expertise for the job or there may not be time to train then, so AR will enable an experienced operator in another area to train, guide and give precise instructions to the new operator.

http://www.etsi.org

> Read More

Voice cores from CEVA support TensorFlow Lite for Microcontrollers

Machine learning at the edge is now possible for WhisPro speech recognition software from CEVA, as it is now available with open source TensorFlow Lite for Microcontrollers. TensorFlow Lite for Microcontrollers from Google is already optimised and available for CEVA-BX DSP cores, for low power artificial intelligence (AI) in conversational and contextual awareness applications, says CEVA.

The license provider of wireless connectivity and smart sensing technologies targets conversational AI and contextual awareness applications, with support for the TensorFlow Lite for Microcontrollers cross-platform framework for deploying tiny machine learning on power-efficient processors in edge devices.

Tiny machine learning brings AI to low power, always-on, battery operated IoT devices for on-device sensor data analytics in areas such as audio, voice, image and motion. Customers using TensorFlow Lite for Microcontrollers can use a unified processor architecture to run both the framework and the associated neural network workloads required to build intelligent connected products. CEVA’s WhisPro speech recognition software and custom command models are integrated with the TensorFlow Lite framework to accelerate the development of small footprint voice assistants and other voice-controlled IoT devices.

The CEVA-BX DSP family is a high-level programmable hybrid DSP/controller offering high efficiency for a broad range of signal processing and control workloads of real-time applications. Using an 11-stage pipeline and five-way VLIW micro-architecture, it offers parallel processing with dual scalar compute engines, load/store and program control that reaches a CoreMark per MHz score of 5.5, making is suitable for real time signal control. Its support for SIMD instructions makes it suitable for a variety of signal processing applications and the double precision floating point units efficiently handle contextual awareness and sensor fusion algorithms with a wide dynamic range. It also facilitates simultaneous processing of front-end voice, sensor fusion, audio processing, and general DSP workloads in addition to AI runtime inferencing.

http://www.ceva-dsp.com

> Read More

400G-capable optical transceiver increases 400G and 100G infrastructure

To address the demands of enterprises worldwide, seeking to deliver faster speeds and higher bandwidth, AddOn Networks has introduced the QSFP28-DD 2x100G optical transceiver. It increases network density, reduces infrastructure investments and solves interoperability issues between current and future infrastructure, claims AddOn.

“At a time when new technologies such as 5G are driving greater traffic onto networks, it is vital that enterprises and data centres deliver high-quality, large-capacity connectivity to meet the needs of businesses and consumers,” said Patrick Beard, chief technology officer at AddOn Networks. The QSFP28-DD 2x100G transceiver enables network expansion at a multitude of levels while keeping expansion costs to a minimum, he added.

The QSFP28-DD 2x100G transceiver provides enterprises facing scaling challenges the upgrade to a 400G PAM4 infrastructure. It is also suitable for customers who require an interim step as they wait for a more mature solution, advises AddOn. The QSFP28-DD 2x100G solves the interoperability problems that have been experienced between legacy infrastructures and newer systems by using two non-return to zero (NRZ) connectors for compatibility to deliver bandwidth and speed upgrades.

The QSFP28-DD 2x100G transceiver consists of a high-density CS connector and contains two 100G transceivers in one housing, enabling the subtending of two common 100G NRZ to the network. Two 100G transceivers offer flexibility for future-proofing infrastructure and allow enterprises to invest in the relieving of network bottlenecks at minimal expense, says AddOn. The transceiver is also interoperable with existing 100G-CWDM4, 100G-LR4 and 100G-4WDM10 transceivers.

http://www.addonnetworks.com

> Read More

About Smart Cities

This news story is brought to you by smartcitieselectronics.com, the specialist site dedicated to delivering information about what’s new in the Smart City Electronics industry, with daily news updates, new products and industry news. To stay up-to-date, register to receive our weekly newsletters and keep yourself informed on the latest technology news and new products from around the globe. Simply click this link to register here: Smart Cities Registration