Developer kit accelerates AI vision

To accelerate proof of concept, rapid prototyping and small series production, Vision Components has collaborated with AU-Zone and Toradex to create the Maivin i.MX 8M Plus AI vision kit.

The developer kit is based on a Toradex Verdin i.MX 8M Plus system on module (SoM) and a carrier board designed by AU-Zone which accommodates up to two VC MIPI camera modules.

NXP’s i.MX 8M Plus processor has a neural network processor unit (NPU) and an integrated image signal processor. The Verdin SoM for the kit has been extended by a variable SoM adapter and connector board from AU-Zone, which enables users to build functional models. The VC MIPI IMX327-C (colour) and VC MIPI IMX296 (monochrome) camera modules are combined with the required interfaces and I/Os for individual rapid prototyping up to small series. Additional VC camera modules are also compatible. The AU-Zone connector boards can also be custom-developed with interfaces and functionalities for individual requirements. This makes the Maivin i.MX 8M Plus AI vision kit for a range of applications, including automation and robotics, medical technology or the agricultural industry. The kit also includes a housing, including lighting.

Drivers ensure optimal image processing, says Vision Components, which enable the direct connection and support of the VC MIPI camera modules with the NXP i.MX 8M processor family. They have been integrated into Toradex’ software platform, TorizonCore, which allows access to the image signal processor (ISP) of the i.MX 8M Plus. The ISP can be used for advanced image pre-processing such as colour conversion, geometry correction, HDR and gamma correction. The software platform also includes comprehensive frameworks for an easy entry into development, over the air updates and security features.

The kit also includes AU-Zone’s DeepView machine learning toolkit is also part of the Maivin i.MX 8M Plus AI vision kit. It includes machine learning demos for object recognition, classification, and tracking that can be customised to the users own AI models and datasets using the NXP eIQ toolkit. NXP continues to add tools to the development environment, including a GUI-based interface, and the DeepViewRT engine which is optimised for the i.MX platform. The company also added that other applications, for example AU-Zone applications, can be integrated and used to develop vision systems.

Vision Components drivers for the NXP i.MX 8M processor family are also available for platforms in addition to the Toradex Verdin SoM series platforms.

The kit is scheduled to be ready for shipping in Q3 2021.

http://www.vision-components.com

> Read More

Microchip unveils single chip for network synchronisation

Offering precise timing for 5G radio access equipment, the ZL3073x / 63x / 64x network synchronisation platform combines integration and performance in one compact, low-power device, says Microchip.

For 5G, time sources need to be synchronised throughout a packet-switched network 10 times more accurately than 4G requirements. The devices makes it possible to achieve 5G performance with what is claimed to be the first single chip, highly integrated, low power, multi-channel IC coupled with the company’s IEEE 1588 precision time protocol (PTP) and clock recovery algorithm software modules.

The ZL3073x / 63x / 64x network synchronisation platform implements sophisticated measure, calibrate and tune capabilities, which reduces network equipment time error to meet the most stringent 5G requirements, said Rami Kanama, vice president of Microchip’s timing and communications business unit.

Microchip’s measure, calibrate and tune capabilities ensure 5G systems achieve ITU-T Standard G.8273.2 Class C (30ns max|TE|) and the emerging Class D (5ns max|TEL|) time error requirements. The architecture offers up to five independent digital phase locked loop (DPLL) channels while consuming only 0.9W in a compact 9.0 x 9.0mm package that simultaneously reduces board space, power and system complexity.

There are five low-jitter synthesisers which offers 100 femto second root mean square (rms) jitter performance required by high speed interfaces in the latest 5G radio unit, distributed unit and central unit systems.

Microchip’s network synchronisation platform software includes its ZLS30730 high-performance algorithm coupled with its ZLS30390 IEEE 1588-2008 protocol engine. The network synchronisation platform combines seamlessly with Microchip’s family of precision 5G oscillators, adds the company. Its portfolio also includes clock generation, fanout buffer and jitter attenuator solutions as well as quartz and MEMS oscillators and Ethernet physical layer (PHY) devices.

A graphical user interface (GUI) and evaluation board are also available, along with application notes and other design-in support tools.

The ZL3073x / 63x / 64x network synchronisation platform is available in production quantities and offered with IEEE 1588 PTP and algorithm software modules, which are provided through license terms for download.

http://www.microchip.com

> Read More

Renesas and Syntiant develop voice-controlled multimodal AI solution combining advanced vision and voice technologies

Renesas Electronics and Syntiant have announced the joint development of a voice-controlled multimodal AI solution that enables low-power contactless operation for image processing in vision AI-based IoT and edge systems, such as self-checkout machines, security cameras, and video conference systems, and smart appliances such as robotic cleaning devices.

The new solution combines the Renesas RZ/V Series vision AI microprocessor unit (MPU) and the low-power multimodal, multi-feature Syntiant® NDP120 Neural Decision Processor™ to deliver advanced voice and image processing capabilities. The joint solution features always-on functionality with quick voice-triggered activation from standby mode to perform object recognition, facial recognition, and other vision-based tasks that are critical functions in security cameras and other systems. For example, while user-defined voice cues drive activation and system operation, vision AI recognition tracks operator behaviour and controls operation or issues a warning when suspicious actions are detected.

The multimodal architecture makes it easier to create contactless user experiences for vision AI-based systems. Using a dedicated, power-efficient chip for voice recognition reduces standby power consumption while speeding up system development because it is possible to develop software independently of the vision AI functionality.

“We anticipate that demand for multimodal systems that use multiple streams of input information – both image and voice – will increase moving forward as a way to improve both ease of use and safety,” said Hiroto Nitta, Senior Vice President and Head of SoC Business in the IoT and Infrastructure Business Unit at Renesas. “Through the collaboration between Renesas, a leader in low-power image AI technology, and Syntiant, a leader in voice AI technology, we will accelerate the adoption of low-power, ultra-small smart voice AI technology in embedded systems and deliver new combined solutions to customers globally.”

“Voice-based user interfaces will make it possible for customers to deliver new user experiences that bring the next generation of innovative ideas from concept to reality, said Syntiant CEO Kurt Busch. “We’ve already shipped more than 15 million of our deep learning NDPs globally to enable always-on voice in a wide variety of consumer and industrial IoT applications. Our collaboration with Renesas delivers a powerful, low-power voice and image solution that is certain to accelerate traction among a global customer base in a variety of devices and use cases.”

The Renesas RZ/V Series MPU for vision AI incorporates Renesas’ exclusive DRP-AI (Dynamically Reconfigurable Processor-AI) accelerator and combines high-precision AI inference with a power efficiency that is among the best in the industry. This superior power performance eliminates the need for heat dispersion measures such as heat sinks or cooling fans, which reduces the bill of materials (BOM) cost and makes it possible to integrate vision AI into a wide range of embedded applications.

The Syntiant NDP120 chip incorporates sophisticated AI capabilities that can be used to implement many high-precision, hands-free voice functions, including speaker recognition, keyword detection, multiple wake words, and local command recognition. Packaged with the Syntiant Core 2™ neural network inference engine, the NDP120 can also run multiple applications simultaneously while minimising power consumption to 1mW battery power.

The new voice-controlled multimodal AI solution uses multiple mutually compatible devices from broader Renesas portfolio to provide customers an elevated prototyping platform for faster time to market and reduced risk. The new solution is part of Renesas’ Winning Combinations, which feature compelling analog, power, and embedded processing product combinations that help customers accelerate their designs and get to market faster.

Availability

The reference design for the new multimodal AI solution is available now, including circuit diagrams and BOM lists. For more information, please visit multimodal AI solution.

> Read More

Xtensa processors meet ISO 26262 compliance to ASIL-D

Cadence Tensilica Xtensa processors with FlexLock capability meet the ISO 26262:2018 standard to ASIL-D, the highest level possible under the Automotive Safety Integrity Level rating. The functional safety certification spans from base microcontroller to high-performance DSP, each with a configuration option for FlexLock to provide increased random fault protection. The processor have been developed following a robust safety process to protect against systematic faults. Tensilica Xtensa processors with FlexLock are suitable for the automotive market and tailored for AI, vision, radar, lidar, audio, vehicle-to-everything (V2X), and control applications.

The Cadence Tensilica FlexLock processors optimised for automotive applications are among the first in the industry to achieve full compliance with ASIL-D functional safety standards, said Wolfgang Ruf, head of functional safety for semiconductors at SGS-TÜV Saar. “Certification to . . . . the ISO 26262:2018 standard for ASIL-D systematic and random fault avoidance is a testament to the high functional safety quality of Cadence’s IP. SoC designers are assured that their designs using functional safety-certified Tensilica processor IP can achieve compliance with the automotive industry’s stringent safety-critical requirements,” he added.

Key to ASIL-D compliance is the new FlexLock capability, which adds lockstep support to the flexible and extensible Xtensa processor architecture. Lockstep is a proven method for increasing safety in software execution by providing redundancy of the core logic at the hardware level. In addition to ASIL-D certification, FlexLock also gives design teams the ability to accommodate two cores running independently in ASIL-B solutions and the option of running local memories and caches of two cores in lockstep, achieving even greater levels of protection against memory faults.

“Higher levels of autonomy require more intelligent computing at the edge in automotive applications, which is driving the need for higher levels of functional safety,” said Larry Przywara, senior group director, Tensilica marketing at Cadence. “With the introduction of FlexLock capability, users of Tensilica controllers and DSPs can achieve the highest level of certification, ASIL-D, and the protection it brings against random hardware faults. Designers choosing Tensilica IP to accelerate their ADAS [advanced driver assistance systems], radar, lidar, V2X and vision processing can do so with the confidence that they can meet their customers’ functional safety requirements.”

As with other Xtensa processors, the ASIL-D certified cores can be customised using the Tensilica Instruction Extension (TIE) language. This allows the IP to be optimised for the specific application, combining the right level of performance with the highest levels of safety.

The Tensilica Xtensa processors with FlexLock capability are available now.

http://www.cadence.com

> Read More

About Smart Cities

This news story is brought to you by smartcitieselectronics.com, the specialist site dedicated to delivering information about what’s new in the Smart City Electronics industry, with daily news updates, new products and industry news. To stay up-to-date, register to receive our weekly newsletters and keep yourself informed on the latest technology news and new products from around the globe. Simply click this link to register here: Smart Cities Registration