Qualcomm launches next-generation XR and AR platforms

Two spatial computing platforms called Snapdragon XR2 Gen 2 and Snapdragon AR1 Gen 1 have been introduced by Qualcomm to enable the next generation of mixed reality (MR), virtual reality (VR) devices and smart glasses.

Snapdragon XR2 Gen 2 brings premium MR and VR technology into a single chip architecture for immersive experiences in thinner and more comfortable headsets, that do not require an external battery pack.

It is engineered to deliver a lag-free experience with immersive sound blending virtual content with the user’s physical surroundings and transition seamlessly between MR and VR experiences.

Snapdragon AR1 Gen 1 platform is designed with power optimisations for sleek, lightweight smart glasses that enable the user to capture, share or live-stream hands-free, directly from the glasses. On-device AI enables personal assistant experiences such as audio quality enhancement, visual search and real-time translation. There is also support for a visual heads-up display to enable content consumption, including video, that blend seamlessly in the users’ field of view.

The platforms were developed in close collaboration with Meta and will commercially debut on Meta devices in 2023. The Meta Quest 3 will be powered by Snapdragon XR2 Gen 2 Platform, and Ray-Ban Meta smart glasses collection will be powered by Snapdragon AR1 Platform. Other manufacturers are expected to follow next year.

“At Meta, we’re focused on developing the technologies of the future in mixed reality and smart glasses, as well as the foundational innovations that will one day power our vision for AR glasses,” said Andrew “Boz” Bosworth, Meta’s CTO and Head of Reality Labs. 

“The Snapdragon XR2 Gen 2 and Snapdragon AR1 platforms are the latest purpose-built processors that are designed to power the next generation of MR and VR devices and sleek smart glasses for all,” said Hugo Swart, vice president and GM of XR, Qualcomm Technologies. “The commercial debut of these two platforms with Meta is a further step forward in realizing our joint vision – unlocking premium, all-in-one XR devices and smart glasses that are affordable to users around the globe.”

http://www.qualcomm.com

> Read More

IP and SDK accelerate on-device and edge AI design, says Cadence

AI IP and software tools to address the escalating demand for on-device and edge AI processing have been unveiled by Cadence. The scalable Cadence Neo neural processing units (NPUs) deliver a range of AI performance in a low-energy footprint, said the company and this is claimed to bring new levels of performance and efficiency to AI SoCs.
The Neo NPUs deliver up to 80TOPS performance in a single core, in order to support both classic and new generative AI models. They can also offload AI/ML execution from any host processor, including application processors, general-purpose microcontrollers and DSPs. This is achieved with a simple and scalable AMBA AXI interconnect.
Cadence has also introduced the NeuroWeave software development kit (SDK) which it said provides developers with a “one-tool” AI software solution across Cadence AI and Tensilica IP products for no-code AI development.
“While most of the recent attention on AI has been cloud-focused, there are an incredible range of new possibilities that both classic and generative AI can enable on the edge and within devices,” pointed out Bob O’Donnell, president and chief analyst at TECHnalysis Research. For these intuitive, intelligent devices to be realised will need a flexible, scalable combination of hardware and software solutions with a range of power requirements and compute performance, “all while leveraging familiar tools” he believed. “New chip architectures that are optimised to accelerate ML models and software tools with seamless links to popular AI development frameworks are going to be incredibly important parts of this process,” he added.
The Neo NPUs are suitable for power-sensitive devices as well as high-performance systems with a configurable architecture. SoC architects will be able to integrate an optimal AI inferencing solution in a range of products, including intelligent sensors, IoT and mobile devices, cameras, hearables/wearables, PCs, AR/VR headsets and advanced driver-assistance systems (ADAS). New hardware and performance enhancements and key features/capabilities include:
The single core NPUs are scalable from 8GOPS to 80TOPS, with further extension to hundreds of TOPS with multi-core devices, said Cadence. They support 256 to 32K MACs per cycle, allowing SoC architects to optimise embedded AI to meet power, performance and area (PPA) tradeoffs.
Offloading of inferencing tasks from any host processor (e.g., DSPs, general-purpose microcontrollers or application processors) significantly improves system performance and power, said Cadence.
Support for Int4, Int8, Int16 and FP16 data types across a wide set of operations that form the basis of CNN, RNN and transformer-based networks allows flexibility in neural network performance and accuracy tradeoffs while the NPUs offer up to 20 times higher performance than the first-generation Cadence AI IP, with two to five time the inferences per second per area (IPS/mm2) and five to 10 times the inferences per second per Watt (IPS/W)

Upgrades to the common software toolchain include the NeuroWeave software development kit (SDK). Providing customers with a uniform, scalable and configurable software stack across Tensilica DSPs, controllers and Neo NPUs to address all target applications, the NeuroWeave SDK streamlines product development and enables an easy migration as design requirements evolve. It supports many industry-standard domain-specific ML frameworks, including TensorFlow, ONNX, PyTorch, Caffe2, TensorFlow Lite, MXNet and JAX for automated end-to-end code generation, together with Android Neural Network Compiler; TF Lite Delegates for real-time execution and TensorFlow Lite Micro for microcontroller-class devices.
The Neo NPUs and the NeuroWeave SDK are expected to be in general availability beginning in December 2023.

http://www.cadence.com

> Read More

STM32H5 discovery kit builds a case for secure, smart, connected devices

Support for Secure Manager, a turnkey SoC which integrates core security services certified and maintained by ST is included in the STM32H5 discovery kit by STMicroelectronics.
The development board is for creating diverse applications with the company’s STM32H5 microcontrollers. The STM32H5 devices are intended for high performance processing and advanced security in a wide range of applications, including smart sensors, smart appliances, industrial controllers, networking equipment, personal electronics and medical devices. 

The STM32H573I-DK discovery kit enables developers to explore all the integrated features of the STM32H5, such as analogue peripherals, timers, the ST ART (Adaptive Real-Time) accelerator, media interfaces and mathematical accelerators. This makes it easy to evaluate new designs for industrial programmable logic controllers (PLC), motor drives, and smart controllers for appliances, for example, air conditioners, refrigerators and washing machines. Other potential applications include alarm controllers, communication hubs and smart lighting controls.
The STM32H573I-DK Discovery kit is a development board that includes an STM32H5 microcontroller, colour touch display, digital microphone, and interfaces such as USB, Ethernet, and Wi-Fi. The board also features an audio codec, flash memory, and headers for connecting expansion shields and daughterboards.
To simplify the development process, the STM32CubeH5 microcontroller software package consolidates all the necessary components required to develop an application on the STM32H5, including examples and application code. The package is fully integrated into the STM32Cube ecosystem, which contains additional software to assist with application development. ST also offers the STM32CubeMX tool for configuring and initialising the microcontroller.
The STM32H5 microcontroller features the Arm Cortex-M33 embedded microcontroller core running at 250MHz and is the first microcontroller to support ST’s Secure Manager SoC security solutions. The microcontrollers combine Arm TrustZone security with ST’s STM32Trust framework to provide trusted storage, cryptography, attestation and updates. They embed side-channel protected hardware cryptographic accelerators and target recognised security certifications, PSA Certified Level 3 and GlobalPlatform SESIP3.
ST has created the STM32H573I-DK Discovery kit with examples showing how to use the security services and integrated all the necessary software tools and support in the STM32Cube development ecosystem.
The Discovery kit as well as the H5 Nucleo Board Nucleo-H563ZI are available now available from ST’s eStore and authorised distributors.

https://www.st.com

> Read More

Compact LTE-M / NB-IoT module by u-blox has 2G fallback capability 

The LEXI-R4 is a compact module that has been customised for applications where space is limited. It has dimensions of 16 x 16mm and supports all LTE-M and NB-IoT bands with an RF output power of 23dBm. It also has the possibility to operate on a 2G network. Typical applications are small asset trackers, such as pet and personal trackers, micromobility devices and luggage tags. It is also able to encompass larger applications, such as alarm systems, vending machines and stolen vehicle recovery systems, advised u-blox. 

The u-blox LEXI-R4’s compact dimensions are a 40 per cent footprint reduction compared to the company’s u-blox SARA-R4. The space gained can be used to host larger antennas, which can improve radio frequency (RF) performance, or to accommodate larger-size batteries.

It also has 2G fallback capability. Whenever LTE-M / NB-IoT coverage conditions are not optimal, it will keep functioning by falling back onto a 2G network. This is practical and convenient in countries where LTE-M / NB-IoT networks have yet to be fully deployed. 

The module is natively designed to support GNSS (Global Navigation Satellite System) AT commands and is also ready for GNSS bundling. Its dedicated port enables easy integration with any u-blox M10-based GNSS module, for instance the u-blox MIA-M10, to improve performance and lower power consumption, said u-blox. The module can also connect to additional positioning services such as AssistNow and CellLocate.   

“Since the module supports the u-blox M10 GNSS platform, customers save execution time and resources,” says Samuele Falcomer, senior product line manager, product centre cellular at u-blox. 

The module’s AT commands and a dedicated I2C port can operate the GNSS core to eliminate the need to integrate additional code into the MCU. “In addition, the LEXI-R4 module offers a single SKU with global LPWA (low power wide area) coverage that simplifies logistics,” added Falcomer.

The first samples will be available by the end of Q3 2023. 

u-blox provides positioning and wireless communication in automotive, industrial, and consumer markets. Its services and products let people, vehicles and machines determine their precise position and communicate wirelessly over cellular and short range networks. The company offers a broad portfolio of chips, modules, and secure data services and connectivity, to empower developers to introduce solutions for the IoT, quickly and cost-effectively. The company has headquarters in Thalwil, Switzerland and offices in Europe, Asia, and the USA. 

http://www.u-blox.com

> Read More

About Smart Cities

This news story is brought to you by smartcitieselectronics.com, the specialist site dedicated to delivering information about what’s new in the Smart City Electronics industry, with daily news updates, new products and industry news. To stay up-to-date, register to receive our weekly newsletters and keep yourself informed on the latest technology news and new products from around the globe. Simply click this link to register here: Smart Cities Registration