Xylon releases multi-channel HDR ISP IP suite for multiple video processing

For use with Xilinx programmable devices, ranging from the Artix-7 FPGAs to the latest Versal ACAP devices, the logicBricks high dynamic range (HDR) image signal processing (ISP) IP Suite enables parallel processing of multiple Ultra-HD video inputs. At the same time, it allows savings of up to 50 per cent of programmable logic in comparison to simple instantiation of multiple ISP pipelines, says Xylon.

The latest version of Xylon’s logicBricks IP suite enables crisp camera video under altering and rough lighting conditions in next-generation, multi-channel embedded systems for use in automotive, surveillance, medical and similar video and vision artificial intelligence (AI) applications.

The logicBricks HDR ISP IP suite is designed and optimised for Xilinx programmable devices.

“As the automotive industry progressively moves towards more automated driving implementations, the trend towards high resolution cameras and higher frame rates continues,” said Paul Zoratti, director of automotive solutions and system architect at Xilinx. The multi-camera ISP functionality will help automotive developers optimise cost, power, and performance in future advanced driver assistance systems (ADAS) and automated driving products, he added.

The suite’s key IP cores, the logiISP-UHD ISP pipeline and the logiHDR HDR pipeline, support parallel processing of multiple video inputs, resolutions up to 7680 x 7680 (including the popular 4K2Kp60 video resolution). It also supports the ability to merge two or three exposures, parallel pixel processing and different pixel formats. These IP cores are supplemented with automatic white balance (AWB) and automatic exposure (AE) software libraries that use video statistics data collected at the video inputs, software drivers, demo applications, reference SoC designs, and bit-accurate C models.

The HDR ISP IP suite enables application-specific tuning through modifications at different implementation stages, explained Roko Koncurat, Xylon’s ISP team lead. “The provided IP blocks can be arranged in many different ways to fully tune up the system for a specific application. While hardware engineers may configure and arrange IP blocks implemented in programmable logic in various ways, software engineers can further control the implemented ISP pipeline to adapt to changing use conditions,” he said.

The logicBricks HDR ISP IP suite can be demonstrated on different computer vision development platforms designed by Xylon. The  logiREF-MULTICAM-ISP reference design is immediately available. It demonstrates parallel processing of four video camera inputs and works on the logiISP-ZU-GMSL2 evaluation kit. This kit is based on the Xilinx Zynq UltraScale+ MPSoC and includes four of Xylon’s 2.3 MP HDR logiCAM-GMSL2 automotive cameras configured to output raw Bayer video image. Xylon’s automotive cameras are Xilinx Artix-7 FPGA-based and users can re-install the HDR ISP functionality with the provided firmware and initialisation scripts.   

In addition to the MPSoC-based demo kit, Xylon offers an Ultra HD reference design prepared for the logiVID-ACAP vision development kit based on the Xilinx Versal AI VCK190 evaluation kit. The reference design is developed with the Xilinx Vitis unified software platform and demonstrates parallel HDR ISP processing of three 7.4Mpixel automotive video cameras connected to the Xilinx Versal (ACAP) device.

http://www.xylon-lab.com

> Read More

NIRA Dynamics signs agreement with Global Weather for road data

Swedish auto technology leader NIRA Dynamics, a company within the Volkswagen Group, has signed an agreement with Global Weather Corporation (GWC), for its road condition services for the automotive industry.

The partnership will allow improved road condition services for autonomous vehicle functions, says NIRA.

GWC’s RoadWX data services predict atmospheric weather and road surface conditions over two phases.

The first is rain or snow falling, making the road wet or snowy, the second phase is when the rain or snow has stopped and the road begins to dry. Ignoring the second phase, warns, GWC, can mean forecasts can be wrong over many hours.

GWC employs an atmospheric forecast and a physics-based model of the road to compute how the road conditions respond initially to rain or snow, and how/when the road freezes or dries after rain or snowfall ends to forecast road weather events.

RoadWX data service combines atmospheric forecast with GWC’s RoadWeather road physics model for road weather forecasting. There are two critical modelling steps, beginning with atmospheric forecast technology and the RoadWeather road physics model, which uses radiation transfer algorithms to compute road surface temperature using current weather and road state history as inputs.

It is configured to account for road type, traffic volume, and winter treatment level.

NIRA Dynamics says it is spearheading the next generation of connected car technology, preparing drivers for adverse weather or road conditions, reducing crashes, and improving safety with data from connected vehicles and weather and road predictive analytics in a map with a friction map layer which will help municipalities better manage roads during extreme weather. It will also allow driver
assistance systems access to road conditions for enhanced safety, improve tyre performance, and ensure navigation systems can take road conditions into account.

The number of connected vehicles with NIRA algorithms is growing rapidly and will reach 1.7 million during 2021, reports NIRA Dynamics. By adding the weather data from GWC, the NIRA/GWC combination will provide industry-leading road surface monitoring, including prediction of future road state, says the company.

http://www.niradynamics.se

> Read More

NIRA Dynamics signs agreement with Global Weather for road data

Swedish auto technology leader NIRA Dynamics, a company within the Volkswagen Group, has signed an agreement with Global Weather Corporation (GWC), for its road condition services for the automotive industry.

The partnership will allow improved road condition services for autonomous vehicle functions, says NIRA.

GWC’s RoadWX data services predict atmospheric weather and road surface conditions over two phases.

The first is rain or snow falling, making the road wet or snowy, the second phase is when the rain or snow has stopped and the road begins to dry. Ignoring the second phase, warns, GWC, can mean forecasts can be wrong over many hours.

GWC employs an atmospheric forecast and a physics-based model of the road to compute how the road conditions respond initially to rain or snow, and how/when the road freezes or dries after rain or snowfall ends to forecast road weather events.

RoadWX data service combines atmospheric forecast with GWC’s RoadWeather road physics model for road weather forecasting. There are two critical modelling steps, beginning with atmospheric forecast technology and the RoadWeather road physics model, which uses radiation transfer algorithms to compute road surface temperature using current weather and road state history as inputs.

It is configured to account for road type, traffic volume, and winter treatment level.

NIRA Dynamics says it is spearheading the next generation of connected car technology, preparing drivers for adverse weather or road conditions, reducing crashes, and improving safety with data from connected vehicles and weather and road predictive analytics in a map with a friction map layer which will help municipalities better manage roads during extreme weather. It will also allow driver
assistance systems access to road conditions for enhanced safety, improve tyre performance, and ensure navigation systems can take road conditions into account.

The number of connected vehicles with NIRA algorithms is growing rapidly and will reach 1.7 million during 2021, reports NIRA Dynamics. By adding the weather data from GWC, the NIRA/GWC combination will provide industry-leading road surface monitoring, including prediction of future road state, says the company.

http://www.niradynamics.se

> Read More

Infineon adds sound to ADAS systems

Adding the sense of hearing to advanced driver assistance systems (ADAS), Infineon Technologies has partnered with Reality AI to integrate its Xensiv MEMS microphones to vehicles’ sensor systems. It enables cars to “see” around the corner and to warn about moving objects hidden in the blind spot or approaching emergency vehicles that are still too distant to see. Typically ADAS is based on cameras, radar or lidar so target objects have to be within the line of sight to be recognised by the system, which has proved a weakness for emergency vehicles as these can be heard much earlier than they can be seen and are therefore “invisible” to ADAS for a period of time.

Infineon’s Xensiv MEMS microphones are combined with Aurix microcontrollers and Reality AI’s automotive see-with-sound (SWS) system. Using machine learning-based algorithms, the system is able to detect emergency vehicles, cars and other road vehicles, even if they cannot be seen by drivers or detected by the sensors incorporated in the vehicles’ ADAS. Machine learning also ensures that the country-specific sirens of emergency vehicles are recognised around the world.

The automotive-qualified Xensiv MEMS microphone IM67D130A has an increased operating temperature range from -40 to +105 degrees C for use in harsh automotive environments. The low distortions (THD) and the high acoustic overload point (AOP) of 130dB SPL enable the microphone to capture distortion-free audio signals in loud environments for a reliable classification, even if the siren sound is hidden in high background or wind noise, says Infineon. This sound-base sensing technology can also enable other applications in vehicles such as road condition monitoring, damage detection or even predictive maintenance.

For processing the audio signal, the Reality AI software uses  Infineon’s Aurix TC3x family of microcontrollers. The scalable microcontroller family offers a range from one to six cores and up to 16Mbyte of flash with functional safety up to ASIL-D according to the ISO26262 2018 standard and EVITA full cybersecurity.

The Xensiv MEMS microphone IM67D130A can be ordered now in a PG-LLGA-5-4 package.

http://www.infineon.com

> Read More

About Smart Cities

This news story is brought to you by smartcitieselectronics.com, the specialist site dedicated to delivering information about what’s new in the Smart City Electronics industry, with daily news updates, new products and industry news. To stay up-to-date, register to receive our weekly newsletters and keep yourself informed on the latest technology news and new products from around the globe. Simply click this link to register here: Smart Cities Registration