R&S and China Mobile Research Institute jointly demonstrate generative AI user experience testing
At MWC Shanghai 2026, Rohde & Schwarz and the China Mobile Research Institute have joined forces to demonstrate an innovative testing solution for generative AI applications. Based on the CMX500 5G one-box signalling tester, this solution enables for the first time quantitative measurement of the end-user experience of generative AI applications under diverse network conditions, pioneering a new approach for generative AI user experience testing.
Generative AI uses large language models (LLMs) to create user-requested content, including text, images and videos. As LLMs, computing capabilities and related applications continue to evolve, the use of generative AI services across a wide range of connected devices, including smartphones, AI glasses and robots, is growing rapidly.
However, testing solutions for generative AI remain limited, and the industry still lacks mature metrics and standardised test frameworks for evaluating user experience.
The generative AI user experience testbed, jointly demonstrated at MWC Shanghai 2026, is designed to address these challenges. In the test system architecture, the large language model is deployed on the server side, or in the cloud, while the CMX500 radio communication tester establishes a radio connection with a smart terminal running a client-side test application. The CMX500 flexibly configures network parameters, channel fading models, latency, jitter, RF impairments and other variables, enabling realistic simulation of a wide range of wireless environments, from ideal coverage to weak-signal edge conditions. By entering prompts through the terminal-side application and receiving inference responses from the large language model, users can measure key performance indicators such as Time to First Token (TTFT) and Tokens Per Second (TPS). The resulting data is collected and analysed using host PC software, which generates corresponding charts. This approach enables quantitative evaluation and comparison of the user experience of on-device generative AI applications under different network conditions. It can support optimisation of on-device generative AI application design and provide valuable reference points for future network optimisation.
At the core of this test solution is the tried and tested CMX500 5G one-box signalling tester from Rohde & Schwarz. This all-in-one test platform supports both SA and NSA architectures, covers frequency ranges from FR1 to FR3 (up to 18 GHz) and features a built-in IMS server, enabling one-stop testing for RF conformance, protocol validation, VoNR acoustics and carrier aggregation. With these capabilities, the CMX500 serves as a key test platform for 5G-Advanced and 6G research and development.
Liu Guangyi, Chief Expert of China Mobile and Chief Scientist of ZGC-XNET, said: “To realize the vision of 6G-enabled ubiquitous intelligent connectivity, mobile networks must evolve beyond connectivity alone. By harnessing native network computing capabilities, they will deliver pervasive, ultra-low-latency intelligent services. This shift also calls for new AI service metrics and testing methodologies. Together, Rohde & Schwarz and the China Mobile Research Institute have established a testbed that enables generative AI user experience testing across diverse wireless environments. Looking ahead, both parties plan to expand test metrics and application scenarios to support the evolution, validation and standardisation of 6G-enabled AI technologies.”
Jin Hailiang, Senior Director of Products & Systems Division, Rohde & Schwarz China, said: “At a time of rapid advancement in large language models, the testbed jointly developed by Rohde & Schwarz and the China Mobile Research Institute sets an important benchmark for generative AI user experience testing. We are pleased to showcase this achievement together at MWC Shanghai 2026. Building on this testing architecture, both parties aim to expand test scenarios and industry use cases, helping advance the standardisation of generative AI user experience testing and laying a strong technical foundation for the 6G AI era.”
