UK research program to use AI-powered pedestrians and road users to test CAVs


Researchers at the University of Warwick’s WMG (Warwick Manufacturing Group) academic department have just begun work on a UK government funded project to create a detailed virtual reality (VR) simulator environment, including artificial intelligence-trained (AI) models of pedestrians and road users, to test connected and autonomous vehicles (CAVs).

Working with a consortium of 11 organizations led by Latent Logic in Oxford, the OmniCAV project will lay the foundations for the development of a comprehensive, robust and secure simulator, aimed at providing a certification tool for CAVs that can be used by regulatory and accreditation bodies, insurers and manufacturers to accelerate the safe development of self-driving vehicles.

OmniCAV, which was awarded £2.7m (US$3.5m) funding as part of a competition run by the Centre for Connected and Autonomous Vehicles (CCAV) and Innovate UK, will be fed by highly detailed scans of real roads, traffic camera data, accident data and near-miss analyses.

These inputs will be used to create a high-fidelity model of real-world roads, which will be populated with realistic AI-based road users. This model will used to create an extensive open-access library of VR simulator scenarios to test CAVs.

The project will validate the realism of the simulator by comparing its outputs with data measured for the equivalent locations and scenarios in the real world. This will include tests on proving grounds and open roads. The project will culminate in a CAV being put through the entire end-to-end OmniCAV testing program, from simulator-only, to controlled environment, to on-road testing.

Through representation on international standard committees, OmniCAV’s results will influence, or lead to the creation of, new international standards to ensure safe deployment and certification of CAVs. Alongside Latent Logic and WMG, the other partners in the project are: Admiral Insurance Group, Aimsun, Arcadis, Arrival, Ordnance Survey, Oxfordshire County Council, UK Atomic Energy Agency, and XPI Simulation, with Thatcham Research providing advice as a non-funded partner.

“We have long believed that simulation will play a key role in testing and certification of CAVs. Our 3xD simulator provides a platform with which to bridge the virtual world and real world and since its commissioning in 2016, it has played a vital role in our research strategy,” explained Professor Paul Jennings, head of intelligent vehicles at WMG and the university principal investigator on the OmniCAV project.

“Scenario identification and virtual validation are still major challenges for the CAV industry. In OmniCAV, we have a diverse and capable set of partners to advance the current state of knowledge, enabling the safe deployment of CAVs to provide benefits for us all.”

Kirsty Lloyd-Jukes, CEO of Latent Logic, said, “OmniCAV’s vision is ‘CAVs for All’: bringing safer, smarter, self-driving mobility to urban and rural areas. But first we need to know that driverless cars really can handle our challenging road conditions, on country lanes as much as crowded city streets. Virtual reality ‘driving tests’ are the only way of doing this, which is why we’ve brought together these 11 leading organizations to build a world-first, AI-based simulation of real Oxfordshire roads to securely and reliably test autonomous car safety.”

Share this story:

About Author


Adam joined the company in 1994, and has been News Editor of TTT since 2009. In his other role as Circulation Manager, he helped create the original Traffic Technology International distribution list 23 years ago, and has been working on it ever since. Outside of work, he is a keen fisherman, runs a drumming band, and plays an ancient version of cricket.