When does a safety-critical traffic situation turn into a dangerous one? What is the point at which factors are considered critical? A new initiative badged the Verification & Validation Methods (VVM) project aims to answer these two key questions – while also addressing other important autonomous vehicle safety-related development tasks. TÜV SÜD experts will work to achieve exact determination of the criticality – the technical term used by industry specialists – of these factors influencing road traffic. The program is being funded by the Federal Ministry for Economic Affairs and Climate Action.
One of its goals is to establish simulation as a valid method in the homologation of automated vehicles at SAE Levels 4 and 5. The 23 VVM project partners recently presented their results at a virtual mid-term conference. With the help of use cases, TÜV SÜD project lead Tuan Duong Quang demonstrated how simulation is applied to assess the safety of autonomous vehicles.
Technically speaking, there is an infinite number of road-traffic scenarios that involve critical situations and therefore must be assessed. However, since assessment of all these scenarios in physical tests is impossible, the experts rely on simulation. But how is this done? How do experts determine which of those scenarios poses a genuine traffic hazard?
One thing is clear: not even simulation will enable the experts to test all these scenarios. To make matters worse, every scenario is influenced by a large number of factors. Given this, the experts’ main task is to take the unlimited number of scenarios in real-world traffic and filter for those that actually involve real traffic hazards.
Emmeram Klotz, head of testing and validation in the Highly Automated Driving business line at TÜV SÜD, explained, “Our experts in the VVM project are working on methods that help to determine the level of criticality of certain factors in a traffic scenario. In the validation process, the results are then used as input for the further development of simulation tools.
Duong Quang added, “By adopting this approach, real-life tests are complemented, and to some extent replaced, by virtual tests.”
The experts use openPASS, an open-source simulation platform. TÜV SÜD is responsible for the product management of this platform. The openPASS platform is a transparent simulation tool used in the virtual assessment of automated driving systems. It has been harmonized by the industry partners Bosch, Mercedes-Benz AG, BMW Group, VW, ITK Engineering GmbH and Toyota.
“My position at openPASS gives me excellent insights into the system,” explained Duong Quang. “Given this, I can adapt the tool to our tasks within the VVM project in the best-possible manner, ensure its validity as a test method up to the homologation stage and use it for simulation.”
So how does simulation work?
Back to the occlusion of the cyclist. The central question is what factors influence the criticality of a traffic scenario, and to what extent? In our scenario, a driver’s visibility is obstructed by a parked car occluding a cyclist. The virtual test setup uses factors that influence the level of danger involved in this traffic scenario and are thus classified as critical, including the position and speed of the approaching car, the position and size of the parked vehicle, and the position and speed of the bicycle approaching from the right.
The TÜV SÜD experts then determine the individual factors that affect the occlusion of the cyclist. This is done with small steps of stochastic variation of the adjustment variables in the simulation, e.g. the approaching vehicle is moved half a meter toward the intersection and the cyclist is moved by 20cm. While the actual size of the parked vehicle remains the same, the line-of-sight between the automated car and the cyclist changes.
The result shows that this typical urban traffic scenario may not be critical at that precise moment, because the automated vehicle will notice the cyclist and has sufficient time to respond to the situation. However, if the parked vehicle gets ‘bigger’ and obscures the line-of-sight between the road users, the situation gradually becomes more critical.
“As the only third-party testing, inspection and certification (TIC) company in the Pegasus project [the predecessor of the VVM project], we have already worked intensively and successfully with our project partners to make automated driving functions safe,” concluded Klotz. “In the VVM project, we are now moving to urban environments. In other words, there is a host of further traffic scenarios to be assessed. TÜV SÜD is playing a major role in furthering understanding of the relevance of the hazardous factors. This will enable the number of tests required for type approval to be reduced and simulation to be established as a valid and efficient test method.”
Project background
Pegasus involved bringing the worlds of research, industry and regulation together to establish the basis for fast development of autonomous vehicles.
From 2016 onward, the consortium partners in the Pegasus project worked to develop widely accepted methods and tools to ensure the safety of highly automated driving functions, at first up to SAE Level 3. The Pegasus project has resulted in two successor projects since 2019, one of them VVM. The partners in the VVM project have succeeded in advancing to SAE Levels 4 and 5. The goal of this project is also to establish methods and tools for the homologation of highly automated vehicles – but now in urban environments.
The mid-term VVM event took place in mid-March. Watch a video of the event here.
