AI safety system offers autonomous vehicle drivers seven seconds warning

Posted: 6 April 2021 | | No comments yet

A team of researchers in Germany have come up with a safety system that could warn drivers of autonomous cars that they will have to take control up to seven seconds in advance.

Connected and autonomous vehicles network, which could have cyber-security vulnerabilities

A team of researchers at the Technical University of Munich (TUM) has developed a new early warning system for autonomous vehicles that uses artificial intelligence to learn from thousands of real traffic situations. The study of the system was carried out in cooperation with the BMW Group.

Researchers behind the study claim that if used in today’s self-driving vehicles, it could offer seven seconds advanced warning against potentially critical situations that the cars cannot handle alone – with over 85 per cent accuracy.

To make self-driving cars safe in the future, development efforts often rely on sophisticated models aimed at giving cars the ability to analyse the behaviour of other traffic. But researchers have now asked: what happens if the cars come across a complex situation they haver never seen before and cannot handle alone?

A team working with Prof. Eckehard Steinbach, who holds the Chair of Media Technology and is a member of the Board of Directors of the Munich School of Robotics and Machine Intelligence (MSRM) at TUM, is taking a new approach.

They claim that thanks to artificial intelligence (AI), their system can learn from past situations where self-driving test vehicles were pushed to their limits in real-world road traffic. Those are situations where a human driver takes over – either because the car signals the need for intervention or because the driver decides to intervene for safety reasons.

Pattern recognition through RNN

The technology uses sensors and cameras to capture surrounding conditions and records status data for the vehicle such as the steering wheel angle, road conditions, weather, visibility and speed. The AI system, based on a recurrent neural network (RNN), learns to recognise patterns with the data. If the system spots a pattern in a new driving situation that the control system was unable to handle in the past, the driver will be warned in advance of a possible critical situation.

“To make vehicles more autonomous, many existing methods study what the cars now understand about traffic and then try to improve the models used by them. The big advantage of our technology is that we completely ignore what the car thinks. Instead, we limit ourselves to the data based on what actually happens and look for patterns,” said Steinbach.

“In this way, the AI discovers potentially critical situations that models may not be capable of recognising, or have yet to discover. Our system therefore offers a safety function that knows when and where the cars have weaknesses.”

Warnings up to seven seconds in advance

The team of researchers tested the technology with the BMW Group and its autonomous development vehicles on public roads and analysed around 2500 situations where the driver had to intervene. The study showed that the AI is already capable of predicting potentially critical situations with better than 85 per cent accuracy – up to seven seconds before they occur.

For the technology to function, large quantities of data are needed. The research team says the AI can only recognise and predict experiences at the limits of the system if the situations were seen before. With the large number of development vehicles on the road, the data was practically generated by itself, said Christopher Kuhn, one of the authors of the study.

Every time a potentially critical situation comes up on a test drive, we end up with a new training example,” he said. Researchers say the central storage of the data makes it possible for every vehicle to learn from all of the data recorded across the entire fleet.