Paving the roadway for safety of automated vehicles: An empirical study on testing challenges

The technology in the area of automated vehicles is gaining speed and promises many advantages. However, with the recent introduction of conditionally automated driving, we have also seen accidents. Test protocols for both, conditionally automated (e.g., on highways) and automated vehicles do not exist yet and leave researchers and practitioners with different challenges. For instance, current test procedures do not suffice for fully automated vehicles, which are supposed to be completely in charge for the driving task and have no driver as a back up. This paper presents current challenges of testing the functionality and safety of automated vehicles derived from conducting focus groups and interviews with 26 participants from five countries having a background related to testing automotive safety-related topics. We provide an overview of the state-of-practice of testing active safety features as well as challenges that needs to be addressed in the future to ensure safety for automated vehicles. The major challenges identified through the interviews and focus groups, enriched by literature on this topic are related to 1) virtual testing and simulation, 2) safety, reliability, and quality, 3) sensors and sensor models, 4)required scenario complexity and amount of test cases, and 5)handover of responsibility between the driver and the vehicle.

[1]  Frank Köster,et al.  Testing of Highly Automated Driving Functions , 2016 .

[2]  Frank Barickman,et al.  Validation and Verification of Automated Road Vehicles , 2016 .

[3]  Graham. Parkhurst,et al.  Handover issues in autonomous driving: A literature review , 2016 .

[4]  Reinhard German,et al.  From Simulation Data to Test Cases for Fully Automated Driving and ADAS , 2016, ICTSS.

[5]  Raphael Pfeffer,et al.  Continuous Development of Highly Automated Driving Functions with Vehicle-in-the-Loop Using the Example of Euro NCAP Scenarios , 2016 .

[6]  Rolf Johansson,et al.  Safe Transitions of Responsibility in Highly Automated Driving , 2016 .

[7]  Patrick Seiniger,et al.  Test Methods for Consumer Protection and Legislation for ADAS , 2015 .

[8]  Hermann Winner,et al.  The Release of Autonomous Vehicles , 2016 .

[9]  Christian Berger,et al.  Towards State-of-the-Art and Future Trends in Testing of Active Safety Systems , 2016, 2016 IEEE/ACM 2nd International Workshop on Software Engineering for Smart Cyber-Physical Systems (SEsCPS).

[10]  Hans-Peter Schöner Testing with Coordinated Automated Vehicles , 2015 .

[11]  Christian Berger,et al.  Software-Related Challenges of Testing Automated Vehicles , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C).

[12]  Franz Wotawa Testing Autonomous and Highly Configurable Systems: Challenges and Feasible Solutions , 2017 .

[13]  Michael Paulweber,et al.  Validation of Highly Automated Safe and Secure Systems , 2017 .

[14]  Lutz Eckstein,et al.  Technical Evaluation and Impact Assessment of Automated Driving , 2016 .

[15]  Hans-Peter Schöner Challenges and Approaches for Testing of Highly Automated Vehicles , 2016 .

[16]  Nidhi Kalra,et al.  Driving to Safety , 2016 .