Simulations on consumer tests: A systematic evaluation approach in an industrial case study

Context: Consumer tests for vehicles have long a tradition of almost two decades in Europe to assess vehicular safety abilities. For active safety systems like an emergency braking guard, different consumer-test-organizations (CTOs) around the world intensify now the challenges for automotive Original Equipment Manufacturer (OEM) in terms of specific test protocols. Objective: This work focuses on the systematic generation of possible vehicle trajectories within the allowed tolerance ranges for a simulation environment. It is of great interest to which extent the different test parameters will affect the brake timepoints in each test case as well as the residual velocity in case of a collision with a target vehicle. Method: A formal model using a graph-based representation of the allowed variances based on relevant time-points allows the selection of relevant trajectories as test cases. These trajectories are simulated afterwards to investigate its influence on the system's performance. Results: The systematic approach unveiled varying action points in time of the software of an emergency braking guard, which could influence the overall result of a consumer test. Conclusion: The use of a structured simulative approach for evaluating an active safety system during the development process enables a more focused feedback and supports extensive tests on real proving grounds by systematic and automated robustness analyses for example.

[1]  Christian Berger,et al.  Automating acceptance tests for sensor- and actuator-based systems on the example of autonomous vehicles , 2010, Aachener Informatik-Berichte, Software Engineering.

[2]  Michael Folie,et al.  Virtual Test Driving Hardware-Independent Integration of Series Software , 2013 .

[3]  Bernhard Rumpe,et al.  Simulations on Consumer Tests: A Perspective for Driver Assistance Systems , 2013, ES4CPS '14.

[4]  Falko Saust,et al.  Effiziente systematische Testgenerierung für Fahrerassistenzsysteme in virtuellen Umgebungen , 2013 .

[5]  Christian Berger,et al.  Caroline: An autonomously driving vehicle for urban environments , 2008, J. Field Robotics.

[6]  Hao Li,et al.  Integrated Simulation Toolset for ADA System Development , 2013 .

[7]  Bernhard Rumpe,et al.  Integration von Modellen in einen codebasierten Softwareentwicklungsprozess , 2006, Modellierung.

[8]  Bernhard Rumpe,et al.  Simulations on Consumer Tests: A Systematic Evaluation Approach in an Industrial Case Study , 2015, IEEE Intell. Transp. Syst. Mag..

[9]  Maximilian Miegler,et al.  Hardware-in-the-Loop Testing of Advanced Driver Assistance Systems , 2011 .

[10]  Christian Berger,et al.  Simulations on Consumer Tests: Systematic Evaluation of Tolerance Ranges by Model-Based Generation of Simulation Scenarios , 2015, ArXiv.

[11]  Bernhard Rumpe,et al.  Integrated definition of abstract and concrete syntax for textual languages , 2007, MODELS'07.

[12]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[13]  Martijn Tideman Scenario-Based Simulation Environment for Assistance Systems , 2010 .

[14]  von Neumann-Cosel,et al.  Virtual Test Drive , 2014 .

[15]  Janice Singer,et al.  Guide to Advanced Empirical Software Engineering , 2007 .

[16]  Bernhard Rumpe Agile Modellierung mit UML - Codegenerierung, Testfälle, Refactoring , 2005, Xpert.press.

[17]  Dominique Gruyer,et al.  Simulation-Driven Validation of Advanced Driving- Assistance Systems , 2012 .

[18]  Bernhard Rumpe,et al.  MontiCore: Modular Development of Textual Domain Specific Languages , 2008, TOOLS.

[19]  Henning Holzmann,et al.  Virtual test driving at General Motors Europe , 2008 .

[20]  Bernhard Schick,et al.  Evaluation of Video-Based Driver Assistance Systems with Sensor Data Fusion by Using Virtual Test Driving , 2013 .

[21]  Bernhard Rumpe,et al.  Simulations on Consumer Tests: A Perspective for Driver Assistance Systems , 2014, ES4CPS@DATE.

[22]  O. von Stryk,et al.  Real time simulation and online control for virtual test drives of cars , 1999 .

[23]  Christian Berger,et al.  Software & Systems Engineering Process and Tools for the Development of Autonomous Driving Intelligence , 2007, J. Aerosp. Comput. Inf. Commun..

[24]  Michiel van Ratingen,et al.  The European New Car Assessment Programme , 2014 .

[25]  Lane Tracker,et al.  Preadjustment of a Vision-based Lane Tracker Using Virtual Test Drive within a Hardware in the Loop Simulator , 2008 .

[26]  Matthew Avery,et al.  Autonomous Emergency Braking Test Results , 2013 .