Testing of autonomous vehicles using surrogate models and stochastic optimization

Advancement in testing and verification methodologies is one of the key requirements for the commercialization and standardization of autonomous driving. Even though great progress has been made, the main challenges encountered during testing of autonomous vehicles, e.g., high number of test scenarios, huge parameter space and long simulation runs, still remain. In order to reduce current testing efforts, we propose an innovative method based on surrogate models in combination with stochastic optimization. The approach presents an iterative zooming-in algorithm aiming to minimize a given cost function and to identify faulty behavior regions within the parameter space. The surrogate model is updated in each iteration and is further used for intensive evaluation tasks, such as exploration and optimization.

[1]  Thomas Schamm,et al.  Testing and validating high level components for automated driving: simulation framework for traffic scenarios , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[2]  Ralf Kohlhaas,et al.  Data-driven simulation and parametrization of traffic scenarios for the development of advanced driver assistance systems , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[3]  Ken Butts,et al.  Simulation-Based Approaches for Verification of Embedded Control Systems: An Overview of Traditional and Advanced Modeling, Testing, and Verification Techniques , 2016, IEEE Control Systems.

[4]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[5]  Sebastien Glaser,et al.  Distributed simulation platform for cooperative ADAS testing and validation , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[6]  Antonella Ferrara,et al.  Collision avoidance strategies and coordinated control of passenger vehicles , 2007 .

[7]  Hermann Winner,et al.  Handbook of Driver Assistance Systems: Basic Information, Components and Systems for Active Safety and Comfort , 2015 .

[8]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[9]  Hermann Winner,et al.  Virtual Assessment of Automation in Field Operation – A New Runtime Validation Method , 2015 .

[10]  Georgios E. Fainekos,et al.  Utilizing S-TaLiRo as an automatic test generation framework for autonomous vehicles , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[11]  Ralf Kohlhaas,et al.  Semivirtual simulations for the evaluation of vision-based ADAS , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[12]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[13]  Antonella Ferrara,et al.  Onboard Sensor-Based Collision Risk Assessment to Improve Pedestrians' Safety , 2007, IEEE Transactions on Vehicular Technology.

[14]  Lionel C. Briand,et al.  Testing advanced driver assistance systems using multi-objective search and neural networks , 2016, 2016 31st IEEE/ACM International Conference on Automated Software Engineering (ASE).

[15]  Berthold Färber,et al.  Driver perception and reaction in collision avoidance: Implications for ADAS development and testing , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[16]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[17]  Sriram Sankaranarayanan,et al.  S-TaLiRo: A Tool for Temporal Logic Falsification for Hybrid Systems , 2011, TACAS.

[18]  WuLing Huang,et al.  Autonomous vehicles testing methods review , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[19]  Thomas Schamm,et al.  Testing of Advanced Driver Assistance Towards Automated Driving: A Survey and Taxonomy on Existing Approaches and Open Questions , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.