Accelerated testing for automated vehicles safety evaluation in cut-in scenarios based on importance sampling, genetic algorithm and simulation applications

Purpose It would take billions of miles’ field road testing to demonstrate that the safety of automated vehicle is statistically significantly higher than the safety of human driving because that the accident of vehicle is rare event. Design/methodology/approach This paper proposes an accelerated testing method for automated vehicles safety evaluation based on improved importance sampling (IS) techniques. Taking the typical cut-in scenario as example, the proposed method extracts the critical variables of the scenario. Then, the distributions of critical variables are statistically fitted. The genetic algorithm is used to calculate the optimal IS parameters by solving an optimization problem. Considering the error of distribution fitting, the result is modified so that it can accurately reveal the safety benefits of automated vehicles in the real world. Findings Based on the naturalistic driving data in Shanghai, the proposed method is validated by simulation. The result shows that compared with the existing methods, the proposed method improves the test efficiency by 35 per cent, and the accuracy of accelerated test result is increased by 23 per cent. Originality/value This paper has three contributions. First, the genetic algorithm is used to calculate IS parameters, which improves the efficiency of test. Second, the result of test is modified by the error correction parameter, which improves the accuracy of test result. Third, typical high-risk cut-in scenarios in China are analyzed, and the proposed method is validated by simulation.

[1]  Philip Heidelberger,et al.  Effective Bandwidth and Fast Simulation of ATM Intree Networks , 1994, Perform. Evaluation.

[2]  Paul Glasserman,et al.  Importance Sampling for Portfolio Credit Risk , 2005, Manag. Sci..

[3]  Klaus C. J. Dietmayer,et al.  Situation Assessment of an Autonomous Emergency Brake for Arbitrary Vehicle-to-Vehicle Collision Scenarios , 2009, IEEE Transactions on Intelligent Transportation Systems.

[4]  Dennis D. Cox,et al.  Adaptive importance sampling on discrete Markov chains , 1999 .

[5]  A Touran,et al.  A collision model for safety evaluation of autonomous intelligent cruise control. , 1999, Accident; analysis and prevention.

[6]  A. Galip Ulsoy,et al.  Automotive Control Systems: Vehicle Control Systems , 2012 .

[7]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[8]  Michael A. Shulman,et al.  Third Annual Report of the Crash Avoidance Metrics Partnership,April 2003 - March 2004 , 2005 .

[9]  A. Galip Ulsoy,et al.  Automotive Control Systems: Preface , 2012 .

[10]  Donald L. Iglehart,et al.  Importance sampling for stochastic simulations , 1989 .

[11]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[12]  Ding Zhao,et al.  Accelerated Evaluation of Automated Vehicles. , 2016 .

[13]  Berthold Färber,et al.  Vehicle in the Loop , 2015, Handbuch Fahrerassistenzsysteme.

[14]  Azim Eskandarian,et al.  Research advances in intelligent collision avoidance and adaptive cruise control , 2003, IEEE Trans. Intell. Transp. Syst..

[15]  P. Shahabuddin,et al.  Chapter 11 Rare-Event Simulation Techniques: An Introduction and Recent Advances , 2006, Simulation.

[16]  Suzanne E. Lee,et al.  A COMPREHENSIVE EXAMINATION OF NATURALISTIC LANE-CHANGES , 2004 .

[17]  Henry Lam,et al.  State-dependent importance sampling for rare-event simulation: An overview and recent advances , 2012 .

[18]  Ding Zhao,et al.  Accelerated Evaluation of Automated Vehicles in Car-Following Maneuvers , 2016, IEEE Transactions on Intelligent Transportation Systems.

[19]  Youseok Kou,et al.  Development and Evaluation of Integrated Chassis Control Systems. , 2010 .

[20]  Francesco Timpone,et al.  Software-in-the-loop development and validation of a Cornering Brake Control logic , 2007 .

[21]  Philip Heidelberger,et al.  Fast simulation of rare events in queueing and reliability models , 1993, TOMC.

[22]  James R. Sayer,et al.  Integrated vehicle-based safety systems field operational test final program report. , 2011 .

[23]  Ding Zhao,et al.  An accelerated testing approach for automated vehicles with background traffic described by joint distributions , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[24]  Majid Sarvi,et al.  Lane changing models: a critical review , 2010 .

[25]  Nidhi Kalra,et al.  Driving to Safety , 2016 .

[26]  Ding Zhao,et al.  Accelerated Evaluation of Automated Vehicles Using Piecewise Mixture Models , 2017, IEEE Transactions on Intelligent Transportation Systems.

[27]  Huei Peng,et al.  Development and evaluation of collision warning/collision avoidance algorithms using an errable driver model , 2010 .

[28]  A Lie,et al.  Effectiveness of low speed autonomous emergency braking in real-world rear-end crashes. , 2015, Accident; analysis and prevention.

[29]  Eduard Zaloshnja,et al.  The Economic and Societal Impact of Motor Vehicle Crashes, 2010 (Revised) , 2015 .

[30]  Matthias Althoff,et al.  Comparison of Markov Chain Abstraction and Monte Carlo Simulation for the Safety Assessment of Autonomous Cars , 2011, IEEE Transactions on Intelligent Transportation Systems.

[31]  Ding Zhao,et al.  Towards affordable on-track testing for autonomous vehicle — A Kriging-based statistical approach , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[32]  Huei Peng,et al.  A Worst-case Evaluation Method for Dynamic Systems , 1999 .

[33]  Daniel Blower,et al.  Effectiveness of a current commercial vehicle forward collision avoidance and mitigation systems , 2013 .

[34]  Michel Verhaegen,et al.  Development of advanced driver assistance systems with vehicle hardware-in-the-loop simulations , 2006 .

[35]  Mitsuo Gen,et al.  Genetic algorithms and engineering optimization , 1999 .

[36]  S. Juneja,et al.  Rare-event Simulation Techniques : An Introduction and Recent Advances , 2006 .

[37]  Helen Fagerlind,et al.  Assessment of Integrated Vehicle Safety Systems for Improved Vehicle Safety , 2012 .

[38]  Ding Zhao,et al.  Accelerated evaluation of automated vehicles using extracted naturalistic driving data , 2016 .

[39]  James R. Sayer,et al.  Integrated vehicle-based safety systems: light vehicle field operational test, key findings report. , 2011, Annals of emergency medicine.

[40]  Thomas I. Gorman,et al.  Prospects for the Collision-Free Car: The Effectiveness of Five Competing Forward Collision Avoidance Systems , 2013 .

[41]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[42]  Mike McDonald,et al.  Towards an understanding of adaptive cruise control , 2001 .

[43]  James A. Bucklew,et al.  Introduction to Rare Event Simulation , 2010 .

[44]  Hermann Winner,et al.  Handbook of Driver Assistance Systems: Basic Information, Components and Systems for Active Safety and Comfort , 2015 .