Accelerated Evaluation of Automated Vehicles Using Piecewise Mixture Models

The process to certify highly automated vehicles has not yet been defined by any country in the world. Currently, companies test automated vehicles on public roads, which is time-consuming and inefficient. We proposed the accelerated evaluation concept, which uses a modified statistics of the surrounding vehicles and the importance sampling theory to reduce the evaluation time by several orders of magnitude, while ensuring the evaluation results are statistically accurate. In this paper, we further improve the accelerated evaluation concept by using piecewise mixture distribution models, instead of single parametric distribution models. We developed and applied this idea to forward collision control system reacting to vehicles making cutin lane changes. The behavior of the cutin vehicles was modeled based on more than 403,581 lane changes collected by the University of Michigan Safety Pilot Model Deployment Program. Simulation results confirm that the accuracy and efficiency of the piecewise mixture distribution method outperformed single parametric distribution methods in accuracy and efficiency, and accelerated the evaluation process by almost four orders of magnitude.

[1]  M. Kendall Theoretical Statistics , 1956, Nature.

[2]  J. Aldrich R.A. Fisher and the making of maximum likelihood 1912-1922 , 1997 .

[3]  Ding Zhao,et al.  Accelerated evaluation of automated vehicles using extracted naturalistic driving data , 2016 .

[4]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[7]  Ding Zhao,et al.  Evaluation of automated vehicles in the frontal cut-in scenario — An enhanced approach using piecewise mixture models , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Huei Peng,et al.  A Worst-case Evaluation Method for Dynamic Systems , 1999 .

[9]  Ding Zhao,et al.  Accelerated Evaluation of Automated Vehicles in Car-Following Maneuvers , 2016, IEEE Transactions on Intelligent Transportation Systems.

[10]  Huei Peng,et al.  An adaptive lateral preview driver model , 2005 .

[11]  Timothy J. Robinson,et al.  Linear Models With R , 2005, Technometrics.

[12]  Peter W. Glynn,et al.  Stochastic Simulation: Algorithms and Analysis , 2007 .

[13]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[14]  Gerardo Rubino,et al.  Introduction to Rare Event Simulation , 2009, Rare Event Simulation using Monte Carlo Methods.

[15]  Ding Zhao,et al.  Accelerated Evaluation of Automated Vehicles. , 2016 .

[16]  Evaluation of the Performance and Safety of Automated Vehicles ” for , 2013 .

[17]  Youseok Kou,et al.  Development and Evaluation of Integrated Chassis Control Systems. , 2010 .

[18]  Dirk P. Kroese,et al.  The cross-entropy method for estimation , 2013 .