Validation of vehicle environment sensor models

Today's advanced driver assistance systems (ADAS) are increasingly becoming more complex. The next step in this direction is the development of automated driving systems. However, along with the complexity, the effort required for development and validation of these systems is increasing as well. In order to be able to master this complexity in terms of cost and time, simulations are being used more frequently. Since perception sensors are essential for highly and fully automated systems, it is important to have valid sensor models for the development and validation of such systems. Therefore, in this paper we present a method for the validation of perception sensor models. The method differs from known approaches by its two-step procedure. First we directly compare the experimental results and the model output. Then the output of the next tier in the system, using real and synthetic data from sensor model as input, is compared. We also show the tool chain for implementation along with first results, confirming the potential of our approach.

[1]  Masoud Nikravesh,et al.  Feature Extraction - Foundations and Applications , 2006, Feature Extraction.

[2]  Torsten Bertram,et al.  Track-to-track fusion with asynchronous sensors and out-of-sequence tracks using information matrix fusion for advanced driver assistance systems , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[3]  Matthew F. Barone,et al.  Measures of agreement between computation and experiment: Validation metrics , 2004, J. Comput. Phys..

[4]  Alois Knoll,et al.  Analysis and Validation of Perception Sensor Models in an Integrated Vehicle and Environment Simulation , 2011 .

[5]  B. Dehlink,et al.  A non-parametric approach for modeling sensor behavior , 2015, 2015 16th International Radar Symposium (IRS).

[6]  Maximilian Miegler,et al.  Testing of Piloted Driving on Virtual Streets , 2015 .

[7]  Timothy G. Trucano,et al.  Verification and validation benchmarks , 2008 .

[8]  Robert J. Baron,et al.  Mechanisms of Human Facial Recognition , 1981, Int. J. Man Mach. Stud..

[9]  W. Wiesbeck,et al.  Extraction of Virtual Scattering Centers of Vehicles by Ray-Tracing Simulations , 2008, IEEE Transactions on Antennas and Propagation.

[10]  Dirk Wollherr,et al.  Evidential Grid-Based Tracking and Mapping , 2017, IEEE Transactions on Intelligent Transportation Systems.

[11]  Robin R. Murphy,et al.  Conflict Metric as a Measure of Sensing Quality , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[12]  Robin Schubert,et al.  Simulation von Sensorfehlern zur Evaluierung von Fahrerassistenzsystemen , 2014 .

[13]  Leonard E. Schwer,et al.  An overview of the PTC 60/V&V 10: guide for verification and validation in computational solid mechanics , 2007, Engineering with Computers.

[14]  Hermann Winner,et al.  Perception sensor modeling for virtual validation of automated driving , 2015, it Inf. Technol..

[15]  Markus Maurer,et al.  Vernetzung von Test- und Simulationsmethoden für Fahrerassistenzsysteme , 2009 .

[16]  Erwin Biebl,et al.  A ray launching approach for modeling an FMCW radar system , 2017, 2017 18th International Radar Symposium (IRS).

[17]  B. Dehlink,et al.  Generic architecture for simulation of ADAS sensors , 2015, 2015 16th International Radar Symposium (IRS).

[18]  Erwin Biebl,et al.  Virtual sensor models for real-time applications , 2016 .

[19]  Rasshofer Ralph,et al.  Classification of sensor errors for the statistical simulation of environmental perception in automated driving systems , 2016 .