Simulation-based Evaluation of Automotive Sensor Setups for Environmental Perception in Early Development Stages

Car manufacturers are facing the challenge of defining suitable sensor setups that cover all requirements for the particular SAE level of automated driving. Besides the sensors' performance and surround-view coverage, other factors like vehicle integration, costs and design aspects need to be taken into account. Additionally, a redundant sensor arrangement and the sensors' sensitivity to environmental influences are of crucial importance for safety. By increasing the degree of automation, vehicles require more external sensors to observe their surrounding environment sufficiently, which raises the variety of setup configurations and the difficulty to identify the optimal one. Concerning the vehicle development process, concepts for sensor setups need to be defined at a very early stage. In this concept stage, it is not feasible to explore every possible sensor arrangement with test drives or to simulate the setup performance with tools used for vehicle validation. Thus, we propose a new simulation-based evaluation method, which allows the configuration of arbitrary sensor setups and enables virtual test drives within specific scenarios to evaluate the setup performance in this early development phase with metrics and key performance indicators. Two different setups are analyzed to demonstrate the results of this evaluation method.

[1]  Hermann Winner,et al.  Measurements revealing Challenges in Radar Sensor Modeling for Virtual Validation of Autonomous Driving , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[2]  Thomas Dörfler Testing ADAS sensors in early development phases , 2018 .

[3]  Stephan Matzka,et al.  A comparison of track-to-track fusion algorithms for automotive sensor fusion , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[4]  Ba-Ngu Vo,et al.  A Consistent Metric for Performance Evaluation of Multi-Object Filters , 2008, IEEE Transactions on Signal Processing.

[5]  Thomas Brandmeier,et al.  Test methodology for rain influence on automotive surround sensors , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[6]  Raju V. Kala,et al.  Sensor modeling for the Virtual Autonomous Navigation Environment , 2009, 2009 IEEE Sensors.

[7]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[8]  Brigitte d'Andréa-Novel,et al.  From virtual to reality, how to prototype, test and evaluate new ADAS: Application to automatic car parking , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[9]  WuLing Huang,et al.  Autonomous vehicles testing methods review , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[10]  Soyeb Nagori,et al.  Virtual Simulation Platforms for Automated Driving: Key Care-About and Usage Model , 2018 .

[11]  B. Dehlink,et al.  A non-parametric approach for modeling sensor behavior , 2015, 2015 16th International Radar Symposium (IRS).

[12]  Adam Ziebinski,et al.  Review of advanced driver assistance systems (ADAS) , 2017 .

[13]  Thomas Schaller,et al.  Overall Approach to Standardize AD Sensor Interfaces: Simulation and Real Vehicle , 2019 .

[14]  Erwin M. Biebl,et al.  Classification of sensor errors for the statistical simulation of environmental perception in automated driving systems , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[15]  Hermann Winner,et al.  Towards a Generally Accepted Validation Methodology for Sensor Models - Challenges, Metrics, and First Results , 2019 .

[16]  Homayoun Najjaran,et al.  Autonomous vehicle perception: The technology of today and tomorrow , 2018 .

[17]  Robin Schubert,et al.  Simulation of Sensor Models for the Evaluation of Advanced Driver Assistance Systems , 2014, ATZelektronik worldwide.

[18]  Sukhan Lee,et al.  Multisensor Fusion and Integration for Intelligent Systems , 2009 .

[19]  Hermann Winner,et al.  Three Decades of Driver Assistance Systems: Review and Future Perspectives , 2014, IEEE Intelligent Transportation Systems Magazine.