Impact of circuit-level non-idealities on vision-based autonomous driving systems

We describe a novel methodology to validate vision-based autonomous driving systems over different circuit corners with consideration of temperature variation and circuit aging. The proposed work is motivated by the fact that low-level circuit implementation may have a significant impact on system performance, even though such effects have not been appropriately taken into account today. Our approach seamlessly integrates the image data recorded under nominal conditions with comprehensive statistical circuit models to synthetically generate the critical corner cases for which an autonomous driving system is likely to fail. As such, a given automotive system can be robustly validated for these worst-case scenarios that cannot be easily captured by physical experiments.

[1]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[2]  Luc Van Gool,et al.  Traffic sign recognition — How far are we from the solution? , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[3]  Anders Lindgren,et al.  State of the Art Analysis: An Overview of Advanced Driver Assistance Systems (ADAS) and Possible Human Factors Issues , 2006 .

[4]  Albert J. P. Theuwissen,et al.  Single-photon imaging , 2011 .

[5]  Chong-Min Kyung.  Theory and Applications of Smart Cameras , 2015 .

[6]  Eric Dumont,et al.  Nighttime Visibility Analysis and Estimation Method in the Presence of Dense Fog , 2015, IEEE Transactions on Intelligent Transportation Systems.

[7]  Marc Stamminger,et al.  Hardware-in-the-loop testing of computer vision based driver assistance systems , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[8]  W.E. Snyder,et al.  Color image processing pipeline , 2005, IEEE Signal Processing Magazine.

[9]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[10]  Johannes Stallkamp,et al.  Detection of traffic signs in real-world images: The German traffic sign detection benchmark , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[11]  Gerald C. Holst,et al.  CCD arrays, cameras, and displays , 1996 .

[12]  Marc Stamminger,et al.  Concerning the applicability of computer graphics for the evaluation of image processing algorithms , 2012, 2012 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2012).

[13]  Albert J. P. Theuwissen,et al.  Ageing effects on image sensors due to terrestrial cosmic radiation , 2011, Electronic Imaging.

[14]  Nasir Memon,et al.  Digital Image Forensics: There is More to a Picture than Meets the Eye , 2012 .

[15]  J. Fridrich,et al.  Digital image forensics , 2009, IEEE Signal Processing Magazine.

[16]  Israel Koren,et al.  Empirical formula for rates of hot pixel defects based on pixel size, sensor area, and ISO , 2013, Electronic Imaging.

[17]  Meng-Yin Fu,et al.  A survey of traffic sign recognition , 2010, 2010 International Conference on Wavelet Analysis and Pattern Recognition.

[18]  Wolfgang Rosenstiel,et al.  Simulation of falling rain for robustness testing of video-based surround sensing systems , 2016, 2016 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[19]  Zhiyi Yu,et al.  An FPGA-Based Hardware Accelerator for Traffic Sign Detection , 2017, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[20]  Werner Huber,et al.  Experience, Results and Lessons Learned from Automated Driving on Germany's Highways , 2015, IEEE Intelligent Transportation Systems Magazine.

[21]  Xin Li,et al.  Efficient statistical validation of machine learning systems for autonomous driving , 2016, 2016 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[22]  Nidhi Kalra,et al.  Driving to Safety , 2016 .

[23]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[24]  Takao Kuroda,et al.  Essential Principles of Image Sensors , 2014 .

[25]  K. Castleman,et al.  Cameras , 1998, Current protocols in cytometry.