Challenges in Object Detection Under Rainy Weather Conditions

Intelligent vehicles use surround sensors which perceive their environment and therefore enable automatic vehicle control. As already small errors in sensor data measurement and interpretation could lead to severe accidents, future object detection algorithms must function safely and reliably. However, adverse weather conditions, illustrated here using the example of rain, attenuate the sensor signals and thus limit sensor performance. The indoor rain simulation facility at CARISSMA enables reproducible measurements of predefined scenarios under varying conditions of rain. This simulator is used to systematically investigate the effects of rain on camera, lidar, and radar sensor data. This paper aims at (1) comparing the performance of simple object detection algorithms under clear weather conditions, (2) visualizing/discussing the direct negative effects of the same algorithms under adverse weather conditions, and (3) summarizing the identified challenges and pointing out future work.

[1]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Hermann Rohling,et al.  Radar CFAR Thresholding in Clutter and Multiple Target Situations , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Shree K. Nayar,et al.  Vision and Rain , 2006 .

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  Frédéric Chausse,et al.  Methodology Used to Evaluate Computer Vision Algorithms in Adverse Weather Conditions , 2016 .

[7]  Alebel Arage Hassen Indicators for the Signal Degradation and Optimization of Automotive Radar Sensors Under Adverse Weather Conditions , 2007 .

[8]  Zygmunt Mierczyk,et al.  Comparison of 905 nm and 1550 nm semiconductor laser rangefinders’ performance deterioration due to adverse environmental conditions , 2014 .

[9]  K Garg,et al.  DETECTION AND REMOVAL OF RAIN FROM VIDEOS IN COMPUTER VISION AND PATTERN RECOGNITION , 2004 .

[10]  Thomas Brandmeier,et al.  Test methodology for rain influence on automotive surround sensors , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[11]  Volker Sandner Development of a test target for AEB systems: development process of a device to test AEB systems for consumer tests , 2013 .

[12]  Ralph Helmar Rasshofer,et al.  Influences of weather phenomena on automotive laser radar systems , 2011 .

[13]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Alexander Yarovoy,et al.  Analysis of rain clutter detections in commercial 77 GHz automotive radar , 2017, 2017 European Radar Conference (EURAD).

[15]  Andreas Riener,et al.  Reproducible Fog Simulation for Testing Automotive Surround Sensors , 2017, 2017 IEEE 85th Vehicular Technology Conference (VTC Spring).

[16]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Hermann Rohling,et al.  Ordered statistic CFAR technique - an overview , 2011, 2011 12th International Radar Symposium (IRS).

[18]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..