Real-time raindrop detection based on cellular neural networks for ADAS

A core aspect of advanced driver assistance systems (ADAS) is to support the driver with information about the current environmental situation of the vehicle. Bad weather conditions such as rain might occlude regions of the windshield or a camera lens and therefore affect the visual perception. Hence, the automated detection of raindrops has a significant importance for video-based ADAS. The detection of raindrops is highly time critical since video pre-processing stages are required to improve the image quality and to provide their results in real-time. This paper presents an approach for real-time raindrops detection which is based on cellular neural networks (CNN) and support vector machines (SVM). The major idea is to prove the possibility of transforming the support vectors into CNN templates. The advantage of CNN is its ultra fast precessing on embedded platforms such as FPGAs and GPUs. The proposed approach is capable to detect raindrops that might negatively affect the vision of the driver. Different classification features were extracted to evaluate and compare the performance between the proposed approach and other approaches.

[1]  John C. Russ,et al.  The Image Processing Handbook , 2016, Microscopy and Microanalysis.

[2]  L.O. Chua,et al.  Cellular neural networks , 1993, 1988., IEEE International Symposium on Circuits and Systems.

[3]  Masanori Sugimoto,et al.  A novel technique for raindrop detection on a car windshield using geometric-photometric model , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[4]  Tamás Roska,et al.  Cellular wave computing library (templates, algorithms, and programs). Version 2.1 , 2007 .

[5]  Andreas Geiger,et al.  Realistic Modeling of Water Droplets for Monocular Adherent Raindrop Recognition Using Bézier Curves , 2010, ACCV Workshops.

[6]  Rob Fergus,et al.  Restoring an Image Taken through a Window Covered with Dirt or Rain , 2013, 2013 IEEE International Conference on Computer Vision.

[7]  Shree K. Nayar,et al.  Detection and removal of rain from videos , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[8]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[9]  Leon O. Chua,et al.  Genetic algorithm for CNN template learning , 1993 .

[10]  Katsushi Ikeuchi,et al.  Adherent Raindrop Detection and Removal in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Hanghang Tong,et al.  Blur detection for digital images using wavelet transform , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[12]  Atsushi Yamashita,et al.  Removal of adherent waterdrops from images acquired with stereo camera , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Klaus D. Tönnies Grundlagen der Bildverarbeitung , 2005 .

[14]  David J. Hand,et al.  Measuring classifier performance: a coherent alternative to the area under the ROC curve , 2009, Machine Learning.

[15]  Martin Roser,et al.  Raindrop detection on car windshields using geometric-photometric environment construction and intensity-based correlation , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[16]  A. Gacsadi,et al.  Medical image enhancement by using cellular neural networks , 2005, Computers in Cardiology, 2005.

[17]  Fawzi Nashashibi,et al.  Detection of unfocused raindrops on a windscreen using low level image processing , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[18]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[19]  K Garg,et al.  DETECTION AND REMOVAL OF RAIN FROM VIDEOS IN COMPUTER VISION AND PATTERN RECOGNITION , 2004 .

[20]  Wei Wang,et al.  Edge detection of infrared image with CNN_DGA algorithm , 2014 .

[21]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[22]  Leon O. Chua,et al.  Cellular Neural Networks and Visual Computing: Foundations and Applications , 2002 .

[23]  Katsushi Ikeuchi,et al.  Adherent Raindrop Modeling, Detectionand Removal in Video , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  I. Ide,et al.  Rainy weather recognition from in-vehicle camera images for driver assistance , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[25]  Akio Ushida,et al.  Adaptive Simulated Annealing in CNN Template Learning , 1999 .

[26]  William T. Freeman,et al.  Orientation Histograms for Hand Gesture Recognition , 1995 .

[27]  Hsien-Chou Liao,et al.  Video-based Water Drop Detection and Removal Method for a Moving Vehicle , 2013 .

[28]  Tamás Roska,et al.  Statistical physics on cellular neural network computers , 2008 .

[29]  Leon O. Chua,et al.  Cellular neural networks: applications , 1988 .

[30]  Andreas Geiger,et al.  Video-based raindrop detection for improved image registration , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[31]  Tinku Acharya,et al.  Image Processing: Principles and Applications , 2005, J. Electronic Imaging.

[32]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[33]  Jitendra Malik,et al.  Matching Shapes , 2001, ICCV.

[34]  Cheng-Wu Chen,et al.  Applications of Cellular Neural Networks to Noise Cancelation in Gray Images Based on Adaptive Particle-swarm Optimization , 2011, Circuits Syst. Signal Process..

[35]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[36]  Atsushi Yamashita,et al.  Noises removal from image sequences acquired with moving camera by estimating camera motion from spatio-temporal information , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Qi Wu,et al.  Camera-based clear path detection , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[38]  Kyandoghere Kyamakya,et al.  CNN based high performance computing for real time image processing on GPU , 2011, Proceedings of the Joint INDS'11 & ISTET'11.

[39]  Imad H. Elhajj,et al.  Support Vector Machines to Define and Detect Agitation Transition , 2010, IEEE Transactions on Affective Computing.

[40]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[41]  Kyandoghere Kyamakya,et al.  Adaptive contrast enhancement involving CNN-based processing for foggy weather conditions & non-uniform lighting conditions , 2010, Proceedings of the Joint INDS'11 & ISTET'11.

[42]  I. Andreadis,et al.  Image analysis using moments , 2005 .

[43]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  George S. Moschytz,et al.  Learning algorithms for cellular neural networks , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[45]  Qi Wu,et al.  Raindrop detection and removal using salient visual features , 2012, 2012 19th IEEE International Conference on Image Processing.