An ER Algorithm-Based Method for Removal of Adherent Water Drops from Images Obtained by a Rear View Camera Mounted on a Vehicle in Rainy Conditions

In this paper, an ER (Error-Reduction) algorithm-based method for removal of adherent water drops from images obtained by a rear view camera mounted on a vehicle in rainy conditions is proposed. Since Fourier-domain and object-domain constraints are needed for any ER algorithm-based method, the proposed method introduces the following two novel constraints for the removal of adherent water drops. The first one is the Fourier-domain constraint that utilizes the Fourier transform magnitude of the previous frame in the obtained images as that of the target frame. Noting that images obtained by the rear view camera have the unique characteristics of objects moving like ripples because the rear view camera is generally composed of a fish-eye lens for a wide view angle, the proposed method assumes that the Fourier transform magnitudes of the target frame and the previous frame are the same in the polar coordinate system. The second constraint is the object-domain constraint that utilizes intensities in an area of the target frame to which water drops have adhered. Specifically, the proposed method models a deterioration process of intensities that are corrupted by the water drop adhering to the rear view camera lens. By utilizing these novel constraints, the proposed ER algorithm can remove adherent water drops from images obtained by the rear view camera. Experimental results that verify the performance of the proposed method are represented.

[1]  Eigo Segawa,et al.  Preceding Vehicle Detection Using Stereo Images and Non-Scanning Millimeter-Wave Radar , 2005, MVA.

[2]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[3]  Miki Haseyama,et al.  A Kalman filter-based approach for adaptive restoration of in-vehicle camera foggy images , 2008, 2008 15th IEEE International Conference on Image Processing.

[4]  Atsushi Yamashita,et al.  Removal of Adherent Waterdrops from Images Acquired with a Stereo Camera System , 2006, IEICE Trans. Inf. Syst..

[5]  Miki Haseyama,et al.  A Kalman filter based restoration method for in-vehicle camera images in foggy conditions , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Stanley T. Birchfield,et al.  Real-Time Incremental Segmentation and Tracking of Vehicles at Low Camera Angles Using Stable Features , 2008, IEEE Transactions on Intelligent Transportation Systems.

[7]  James R. Fienup,et al.  Phase-retrieval stagnation problems and solutions , 1986 .

[8]  Stefan K. Gehrig,et al.  Collision Avoidance for Vehicle-Following Systems , 2007, IEEE Transactions on Intelligent Transportation Systems.

[9]  Raja Sengupta,et al.  Kalman Filter-Based Integration of DGPS and Vehicle Sensors for Localization , 2005, IEEE Transactions on Control Systems Technology.

[10]  Hiroshi Murase,et al.  Raindrop Detection from In-Vehicle Video Camera Images for Rainfall Judgment , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[11]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.