Dust particle detection in surveillance video using salient visual descriptors

We identify the dust particles in images using salient visual descriptors.We exploit localized color, texture and shape saliency features.We develop a machine learning approach to detect dust particle in images. Display Omitted Outdoor surveillance video that suffers from dirty camera lenses has the potential for deteriorated performance in many applications, such as vehicle tracking and target recognition. This paper proposes to identify the dust particles in images using a set of salient visual descriptors. More specifically, the proposed approach exploits an extended feature descriptor comprising localized color, texture and shape saliency features. These proposed features are further incorporated into a machine learning approach, followed by a dust particle localization approach, for detecting dust particle in images. The proposed approach is able to achieve superior dust particle detection performance to that of conventional approaches, as evaluated in real-world video surveillance scenarios.

[1]  Cesare Alippi,et al.  Detecting External Disturbances on the Camera Lens in Wireless Multimedia Sensor Networks , 2010, IEEE Transactions on Instrumentation and Measurement.

[2]  Qi Wu,et al.  Raindrop detection and removal using salient visual features , 2012, 2012 19th IEEE International Conference on Image Processing.

[3]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[4]  Toby P. Breckon,et al.  Improved raindrop detection using combined shape and saliency descriptors with scene context isolation , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[5]  Stephen Lin,et al.  Removal of Image Artifacts Due to Sensor Dust , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Nils Einecke,et al.  Detection of camera artifacts from camera images , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[7]  Andrew E. Johnson,et al.  AN OPTICAL MODEL FOR IMAGE ARTIFACTS PRODUCED BY DUST PARTICLES ON LENSES , 2005 .

[8]  P. Belhumeur,et al.  Removing image artifacts due to dirty camera lenses and thin occluders , 2009, SIGGRAPH 2009.

[9]  Pavel Kisilev Automatic context-aware dust and scratch removal in scanned images , 2008, 2008 15th IEEE International Conference on Image Processing.

[10]  Atsushi Yamashita,et al.  Removal of adherent noises from image sequences by spatio-temporal image processing , 2008, 2008 IEEE International Conference on Robotics and Automation.

[11]  Darryl Greig,et al.  Comprehensive solutions for automatic removal of dust and scratches from images , 2008, J. Electronic Imaging.

[12]  Nasir D. Memon,et al.  Digital Single Lens Reflex Camera Identification From Traces of Sensor Dust , 2008, IEEE Transactions on Information Forensics and Security.

[13]  Darryl Greig,et al.  Dust and scratch removal in scanned images , 2007, Electronic Imaging.

[14]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[15]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[16]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[17]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.