Static object detection and segmentation in videos based on dual foregrounds difference with noise filtering

This paper presents static object detection and segmentation method in videos from cluttered scenes. Robust static object detection is still challenging task due to presence of moving objects in many surveillance applications. The level of difficulty is extremely influenced by on how you label the object to be identified as static that do not establish the original background but appeared in the video at different time. In this context, background subtraction technique based on the frame difference concept is applied to the identification of static objects. Firstly, we estimate a frame differencing foreground mask image by computing the difference of each frame with respect to a static reference frame. The Mixture of Gaussian MOG method is applied to detect the moving particles and then outcome foreground mask is subtracted from frame differencing foreground mask. Pre-processing techniques, illumination equalization and de-hazing methods are applied to handle low contrast and to reduce the noise from scattered materials in the air e.g. water droplets and dust particles. Finally, a set of mathematical morphological operation and largest connected-component analysis is applied to segment the object and suppress the noise. The proposed method was built for rock breaker station application and effectively validated with real, synthetic and two public data sets. The results demonstrate the proposed approach can robustly detect, segmented the static objects without any prior information of tracking.

[1]  Thierry Bouwmans,et al.  Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey , 2008 .

[2]  H. Chenga,et al.  Automated breast cancer detection and classification using ultrasound images A survey , 2009 .

[3]  Xingzhi Luo,et al.  A Multiscale Parametric Background Model for Stationary Foreground Object Detection , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[4]  P. L. Venetianer,et al.  Stationary target detection using the objectvideo surveillance system , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[5]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Sergio A. Velastin,et al.  Automatic congestion detection system for underground platforms , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[7]  Qi Zhang,et al.  Real-Time Automatic Obstacle Detection method for Traffic Surveillance in Urban Traffic , 2015, Journal of Signal Processing Systems.

[8]  Farid Meziane,et al.  Automatic ROI detection and classification of the achilles tendon ultrasound images , 2017, IML.

[9]  Shree K. Nayar,et al.  Chromatic framework for vision in bad weather , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[10]  Brian C. Lovell,et al.  An Abandoned Object Detection System Based on Dual Background Segmentation , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[11]  Martin Servin,et al.  Object Detection in Digital Images under Non-Standardized Conditions Using Illumination and Shadow Filtering , 2017 .

[12]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[13]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Xinge You,et al.  A local region based approach to lip tracking , 2012, Pattern Recognit..

[15]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..

[17]  Michael D. Beynon,et al.  Detecting abandoned packages in a multi-camera video surveillance system , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[18]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[19]  Rubén Heras Evangelio,et al.  Static Object Detection Based on a Dual Background Model and a Finite-State Machine , 2011, EURASIP J. Image Video Process..

[20]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[21]  J. Crowley,et al.  CAVIAR Context Aware Vision using Image-based Active Recognition , 2005 .

[22]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[23]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[24]  José María Martínez Sanchez,et al.  Comparative Evaluation of Stationary Foreground Object Detection Algorithms Based on Background Subtraction Techniques , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[25]  Kazuhiko Sumi,et al.  Background subtraction based on cooccurrence of image variations , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[26]  Jitendra Malik,et al.  Towards robust automatic traffic scene analysis in real-time , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[27]  Edward R. Dougherty,et al.  Hands-on Morphological Image Processing , 2003 .

[28]  Sadiye Guler,et al.  Stationary objects in multiple object tracking , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[29]  José A. Rodríguez-Serrano,et al.  Robust abandoned object detection integrating wide area visual surveillance and social context , 2013, Pattern Recognit. Lett..

[30]  Waqqas ur Rehman Butt Speech Recognition Supported by Lip Analysis , 2016 .

[31]  Yuri Ivanov,et al.  Robust Abandoned Object Detection Using Dual Foregrounds , 2008, EURASIP J. Adv. Signal Process..