Background subtraction methods in video streams: A review

Background subtraction is one of the most important parts in image and video processing field. There are some unnecessary parts during the image or video processing, and should be removed, because they lead to more execution time or required memory. Several subtraction methods have been presented for the time being, but find the best-suited method is an issue, which this study is going to address. This paper presents a comparative study of several existing background subtraction methods which have been investigated from simple background subtraction to more complex statistical techniques. The goal of this study is to provide a view of the strengths and drawbacks of the widely used methods. The methods are compared based on their memory requirement, the computational time and their robustness of different videos. Finally, a comparison between the existing methods has been employed with some factors like computational time or memory requirements.

[1]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[2]  Alexandre R. J. François,et al.  Adaptive Color Background Modeling for Real-Time Segmentation of Video Streams* , 1999 .

[3]  Hélène Laurent,et al.  Review and evaluation of commonly-implemented background subtraction algorithms , 2008, 2008 19th International Conference on Pattern Recognition.

[4]  Claude Montacié,et al.  Mixture splitting technique and temporal control in a HMM-based recognition system , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[5]  Auday A. H. Mohamad,et al.  Adaptive median filter background subtractions technique using fuzzy logic , 2013, 2013 INTERNATIONAL CONFERENCE ON COMPUTING, ELECTRICAL AND ELECTRONIC ENGINEERING (ICCEEE).

[6]  Thierry Chateau,et al.  Vehicle trajectories evaluation by static video sensors , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[7]  Nima Seif Naraghi,et al.  A Comparative Study of Background Estimation Algorithms , 2009 .

[8]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[9]  Thierry Bouwmans,et al.  Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey , 2008 .

[10]  Kenneth Y. Goldberg,et al.  Visual tracking of human visitors under variable-lighting conditions for a responsive audio art installation , 2012, 2012 American Control Conference (ACC).

[11]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[12]  Benjamin Höferlin,et al.  Evaluation of background subtraction techniques for video surveillance , 2011, CVPR 2011.

[13]  Richard Comley,et al.  Performance Evaluation Metrics for Video Tracking , 2011 .

[14]  Daphna Weinshall,et al.  Motion of disturbances: detection and tracking of multi-body non-rigid motion , 1999, Machine Vision and Applications.

[15]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[16]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Hongxun zhang,et al.  Fusing Color and Texture Features for Background Model , 2006, FSKD.

[19]  José Muñoz,et al.  A Neural Network Approach for Video Object Segmentation in Traffic Surveillance , 2008, ICIAR.

[20]  Rita Cucchiara,et al.  Probabilistic posture classification for Human-behavior analysis , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[21]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.

[22]  Simone Calderara,et al.  Reliable background suppression for complex scenes , 2006, VSSN '06.

[23]  T. List,et al.  Comparison of target detection algorithms using adaptive background models , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[24]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[25]  H. Niemann,et al.  Adaptive change detection for real-time surveillance applications , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[26]  D. Koller,et al.  Towards robust automatic traffic scene analysis in real-time , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[27]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[28]  Mohd Shahrizal Sunar,et al.  Survey of Shadow Volume Algorithms in Computer Graphics , 2013 .

[29]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[30]  Thierry Bouwmans,et al.  A Fuzzy Background Modeling Approach for Motion Detection in Dynamic Backgrounds , 2012, MMSP 2012.

[31]  James F. Hubbert.  The real time system , 1972, DATB.

[32]  Lucia Maddalena,et al.  A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection , 2010, Neural Computing and Applications.

[33]  Terrance E. Boult,et al.  Frame-rate omnidirectional surveillance and tracking of camouflaged and occluded targets , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[34]  Quming Zhou,et al.  Tracking and Classifying Moving Objects from Video , 2001 .

[35]  Z. Zivkovic.  Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[36]  Sudipta Mukhopadhyay,et al.  Removal of Fog from Images: A Review , 2012 .

[37]  Hélène Laurent,et al.  Comparative study of background subtraction algorithms , 2010, J. Electronic Imaging.

[38]  O. Silven,et al.  A real-time system for monitoring of cyclists and pedestrians , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[39]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[40]  Bohyung Han,et al.  SEQUENTIAL KERNEL DENSITY APPROXIMATION THROUGH MODE PROPAGATION: APPLICATIONS TO BACKGROUND MODELING , 2004 .

[41]  Tiejun Huang,et al.  Selective Eigenbackground for Background Modeling and Subtraction in Crowded Scenes , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  James Orwell,et al.  Adaptive eigen-backgrounds for object detection , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[43]  Nikos Paragios,et al.  Motion-based background subtraction using adaptive kernel density estimation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[44]  Ioannis Pavlidis,et al.  Urban surveillance systems: from the laboratory to the commercial world , 2001, Proc. IEEE.

[45]  Janne Heikkilä,et al.  A real-time system for monitoring of cyclists and pedestrians , 2004, Image Vis. Comput..

[46]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[47]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Amit Sethi,et al.  An Efficient Neural Network Based Background Subtraction Method , 2012, BIC-TA.

[50]  Yu Chen,et al.  Fast Robust Eigen-Background Updating for Foreground Detection , 2006, 2006 International Conference on Image Processing.