Real-time novelty detection in video using background subtraction techniques: State of the art a practical review

Autonomously detecting novelties using background subtraction has quickly become a very important area of image analysis with many different approaches to novelty detection and the output therein. The ultimate goal of the approaches is to be robust to false detections and noise whilst using as little computational power as possible. This review focuses on some of the most prominent pixel-wise background subtraction techniques currently in use, and compares and contrasts their attributes and capabilities. The purpose of this review is to practically summarize the pixel-wise approaches and suggest a way forward from these techniques.

[1]  I. Haritaoglu,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002 .

[2]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[3]  Vittorio Murino,et al.  A spatial sampling mechanism for effective background subtraction , 2007, VISAPP.

[4]  Plamen P. Angelov,et al.  A real-time approach for novelty detection and trajectories analysis for anomaly recognition in video surveillance systems , 2012, 2012 IEEE Conference on Evolving and Adaptive Intelligent Systems.

[5]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Olivier Bernier,et al.  Real Time Illumination Invariant Background Subtraction Using Local Kernel Histograms , 2006, BMVC.

[7]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[8]  Plamen P. Angelov,et al.  An approach to automatic real‐time novelty detection, object identification, and tracking in video streams based on recursive density estimation and evolving Takagi–Sugeno fuzzy systems , 2011, Int. J. Intell. Syst..

[9]  Marc Van Droogenbroeck,et al.  ViBE: A powerful random technique to estimate the background in video sequences , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[11]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[12]  Plamen Angelov,et al.  ARTOD: Autonomous Real Time Objects Detection by a Moving Camera Using Recursive Density Estimation , 2016 .

[13]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  P. Angelov,et al.  A fast approach to novelty detection in video streams using recursive density estimation , 2008, 2008 4th International IEEE Conference Intelligent Systems.

[15]  D. Koller,et al.  Towards robust automatic traffic scene analysis in real-time , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[16]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[17]  Plamen Angelov.  Autonomous Learning Systems:From Data to Knowledge in Real Time , 2012 .