Real-time record sensitive background classifier (RSBC)

Abstract In computer vision, one of the ways to identify moving objects or foregrounds from a complex video scene is background subtraction. Two problems that usually arise in background subtraction are that of dynamic background and ghost effect. In this article, an efficient, adaptive, real-time, novel background subtraction method is proposed to handle these two problems by utilizing the classification history of previous frames to detect changes in a video scene. The proposed method, coined as Record Sensitive Background Classifier (RSBC) is an amalgamation of two models, the Adaptive Background Model (ABM) and the Neighbourhood Background Model (NBM), which make use of the foreground and background classification information of the previous frames. The novel design of the ABM considers the temporal history of transitions between foreground and background of a given pixel, while the novelty in NBM lies in considering the binary classification results of the local neighbourhood in the preceding frame. Several state-of-the-art methods are compared with the proposed RSBC method, over which the proposed method shows significant improvement. Because of its good performance at fast processing speeds the proposed method can also be used as a preliminary prioritization step for slower but high accuracy methods in an object tracking system.

[1]  Steven L. Brunton,et al.  Dynamic Mode Decomposition for Robust PCA with Applications to Foreground/Background Subtraction in Video Streams and Multi-Resolution Analysis , 2016 .

[2]  Hongyu Zhao,et al.  Low-Rank Modeling and Its Applications in Image Analysis , 2014, ACM Comput. Surv..

[3]  Wen Hu,et al.  Real-Time and Robust Compressive Background Subtraction for Embedded Camera Networks , 2016, IEEE Transactions on Mobile Computing.

[4]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[5]  Yung-Nien Sun,et al.  Weather-adaptive flying target detection and tracking from infrared video sequences , 2010, Expert Syst. Appl..

[6]  Thierry Bouwmans,et al.  Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance , 2014, Comput. Vis. Image Underst..

[7]  Ashish Ghosh,et al.  Real-Time Adaptive Histogram Min-Max Bucket (HMMB) Model for Background Subtraction , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Sukadev Meher,et al.  Detection of Moving Objects Using Fuzzy Color Difference Histogram Based Background Subtraction , 2016, IEEE Signal Processing Letters.

[9]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[10]  El-hadi Zahzah,et al.  Dynamic Mode Decomposition for Robust PCA with Applications to Foreground/Background Subtraction in Video Streams and Multi-Resolution Analysis , 2016 .

[11]  Chris T. Kiranoudis,et al.  A background subtraction algorithm for detecting and tracking vehicles , 2011, Expert Syst. Appl..

[12]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Diego Ortego,et al.  Hierarchical Improvement of Foreground Segmentation Masks in Background Subtraction , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..

[15]  Thierry Chateau,et al.  Vehicle trajectories evaluation by static video sensors , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[16]  Andrzej Czyzewski,et al.  Parallel implementation of background subtraction algorithms for real-time video processing on a supercomputer platform , 2012, Journal of Real-Time Image Processing.

[17]  Marc Van Droogenbroeck,et al.  Background subtraction: Experiments and improvements for ViBe , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[18]  Benjamin Höferlin,et al.  Evaluation of background subtraction techniques for video surveillance , 2011, CVPR 2011.

[19]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[21]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[22]  Yi-Ping Hung,et al.  Efficient hierarchical method for background subtraction , 2007, Pattern Recognit..

[23]  Haixia Wang,et al.  Foreground model for background subtraction with blind updating , 2016, 2016 IEEE International Conference on Signal and Image Processing (ICSIP).

[24]  Hanqing Lu,et al.  Learning sharable models for robust background subtraction , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[25]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[26]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[27]  Francesc Serratosa,et al.  A probabilistic integrated object recognition and tracking framework , 2009, Expert Syst. Appl..

[28]  Guillaume-Alexandre Bilodeau,et al.  SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity , 2015, IEEE Transactions on Image Processing.

[29]  Thierry Bouwmans,et al.  A Fuzzy Background Modeling Approach for Motion Detection in Dynamic Backgrounds , 2012, MMSP 2012.

[30]  Tiziana D'Orazio,et al.  Moving object segmentation by background subtraction and temporal analysis , 2006, Image Vis. Comput..

[31]  Guillaume-Alexandre Bilodeau,et al.  Improving background subtraction using Local Binary Similarity Patterns , 2014, IEEE Winter Conference on Applications of Computer Vision.

[32]  Yong Zhao,et al.  An Adaptive Background Modeling Method for Foreground Segmentation , 2017, IEEE Transactions on Intelligent Transportation Systems.

[33]  Charles Guyon,et al.  Robust Principal Component Analysis for Background Subtraction: Systematic Evaluation and Comparative Analysis , 2012 .

[34]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[35]  El-hadi Zahzah,et al.  LRSLibrary: Low-Rank and Sparse tools for Background Modeling and Subtraction in Videos , 2016 .

[36]  Ramesh Rajagopalan,et al.  A Genetic Algorithm for Optimizing Background Subtraction Parameters in Computer Vision , 2014 .

[37]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[38]  Marc Van Droogenbroeck,et al.  Deep background subtraction with scene-specific convolutional neural networks , 2016, 2016 International Conference on Systems, Signals and Image Processing (IWSSIP).

[39]  Nikos Paragios,et al.  Background modeling and subtraction of dynamic scenes , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[40]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[41]  Fatih Murat Porikli,et al.  A Bayesian Approach to Background Modeling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[42]  James W. Davis,et al.  Background-subtraction using contour-based fusion of thermal and visible imagery , 2007, Comput. Vis. Image Underst..

[43]  Serdar Korukoglu,et al.  Moving object detection and tracking by using annealed background subtraction method in videos: Performance optimization , 2012, Expert Syst. Appl..

[44]  Jae Wook Jeon,et al.  Change Detection by Training a Triplet Network for Motion Feature Extraction , 2019, IEEE Transactions on Circuits and Systems for Video Technology.