Efficient local monitoring approach for the task of background subtraction

Abstract We present in this paper a novel and efficient method that will significantly reduce GMM drawbacks in the presence of complex and dynamic scene. The main idea is to combine global and local features to remove local variations and the instant variations in the brightness that, in most cases, decrease the performance of background subtraction models. The first step is to divide the extracted frames into several equal size blocks. Then, we apply an adaptive local monitoring algorithm for each block to control local variation using Pearson similarity measurement. When a significant environment changes are detected in one or more blocks, the parameters of GMM assigned to these blocks are updated and the parameters of the rest remain the same. We also proposed merging adjacent and invariant blocks to reduce processing time and splitting the blocks that have an intense movement to improve accuracy. Experimental results on several datasets demonstrate that the proposed approach is effective and efficient under the common problems found in background modeling, outperforming the most referred state-of-the-art background subtraction methods.

[1]  Thierry Bouwmans,et al.  Fuzzy statistical modeling of dynamic backgrounds for moving object detection in infrared videos , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[2]  Yujie Liu,et al.  Efficient Foreground Layer Extraction in Video , 2010, PCM.

[3]  Zhiming Luo,et al.  Interactive deep learning method for segmenting moving objects , 2017, Pattern Recognit. Lett..

[4]  Bertrand Vachon,et al.  Statistical Background Modeling for Foreground Detection: A Survey , 2010 .

[5]  David Suter,et al.  A re-evaluation of mixture of Gaussian background modeling [video signal processing applications] , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[6]  Vittorio Murino,et al.  Background Subtraction with Adaptive Spatio-Temporal Neighborhood Analysis , 2008, VISAPP.

[7]  Xiaojun Jing,et al.  FPGA based mixture Gaussian background modeling and motion detection , 2011, 2011 Seventh International Conference on Natural Computation.

[8]  Zun-bing Sheng,et al.  An adaptive learning rate GMM for background extraction , 2008 .

[9]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[10]  Kang Hyun,et al.  Foreground object detection in projection display , 2004 .

[11]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Mubarak Shah,et al.  Automatically Tuning Background Subtraction Parameters using Particle Swarm Optimization , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[13]  Yanjiang Wang,et al.  An improved adaptive background modeling algorithm based on Gaussian Mixture Model , 2008, 2008 9th International Conference on Signal Processing.

[14]  Mario Ignacio Chacon Murguia,et al.  Auto-Adaptive Parallel SOM Architecture with a modular analysis for dynamic object segmentation in videos , 2016, Neurocomputing.

[15]  Vittorio Murino,et al.  A spatial sampling mechanism for effective background subtraction , 2007, VISAPP.

[16]  Nurul Arif Setiawan,et al.  Gaussian Mixture Model in Improved HLS Color Space for Human Silhouette Extraction , 2006, ICAT.

[17]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[18]  Jan-Olof Eklundh,et al.  Statistical background subtraction for a mobile observer , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  D. Scott Wills,et al.  Parallelizing Multimodal Background Modeling on a Low-Power Integrated GPU , 2017, J. Signal Process. Syst..

[20]  Jörg Stückler,et al.  Efficient Dense 3D Rigid-Body Motion Segmentation in RGB-D Video , 2013, BMVC.

[21]  J. Rodgers,et al.  Thirteen ways to look at the correlation coefficient , 1988 .

[22]  P. Wayne Power,et al.  Understanding Background Mixture Models for Foreground Segmentation , 2002 .

[23]  Hong Zhang,et al.  Sparse Learning for Robust Background Subtraction of Video Sequences , 2015, ICIC.

[24]  Wilfried Philips,et al.  C-EFIC: Color and Edge Based Foreground Background Segmentation with Interior Classification , 2015, VISIGRAPP.

[25]  Xiaoqin Zhang,et al.  Robust foreground segmentation based on two effective background models , 2008, MIR '08.

[26]  Thierry Bouwmans,et al.  Recent Advanced Statistical Background Modeling for Foreground Detection - A Systematic Survey , 2011 .

[27]  Zhenjiang Miao,et al.  Fast Background Subtraction Using Improved GMM and Graph Cut , 2008, 2008 Congress on Image and Signal Processing.

[28]  Reinhard Klette,et al.  Evaluation of an Adaptive Composite Gaussian Model in Video Surveillance , 2003, CAIP.

[29]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[30]  Du-Ming Tsai,et al.  Independent Component Analysis-Based Background Subtraction for Indoor Surveillance , 2009, IEEE Transactions on Image Processing.

[31]  Herman Akdag,et al.  Improved gaussian mixture model with background spotter for the extraction of moving objects , 2016, Int. Arab J. Inf. Technol..

[32]  Aini Hussain,et al.  Real-time background subtraction for video surveillance: From research to reality , 2010, 2010 6th International Colloquium on Signal Processing & its Applications.

[33]  Atta Badii,et al.  Change detection based on graph cuts , 2015, 2015 International Conference on Systems, Signals and Image Processing (IWSSIP).

[34]  Herman Akdag,et al.  Improved Parameters Updating Algorithm for the Detection of Moving Objects , 2015, CIIA.

[35]  Maodi Hu,et al.  Adaptive Background Modelling for Image Sequences with Cluttered Background , 2014, 2014 Sixth International Conference on Intelligent Human-Machine Systems and Cybernetics.

[36]  Olga Sorkine-Hornung,et al.  Efficient Salient Foreground Detection for Images and Video using Fiedler Vectors , 2015, WICED@Eurographics.

[37]  Stuart J. Russell,et al.  Image Segmentation in Video Sequences: A Probabilistic Approach , 1997, UAI.

[38]  Fatih Murat Porikli,et al.  CDnet 2014: An Expanded Change Detection Benchmark Dataset , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[39]  K. Pearson Contributions to the Mathematical Theory of Evolution , 1894 .

[40]  Shyjan Mahamud,et al.  Comparing Belief Propagation and Graph Cuts for Novelty Detection , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[41]  Thierry Bouwmans,et al.  Background Subtraction for Visual Surveillance , 2012, Handbook of Soft Computing for Video Surveillance.

[42]  Nuno Vasconcelos,et al.  Spatiotemporal Saliency in Dynamic Scenes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Hasan Sajid,et al.  Background subtraction for static & moving camera , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[44]  Danilo Alves de Lima,et al.  Image processing using Pearson's correlation coefficient: Applications on autonomous robotics , 2013, 2013 13th International Conference on Autonomous Robot Systems.

[45]  Baozong Yuan,et al.  Better Foreground Segmentation for Static Cameras via New Energy Form and Dynamic Graph-cut , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[46]  Manuele Bicego,et al.  Integrated region- and pixel-based approach to background modelling , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[47]  Jiangming Kan,et al.  Background modeling method based on improved multi-Gaussian distribution , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[48]  H. Zhou,et al.  Dynamic foreground detection based on improved Codebook model , 2016 .

[49]  Nikolaos F. Matsatsinis,et al.  Self Adaptive background modeling for identifying persons' falls , 2010, 2010 Fifth International Workshop Semantic Media Adaptation and Personalization.

[50]  Li Sun,et al.  Background modeling and its evaluation for complex scenes , 2013, Multimedia Tools and Applications.

[51]  Rui Caseiro,et al.  Foreground Segmentation via Background Modeling on Riemannian Manifolds , 2010, 2010 20th International Conference on Pattern Recognition.

[52]  Feng Qian,et al.  Object kinematic model: A novel approach of adaptive background mixture models for video segmentation , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[53]  T. Charoenpong,et al.  Adaptive background modeling from an image sequence by using K-Means clustering , 2010, ECTI-CON2010: The 2010 ECTI International Confernce on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[54]  S. Bianco,et al.  How Far Can You Get By Combining Change Detection Algorithms? , 2015, ICIAP.

[55]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[56]  Manabu Hashimoto,et al.  Object Modeling Using Gaussian Mixture Model for Infrared Image and its Application to Vehicle Detection , 2006, J. Robotics Mechatronics.

[57]  Konrad Schindler,et al.  Smooth Foreground-Background Segmentation for Video Processing , 2006, ACCV.

[58]  Herman Akdag,et al.  A New Approach for the Extraction of Moving Objects , 2013, Modeling Approaches and Algorithms for Advanced Computer Applications.

[59]  Serhat Selcuk Bucak,et al.  Incremental Non-negative Matrix Factorization for Dynamic Background Modelling , 2007, PRIS.

[60]  Shanq-Jang Ruan,et al.  Illumination-Sensitive Background Modeling Approach for Accurate Moving Object Detection , 2011, IEEE Transactions on Broadcasting.

[61]  F. D. Garber,et al.  The Quality of Training Sample Estimates of the Bhattacharyya Coefficient , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  Wangtu Xu,et al.  Real-Time Pedestrian Detection Based on Improved Gaussian Mixture Model , 2009, 2009 International Conference on Measuring Technology and Mechatronics Automation.

[63]  Lijing Zhang,et al.  Motion Human Detection Based on Background Subtraction , 2010, 2010 Second International Workshop on Education Technology and Computer Science.

[64]  Lu Yang,et al.  Pixel-to-Model background modeling in crowded scenes , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[65]  Haiying Xia,et al.  A modified Gaussian mixture background model via spatiotemporal distribution with shadow detection , 2016, Signal Image Video Process..

[66]  Winston H. Hsu,et al.  Foreground segmentation for static video via multi-core and multi-modal graph cut , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[67]  Krishnan Kutty,et al.  Background Modelling from a Moving Camera , 2015 .

[68]  Yifan Yu,et al.  Real-time Background Subtraction in C++ , 2010 .