Local Compact Binary Count Based Nonparametric Background Modeling for Foreground Detection in Dynamic Scenes

Background subtraction is one of the most fundamental and challenging tasks in computer vision. Many background subtraction algorithms work well under the assumption that the backgrounds are static over short time periods but degrade dramatically in dynamic scenes, such as swaying trees, rippling water, and waving curtains. In this paper, we propose an effective background subtraction method to address these difficulties by combining color features with texture features in the ViBe framework. Specifically, we present a novel local compact binary count (LCBC) feature that can capture local binary gray-scale difference information and totally discard the local binary structural information. The effective fusion of color and LCBC information significantly improves the performance of the ViBe model, making it very robust to background variations while still highlighting the moving objects. We further embed the total variation (TV) norm regularization technique into the proposed method, which can enhance the spatial smoothness of foreground objects, thereby further improving the accuracy of the method. We evaluate the proposed method against ten sequences containing dynamic backgrounds and show that our method outperforms many state-of-the-art methods in reducing the false positives without compromising the reasonable foreground definitions. The experimental results on challenging well-known data sets demonstrate that the proposed method works effectively on a wide range of dynamic background scenes.

[1]  Guillaume-Alexandre Bilodeau,et al.  A Self-Adjusting Approach to Change Detection Based on Background Word Consensus , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[2]  G. Sreelekha,et al.  Sample-based integrated background subtraction and shadow detection , 2017, IPSJ Transactions on Computer Vision and Applications.

[3]  Guoying Zhao,et al.  Background Subtraction Based on Low-Rank and Structured Sparse Decomposition , 2015, IEEE Transactions on Image Processing.

[4]  Harish Bhaskar,et al.  On the Role and the Importance of Features for Background Modeling and Foreground Detection , 2016, Comput. Sci. Rev..

[5]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jianhui Wu,et al.  Local Compact Binary Patterns for Background Subtraction in Complex Scenes , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[7]  Qingyang Li,et al.  A Highly Scalable Parallel Algorithm for Isotropic Total Variation Models , 2014, ICML.

[8]  Fatih Murat Porikli,et al.  CDnet 2014: An Expanded Change Detection Benchmark Dataset , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[11]  Sahin Isik,et al.  SWCD: a sliding window and self-regulated learning-based background updating method for change detection in videos , 2018, J. Electronic Imaging.

[12]  J. Zico Kolter,et al.  Certified Adversarial Robustness via Randomized Smoothing , 2019, ICML.

[13]  Nicola Conci,et al.  Structured learning for crowd motion segmentation , 2013, 2013 IEEE International Conference on Image Processing.

[14]  Dan Xu,et al.  Background Subtraction Using Local SVD Binary Pattern , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Thierry Bouwmans,et al.  Superpixel-based online wagging one-class ensemble for feature selection in foreground/background separation , 2017, Pattern Recognit. Lett..

[16]  Miguel A. Molina-Cabello,et al.  Foreground Detection by Competitive Learning for Varying Input Distributions , 2017, Int. J. Neural Syst..

[17]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[18]  Guillaume-Alexandre Bilodeau,et al.  Improving background subtraction using Local Binary Similarity Patterns , 2014, IEEE Winter Conference on Applications of Computer Vision.

[19]  Huiyu Zhou,et al.  Region-based Mixture of Gaussians modelling for foreground detection in dynamic scenes , 2015, Pattern Recognit..

[20]  Sambit Bakshi,et al.  An Evaluation of Background Subtraction for Object Detection Vis-a-Vis Mitigating Challenging Scenarios , 2016, IEEE Access.

[21]  Allen R. Hanson,et al.  Background modeling using adaptive pixelwise kernel variances in a hybrid feature space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Thierry Bouwmans,et al.  Online Weighted One-Class Ensemble for feature selection in background/foreground separation , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[23]  Marc Van Droogenbroeck,et al.  Deep background subtraction with scene-specific convolutional neural networks , 2016, 2016 International Conference on Systems, Signals and Image Processing (IWSSIP).

[24]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[26]  David Suter,et al.  A consensus-based method for tracking: Modelling background scenario and foreground appearance , 2007, Pattern Recognit..

[27]  Lucia Maddalena,et al.  Background Subtraction for Moving Object Detection in RGBD Data: A Survey , 2018, J. Imaging.

[28]  Jean-Marc Odobez,et al.  Multi-Layer Background Subtraction Based on Color and Texture , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[30]  S. Bianco,et al.  How Far Can You Get By Combining Change Detection Algorithms? , 2015, ICIAP.

[31]  Soon Ki Jung,et al.  Unsupervised deep context prediction for background estimation and foreground segmentation , 2018, Machine Vision and Applications.

[32]  Nicu Sebe,et al.  Particles cross-influence for entity grouping , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[33]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.

[34]  Somnath Sengupta,et al.  Detection of Moving Objects Using Multi-channel Kernel Fuzzy Correlogram Based Background Subtraction , 2014, IEEE Transactions on Cybernetics.

[35]  Jiwen Lu,et al.  Learning Compact Binary Face Descriptor for Face Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Marc Van Droogenbroeck,et al.  A Generic Feature Selection Method for Background Subtraction Using Global Foreground Models , 2015, ACIVS.

[37]  Guillaume-Alexandre Bilodeau,et al.  SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity , 2015, IEEE Transactions on Image Processing.

[38]  Guillaume-Alexandre Bilodeau,et al.  Change Detection in Feature Space Using Local Binary Similarity Patterns , 2013, 2013 International Conference on Computer and Robot Vision.

[39]  Sukadev Meher,et al.  Detection of Moving Objects Using Fuzzy Color Difference Histogram Based Background Subtraction , 2016, IEEE Signal Processing Letters.

[40]  Xiaobo Lu,et al.  WeSamBE: A Weight-Sample-Based Method for Background Subtraction , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[42]  Faouzi Alaya Cheikh,et al.  PedNet: A Spatio-Temporal Deep Convolutional Neural Network for Pedestrian Segmentation , 2018, J. Imaging.

[43]  Soon Ki Jung,et al.  Deep Neural Network Concepts for Background Subtraction: A Systematic Review and Comparative Evaluation , 2018, Neural Networks.

[44]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[45]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[46]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[47]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[48]  Soon Ki Jung,et al.  Spatiotemporal Low-Rank Modeling for Complex Scene Background Initialization , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[49]  Mario I. Chacon-Murguia,et al.  Auto-Adaptive Parallel SOM Architecture with a modular analysis for dynamic object segmentation in videos , 2016 .

[50]  Max Lu,et al.  Interactive Motion Analysis for Video Surveillance and Long Term Scene Monitoring , 2010, ACCV Workshops.

[51]  Thierry Bouwmans,et al.  Type-2 Fuzzy Mixture of Gaussians Model: Application to Background Modeling , 2008, ISVC.

[52]  Matti Pietikäinen,et al.  Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[53]  Soon Ki Jung,et al.  Moving Object Detection on RGB-D Videos Using Graph Regularized Spatiotemporal RPCA , 2017, ICIAP Workshops.

[54]  Muhammad Uzair,et al.  A hybrid social influence model for pedestrian motion segmentation , 2018, Neural Computing and Applications.

[55]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[56]  Hongbin Wang,et al.  Regularized online Mixture of Gaussians for background subtraction , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[57]  Thierry Bouwmans,et al.  A Fuzzy Background Modeling Approach for Motion Detection in Dynamic Backgrounds , 2012, MMSP 2012.