Adaptive pixel-block based background subtraction using low-rank and block-sparse matrix decomposition

We present three stages of a novel backgrounds subtraction method in this paper: a new pixel-block based randomized arrangement is utilized to preprocess all the frame images, so that low-rank property of background and sparsity of foreground can be separated more easily; different foreground regions have different sparsity, we use a set of adaptive parameters for subtracting foregrounds according to the variances of frame pixels; finally, background model is built via an improved low-rank and block-sparse matrix decomposition based on the proposed adaptive pixel-block background subtraction. All these key measurements guarantee the considerable performance in background subtraction, which are also demonstrated in our experimental results.

[1]  Chih-Hsien Hsia,et al.  Fast Background Subtraction Based on a Multilayer Codebook Model for Moving Object Detection , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[3]  Samy Bengio,et al.  Group Sparse Coding , 2009, NIPS.

[4]  Xiaochun Cao,et al.  Motion saliency detection using low-rank and sparse decomposition , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Brian C. Lovell,et al.  Improved Foreground Detection via Block-Based Classifier Cascade With Probabilistic Decision Integration , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Li Sun,et al.  Background modeling and its evaluation for complex scenes , 2013, Multimedia Tools and Applications.

[7]  J.-C. Pesquet,et al.  A Douglas–Rachford Splitting Approach to Nonsmooth Convex Variational Signal Recovery , 2007, IEEE Journal of Selected Topics in Signal Processing.

[8]  Yin Zhang,et al.  Fixed-Point Continuation for l1-Minimization: Methodology and Convergence , 2008, SIAM J. Optim..

[9]  Qingshan Liu,et al.  Temporal spectral residual: fast motion saliency detection , 2009, ACM Multimedia.

[10]  El-hadi Zahzah,et al.  Robust Principal Component Analysis Based on Low-Rank and Block-Sparse Matrix Decomposition , 2016 .

[11]  Rama Chellappa,et al.  Learning Common and Feature-Specific Patterns: A Novel Multiple-Sparse-Representation-Based Tracker , 2018, IEEE Transactions on Image Processing.

[12]  Marc Van Droogenbroeck,et al.  ViBE: A powerful random technique to estimate the background in video sequences , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Hejun Wu,et al.  Weighted Low-Rank Decomposition for Robust Grayscale-Thermal Foreground Detection , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[15]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[16]  Sedi-Sap CEA-Saclay.  MONOTONE OPERATOR SPLITTING FOR OPTIMIZATION PROBLEMS IN SPARSE RECOVERY , 2009 .

[17]  Loong Fah Cheong,et al.  Block-Sparse RPCA for Salient Motion Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Xiaoming Yuan,et al.  Sparse and low-rank matrix decomposition via alternating direction method , 2013 .

[19]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[20]  Oihana Otaegui,et al.  Adaptive Multicue Background Subtraction for Robust Vehicle Counting and Classification , 2012, IEEE Transactions on Intelligent Transportation Systems.

[21]  Shengping Zhang,et al.  Modality-correlation-aware sparse representation for RGB-infrared object tracking , 2020, Pattern Recognit. Lett..

[22]  Xin Liu,et al.  Background subtraction based on low-rank and structured sparse decomposition. , 2015, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[23]  Tao Xiang,et al.  Background Subtraction with DirichletProcess Mixture Models , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Thierry Bouwmans,et al.  Foreground Detection via Robust Low Rank Matrix Decomposition Including Spatio-Temporal Constraint , 2012, ACCV Workshops.

[25]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[26]  Jingdong Wang,et al.  A Probabilistic Approach to Robust Matrix Factorization , 2012, ECCV.

[27]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[28]  Rama Chellappa,et al.  Robust MIL-Based Feature Template Learning for Object Tracking , 2017, AAAI.

[29]  Constantine Caramanis,et al.  Fast Algorithms for Robust PCA via Gradient Descent , 2016, NIPS.

[30]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[31]  Kun Zhang,et al.  Real-Time Feature-Based Video Stabilization on FPGA , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Sambit Bakshi,et al.  Improved pedestrian detection using motion segmentation and silhouette orientation , 2017, Multimedia Tools and Applications.

[33]  Li Liu,et al.  Recognizing Complex Activities by a Probabilistic Interval-Based Model , 2016, AAAI.

[34]  Mohamed-Jalal Fadili,et al.  Inpainting and Zooming Using Sparse Representations , 2009, Comput. J..

[35]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[36]  Shengping Zhang,et al.  Robust Collaborative Discriminative Learning for RGB-Infrared Tracking , 2018, AAAI.

[37]  Chun-Rong Huang,et al.  Binary Descriptor Based Nonparametric Background Modeling for Foreground Extraction by Using Detection Theory , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Shengping Zhang,et al.  Robust Joint Discriminative Feature Learning for Visual Tracking , 2016, IJCAI.

[39]  Pong C. Yuen,et al.  Multi-cue Visual Tracking Using Robust Feature-Level Fusion Based on Joint Sparse Representation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Dacheng Tao,et al.  Shifted Subspaces Tracking on Sparse Outlier for Motion Segmentation , 2013, IJCAI.

[41]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Thierry Bouwmans,et al.  Foreground detection via robust low rank matrix factorization including spatial constraint with Iterative reweighted regression , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[43]  Thierry Chateau,et al.  A Benchmark Dataset for Outdoor Foreground/Background Extraction , 2012, ACCV Workshops.

[44]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[45]  Brendt Wohlberg,et al.  Fast principal component pursuit via alternating minimization , 2013, 2013 IEEE International Conference on Image Processing.

[46]  Rubén Heras Evangelio,et al.  Splitting Gaussians in Mixture Models , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[47]  Dariu Gavrila,et al.  Multi-cue Pedestrian Detection and Tracking from a Moving Vehicle , 2007, International Journal of Computer Vision.

[48]  Thierry Bouwmans,et al.  Moving Object Detection via Robust Low Rank Matrix Decomposition with IRLS Scheme , 2012, ISVC.

[49]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[50]  Du-Ming Tsai,et al.  Independent Component Analysis-Based Background Subtraction for Indoor Surveillance , 2009, IEEE Transactions on Image Processing.

[51]  Jinwoo Park,et al.  Vision-based surveillance system for monitoring traffic conditions , 2017, Multimedia Tools and Applications.

[52]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[53]  Marc Van Droogenbroeck,et al.  Background subtraction: Experiments and improvements for ViBe , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[54]  Benjamin Höferlin,et al.  Evaluation of background subtraction techniques for video surveillance , 2011, CVPR 2011.

[55]  Xiaodong Li,et al.  Dense error correction for low-rank matrices via Principal Component Pursuit , 2010, 2010 IEEE International Symposium on Information Theory.

[56]  I. Haritaoglu,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002 .

[57]  Bohyung Han,et al.  Density-Based Multifeature Background Subtraction with Support Vector Machine , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[59]  Aaron F. Bobick,et al.  Fast Lighting Independent Background Subtraction , 2004, International Journal of Computer Vision.

[60]  Rama Chellappa,et al.  Joint Sparse Representation and Robust Feature-Level Fusion for Multi-Cue Visual Tracking , 2015, IEEE Transactions on Image Processing.

[61]  Narendra Ahuja,et al.  Robust Orthonormal Subspace Learning: Efficient Recovery of Corrupted Low-Rank Matrices , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[62]  Dariu Gavrila,et al.  Pedestrian Detection from a Moving Vehicle , 2000, ECCV.