Compressed-Sensed-Domain L1-PCA Video Surveillance

We consider the problem of foreground and background extraction from compressed-sensed (CS) surveillance videos that are captured by a static CS camera. We propose, for the first time in the literature, a principal component analysis (PCA) approach that computes directly in the CS domain the low-rank subspace of the background scene. Rather than computing the conventional L2-norm-based principal components, which are simply the dominant left singular vectors of the CS-domain data matrix, we compute the principal components under an L1-norm maximization criterion. The background scene is then obtained by projecting the CS measurement vector onto the L1 principal components followed by total-variation (TV) minimization image recovery. The proposed L1-norm procedure directly carries out low-rank background representation without reconstructing the video sequence and, at the same time, exhibits significant robustness against outliers in CS measurements compared to L2-norm PCA. An adaptive CS- L1-PCA method is also developed for low-latency video surveillance. Extensive experimental studies described in this paper illustrate and support the theoretical developments.

[1]  Hong Jiang,et al.  Surveillance Video Processing Using Compressive Sensing , 2012, ArXiv.

[2]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[3]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[4]  Shih-Chia Huang,et al.  Radial Basis Function Based Neural Network for Motion Detection in Dynamic Scenes , 2014, IEEE Transactions on Cybernetics.

[5]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[6]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[7]  Manoranjan Paul,et al.  Improved Gaussian mixtures for robust object detection by adaptive multi-background generation , 2008, 2008 19th International Conference on Pattern Recognition.

[8]  Zheng Yi,et al.  Moving object detection based on running average background and temporal difference , 2010, 2010 IEEE International Conference on Intelligent Systems and Knowledge Engineering.

[9]  Massimo Piccardi,et al.  Mean-shift background image modelling , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[10]  Shiqian Ma,et al.  An efficient algorithm for compressed MR imaging using total variation and wavelets , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Dimitris A. Pados,et al.  New Bounds and Optimal Binary Signature Sets - Part II: Aperiodic Total Squared Correlation , 2011, IEEE Transactions on Communications.

[12]  Nojun Kwak,et al.  Principal Component Analysis Based on L1-Norm Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Dimitris A. Pados,et al.  Decoding of framewise compressed-sensed video via interframe total variation minimization , 2013, J. Electronic Imaging.

[14]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Dimitris A. Pados,et al.  New Bounds and Optimal Binary Signature Sets - Part I: Periodic Total Squared Correlation , 2011, IEEE Trans. Commun..

[16]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[17]  Quming Zhou,et al.  Tracking and Classifying Moving Objects from Video , 2001 .

[18]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[19]  V. Khanaa,et al.  An Advanced Moving Object Detection Algorithm for Automatic Traffic Monitoring In Real-World Limited Bandwidth Networks , 2015 .

[20]  Chengbo Li An efficient algorithm for total variation regularization with applications to the single pixel camera and compressive sensing , 2010 .

[21]  Seong-Dae Kim,et al.  Recursive On-Line ${(2{\rm D})}^2{\rm PCA}$ and Its Application to Long-Term Background Subtraction , 2014, IEEE Transactions on Multimedia.

[22]  Panos P. Markopoulos,et al.  Fast computation of the L1-principal component of real-valued data , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Bruce W. Suter,et al.  Compressive Sampling With Generalized Polygons , 2011, IEEE Transactions on Signal Processing.

[24]  Feiping Nie,et al.  Robust Principal Component Analysis with Non-Greedy l1-Norm Maximization , 2011, IJCAI.

[25]  Panos P. Markopoulos,et al.  Optimal Algorithms for L1-subspace Signal Processing , 2014, IEEE Transactions on Signal Processing.

[26]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  E. Candes,et al.  11-magic : Recovery of sparse signals via convex programming , 2005 .

[29]  Chih-Hsien Hsia,et al.  Fast Background Subtraction Based on a Multilayer Codebook Model for Moving Object Detection , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Bohyung Han,et al.  SEQUENTIAL KERNEL DENSITY APPROXIMATION THROUGH MODE PROPAGATION: APPLICATIONS TO BACKGROUND MODELING , 2004 .

[31]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[32]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[33]  Shahram Shirani,et al.  Compressive sensing with modified Total Variation minimization algorithm , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[34]  T. Kanade,et al.  Robust subspace computation using L1 norm , 2003 .

[35]  Anders P. Eriksson,et al.  Efficient computation of robust low-rank matrix approximations in the presence of missing data using the L1 norm , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[37]  Shih-Chia Huang,et al.  An Advanced Motion Detection Algorithm With Video Quality Analysis for Video Surveillance Systems , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Dimitris A. Pados,et al.  Rate-adaptive compressive video acquisition with sliding-window total-variation-minimization reconstruction , 2013, Defense, Security, and Sensing.

[39]  M. Neifeld,et al.  Block-wise motion detection using compressive imaging system , 2011 .

[40]  Shih-Chia Huang,et al.  Highly Accurate Moving Object Detection in Variable Bit Rate Video-Based Traffic Monitoring Systems , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[41]  Wen Gao,et al.  Nonparametric Background Generation , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[42]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[43]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[44]  Takeo Kanade,et al.  Robust L/sub 1/ norm factorization in the presence of outliers and missing data by alternative convex programming , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[45]  Shih-Chia Huang,et al.  Automatic Moving Object Extraction Through a Real-World Variable-Bandwidth Network for Traffic Monitoring Systems , 2014, IEEE Transactions on Industrial Electronics.

[46]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[47]  Tommaso Melodia,et al.  Compressive Video Streaming: Design and Rate-Energy-Distortion Analysis , 2013, IEEE Transactions on Multimedia.

[48]  Chris H. Q. Ding,et al.  An efficient algorithm for L1-norm principal component analysis , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[49]  John Shawe-Taylor,et al.  MahNMF: Manhattan Non-negative Matrix Factorization , 2012, ArXiv.

[50]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.