Simultaneous denoising and moving object detection using low rank approximation

Abstract Moving Object Detection (MOD) and Background Subtraction (BS) are the fundamental tasks in video surveillance systems. But, one of the major challenges which badly affects the accuracy of detection is the presence of noise in the captured video sequence. In this work, we propose a new moving object detection method from noisy video data named as De-Noising and moving object detection by Low Rank approximation and l 1 - T V regularization ( D N L R l 1 T V ). In general, background of videos are assumed to lie in a low-rank subspace and moving objects are assumed to be piecewise smooth in the spatial and temporal direction. The proposed method consolidates the nuclear norm, l 2 -norm, l 1 -norm and Total Variation (TV) regularization in a unified framework to obtain simultaneous denoising and MOD performance. The nuclear norm exploits the low-rank property of the background, the sparsity is enhanced by the l 1 -norm, T V regularization is used to explore the foreground spatial smoothness and noise is detected and removed by the l 2 -norm regularization. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art approaches in terms of denoising capability and detection accuracy.

[1]  Shih-Chia Huang,et al.  A Hybrid Background Subtraction Method with Background and Foreground Candidates Detection , 2015, ACM Trans. Intell. Syst. Technol..

[2]  Shih-Chia Huang,et al.  Radial Basis Function Based Neural Network for Motion Detection in Dynamic Scenes , 2014, IEEE Transactions on Cybernetics.

[3]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[4]  Thierry Bouwmans,et al.  Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance , 2014, Comput. Vis. Image Underst..

[5]  Lin Zhu,et al.  ${L_{1/2}}$ Norm and Spatial Continuity Regularized Low-Rank Approximation for Moving Object Detection in Dynamic Background , 2018, IEEE Signal Processing Letters.

[6]  A. Chambolle,et al.  An introduction to Total Variation for Image Analysis , 2009 .

[7]  Yuan Xie,et al.  Hyperspectral Image Restoration via Iteratively Regularized Weighted Schatten $p$-Norm Minimization , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  El-hadi Zahzah,et al.  Handbook of Robust Low-Rank and Sparse Matrix Decomposition: Applications in Image and Video Processing , 2016 .

[9]  Minho Lee,et al.  A Genetic Algorithm-Based Moving Object Detection for Real-time Traffic Surveillance , 2015, IEEE Signal Processing Letters.

[10]  Guoying Zhao,et al.  Background Subtraction Based on Low-Rank and Structured Sparse Decomposition , 2015, IEEE Transactions on Image Processing.

[11]  Sukadev Meher,et al.  Detection of Moving Objects Using Fuzzy Color Difference Histogram Based Background Subtraction , 2016, IEEE Signal Processing Letters.

[12]  Gholam Ali Montazer,et al.  Atanassov's intuitionistic fuzzy histon for robust moving object detection , 2017, Int. J. Approx. Reason..

[13]  Soon Ki Jung,et al.  Background–Foreground Modeling Based on Spatiotemporal Sparse Subspace Clustering , 2017, IEEE Transactions on Image Processing.

[14]  Yuan Xie,et al.  Moving Object Detection Using Tensor-Based Low-Rank and Saliently Fused-Sparse Decomposition , 2017, IEEE Transactions on Image Processing.

[15]  Somnath Sengupta,et al.  Detection of Moving Objects Using Multi-channel Kernel Fuzzy Correlogram Based Background Subtraction , 2014, IEEE Transactions on Cybernetics.

[16]  Yong Chen,et al.  Stripe noise removal of remote sensing images by total variation regularization and group sparsity constraint , 2017, Remote. Sens..

[17]  Hasup Lee,et al.  Background Subtraction Using Background Sets With Image- and Color-Space Reduction , 2016, IEEE Transactions on Multimedia.

[18]  Soon Ki Jung,et al.  Decomposition into Low-rank plus Additive Matrices for Background/Foreground Separation: A Review for a Comparative Evaluation with a Large-Scale Dataset , 2015, Comput. Sci. Rev..

[19]  Chuan Chen,et al.  Total variation based tensor decomposition for multi‐dimensional data with time dimension , 2015, Numer. Linear Algebra Appl..

[20]  Alex Pappachen James,et al.  Bit-Plane Extracted Moving-Object Detection Using Memristive Crossbar-CAM Arrays for Edge Computing Image Devices , 2018, IEEE Access.

[21]  W. Shao,et al.  A Generalized Robust Minimization Framework for Low-Rank Matrix Recovery , 2014 .

[22]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Ben Taskar,et al.  Application of trace-norm and low-rank matrix decomposition for computational anatomy , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[24]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[26]  Brendt Wohlberg,et al.  Incremental Principal Component Pursuit for Video Background Modeling , 2015, Journal of Mathematical Imaging and Vision.

[27]  Soon Ki Jung,et al.  Moving Object Detection on RGB-D Videos Using Graph Regularized Spatiotemporal RPCA , 2017, ICIAP Workshops.

[28]  Michael K. Ng,et al.  Median filtering‐based methods for static background extraction from surveillance video , 2015, Numer. Linear Algebra Appl..

[29]  Shih-Chia Huang,et al.  Highly Accurate Moving Object Detection in Variable Bit Rate Video-Based Traffic Monitoring Systems , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Chih-Yang Lin,et al.  Three-Pronged Compensation and Hysteresis Thresholding for Moving Object Detection in Real-Time Video Surveillance , 2017, IEEE Transactions on Industrial Electronics.

[31]  Yun Fu,et al.  Learning Robust and Discriminative Subspace With Low-Rank Constraints , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Sudhish N. George,et al.  Ultrasound image despeckling using low rank matrix approximation approach , 2017, Biomed. Signal Process. Control..

[33]  J. Lei Data Driven Based Method for Field Information Sensing , 2014 .

[34]  Shih-Chia Huang,et al.  An Advanced Motion Detection Algorithm With Video Quality Analysis for Video Surveillance Systems , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Sudhish N. George,et al.  Twist tensor total variation regularized-reweighted nuclear norm based tensor completion for video missing area recovery , 2018, Inf. Sci..

[36]  Shih-Chia Huang,et al.  Automatic Moving Object Extraction Through a Real-World Variable-Bandwidth Network for Traffic Monitoring Systems , 2014, IEEE Transactions on Industrial Electronics.

[37]  Yi Ma,et al.  Unwrapping low-rank textures on generalized cylindrical surfaces , 2011, 2011 International Conference on Computer Vision.

[38]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[39]  Liangpei Zhang,et al.  Total-Variation-Regularized Low-Rank Matrix Factorization for Hyperspectral Image Restoration , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Andrzej Cichocki,et al.  Total Variation Regularized Tensor RPCA for Background Subtraction From Compressive Measurements , 2015, IEEE Transactions on Image Processing.

[41]  Xiaochun Cao,et al.  Total Variation Regularized RPCA for Irregularly Moving Object Detection Under Dynamic Background , 2016, IEEE Transactions on Cybernetics.

[42]  Thierry Chateau,et al.  A Benchmark Dataset for Outdoor Foreground/Background Extraction , 2012, ACCV Workshops.

[43]  Cheng Jiang,et al.  Hyperspectral Image Denoising with a Combined Spatial and Spectral Weighted Hyperspectral Total Variation Model , 2016 .

[44]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[45]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[46]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[47]  Martin Kleinsteuber,et al.  pROST: a smoothed $$\ell _p$$ℓp-norm robust online subspace tracking method for background subtraction in video , 2013, Machine Vision and Applications.

[48]  Karen S. Braman Third-Order Tensors as Linear Operators on a Space of Matrices , 2010 .