Video Completion and Simultaneous Moving Object Detection for Extreme Surveillance Environments

Since automated cleaning systems are less common in extreme surveillance environments, the accumulations of combustion fuels, dust, dirt, spider webs, etc., affect the visibility and clarity of the captured video data to different degrees resulting in incomplete (missing) video sequences. Grounded on this significant practical scenario, this letter proposes a scheme to concurrently complete the missing entries and detect moving objects with efficient background separation by formulating a single convex optimization problem developed and implemented in the tensor framework. The work is implemented as a unified scheme for concurrent video completion and moving object detection using twist spatio-temporal total variation to enhance the detection performance of the foreground while fitting the tensor nuclear norm minimization for efficient background separation with half thresholding applied on the tensor singular values. Moreover, the sparse variations that are part of the dynamic background are addressed using $l_{1/2}$ regularization. The formulated minimization problem is solved using the augmented Lagrangian method with an alternating direction strategy. The work also has computational benefits and the excellence of this method is revealed in the quantified performance evaluation against the compared approaches.

[1]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[2]  Sudhish N. George,et al.  Simultaneous denoising and moving object detection using low rank approximation , 2019, Future Gener. Comput. Syst..

[3]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[4]  Andrzej Cichocki,et al.  Total Variation Regularized Tensor RPCA for Background Subtraction From Compressive Measurements , 2015, IEEE Transactions on Image Processing.

[5]  Jiarong Shi,et al.  Alternating Direction Method of Multipliers for Generalized Low-Rank Tensor Recovery , 2016, Algorithms.

[6]  Xiaochun Cao,et al.  Total Variation Regularized RPCA for Irregularly Moving Object Detection Under Dynamic Background , 2016, IEEE Transactions on Cybernetics.

[7]  Gang Liu,et al.  Tensor completion using total variation and low-rank matrix factorization , 2016, Inf. Sci..

[8]  Lei Zhang,et al.  Robust Online Matrix Factorization for Dynamic Background Subtraction , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Misha Elena Kilmer,et al.  Novel Methods for Multilinear Data Completion and De-noising Based on Tensor-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[11]  Qinghua Hu,et al.  Efficient Background Modeling Based on Sparse Representation and Outlier Iterative Removal , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Lin Zhu,et al.  ${L_{1/2}}$ Norm and Spatial Continuity Regularized Low-Rank Approximation for Moving Object Detection in Dynamic Background , 2018, IEEE Signal Processing Letters.

[13]  Xin Li,et al.  Simultaneous Video Stabilization and Moving Object Detection in Turbulence , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Michael K. Ng,et al.  Robust Tensor Completion Using Transformed Tensor SVD , 2019, ArXiv.

[15]  Sudhish N. George,et al.  Twist tensor total variation regularized-reweighted nuclear norm based tensor completion for video missing area recovery , 2018, Inf. Sci..

[16]  Zongben Xu,et al.  Representative of L1/2 Regularization among Lq (0 < q ≤ 1) Regularizations: an Experimental Study Based on Phase Diagram , 2012 .

[17]  Jian Yu,et al.  $$S_{1/2}$$S1/2 regularization methods and fixed point algorithms for affine rank minimization problems , 2017, Comput. Optim. Appl..

[18]  Zongben Xu,et al.  $L_{1/2}$ Regularization: A Thresholding Representation Theory and a Fast Solver , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Angshul Majumdar,et al.  Hyperspectral Image Denoising Using Spatio-Spectral Total Variation , 2016, IEEE Geoscience and Remote Sensing Letters.

[20]  Guoying Zhao,et al.  Background Subtraction Based on Low-Rank and Structured Sparse Decomposition , 2015, IEEE Transactions on Image Processing.

[21]  Sudhish N. George,et al.  Moving object detection by low rank approximation and l1-TV regularization on RPCA framework , 2018, J. Vis. Commun. Image Represent..

[22]  Wei Liu,et al.  Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[24]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[25]  Christine Guillemot,et al.  Image Inpainting : Overview and Recent Advances , 2014, IEEE Signal Processing Magazine.

[26]  Xiang Zhang,et al.  A Bayesian Approach to Camouflaged Moving Object Detection , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Wensheng Zhang,et al.  The Twist Tensor Nuclear Norm for Video Completion , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[29]  N. Meinshausen,et al.  LASSO-TYPE RECOVERY OF SPARSE REPRESENTATIONS FOR HIGH-DIMENSIONAL DATA , 2008, 0806.0145.

[30]  Chen Xu,et al.  L1/2 Regularization Based Low-Rank Image Segmentation Model , 2013, 2013 Ninth International Conference on Computational Intelligence and Security.

[31]  Alfred Ekermo,et al.  Reducing the need for manual cleaning maintenance of digital surveillance cameras - A conceptual study , 2013 .

[32]  Zongben Xu,et al.  L1/2 regularization , 2010, Science China Information Sciences.

[33]  Yuan Xie,et al.  A New Low-Rank Tensor Model for Video Completion , 2015, ArXiv.

[34]  Wotao Yin,et al.  Parallel matrix factorization for low-rank tensor completion , 2013, ArXiv.

[35]  Feiping Nie,et al.  Joint Schatten $$p$$p-norm and $$\ell _p$$ℓp-norm robust matrix completion for missing value recovery , 2013, Knowledge and Information Systems.

[36]  Jieping Ye,et al.  An efficient ADMM algorithm for multidimensional anisotropic total variation regularization problems , 2013, KDD.

[37]  Yuan Xie,et al.  Moving Object Detection Using Tensor-Based Low-Rank and Saliently Fused-Sparse Decomposition , 2017, IEEE Transactions on Image Processing.

[38]  Hua Chai,et al.  The L1/2 regularization approach for survival analysis in the accelerated failure time model , 2015, Comput. Biol. Medicine.