Tensor completion via optimization on the product of matrix manifolds

We present a method for tensor completion using optimization on low-rank matrix manifolds. Our notion of tensor-rank is based on the recently proposed framework of tensor- Singular Value Decomposition (t-SVD) in [1], [2]. In contrast to convex optimization methods used in [1] that operate in a high-dimensional space, in the manifold setting, one works directly in the reduced dimensionality space and is thus able to significantly reduce the computational costs [3], [4]. In this paper we focus on 3-D data and under the tensor algebraic framework of [1], [2] we show that a 3-D tensor of fixed tubal-rank can be seen as an element of the product manifold of fixed low-rank matrices in the Fourier domain. The tensor completion problem then reduces to finding the best approximation to the sampled data on this product manifold. Further, for 3-D data we consider and compare recovery performance under two approaches. In the first approach one samples entire mode-3 fibers of the tensor, which we refer to as tubal-sampling. The second approach employs element-wise sampling and we simply refer to this method as sampling. For these two types of sampling approaches, we present simulation results for surveillance video data and show that recovery under random sampling has better performance compared to the random tubal-sampling.

[1]  Bamdev Mishra,et al.  Manopt, a matlab toolbox for optimization on manifolds , 2013, J. Mach. Learn. Res..

[2]  A. Stegeman,et al.  On Kruskal's uniqueness condition for the Candecomp/Parafac decomposition , 2007 .

[3]  W. Hackbusch Tensor Spaces and Numerical Tensor Calculus , 2012, Springer Series in Computational Mathematics.

[4]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[5]  Misha Elena Kilmer,et al.  Third-Order Tensors as Operators on Matrices: A Theoretical and Computational Framework with Applications in Imaging , 2013, SIAM J. Matrix Anal. Appl..

[6]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[7]  M. Kilmer,et al.  Tensor-Tensor Products with Invertible Linear Transforms , 2015 .

[8]  Shuchin Aeron,et al.  5D and 4D pre-stack seismic data completion using tensor nuclear norm (TNN) , 2013, SEG Technical Program Expanded Abstracts 2013.

[9]  Bamdev Mishra,et al.  A Riemannian geometry for low-rank matrix completion , 2012, ArXiv.

[10]  Thomas B. Schön,et al.  2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2015 , 2016 .

[11]  Bart Vandereycken,et al.  Low-Rank Matrix Completion by Riemannian Optimization , 2013, SIAM J. Optim..

[12]  Jérôme Malick,et al.  Projection-like Retractions on Matrix Manifolds , 2012, SIAM J. Optim..

[13]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[14]  Bart Vandereycken,et al.  Low-rank tensor completion by Riemannian optimization , 2014 .

[15]  Vin de Silva,et al.  Tensor rank and the ill-posedness of the best low-rank approximation problem , 2006, math/0607647.

[16]  Felix J. Herrmann,et al.  Optimization on the Hierarchical Tucker manifold – Applications to tensor completion , 2014, Linear Algebra and its Applications.

[17]  Hiroyuki Kasai,et al.  Riemannian preconditioning for tensor completion , 2015, ArXiv.

[18]  Misha Elena Kilmer,et al.  Novel Methods for Multilinear Data Completion and De-noising Based on Tensor-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.