Missing Data Recovery Based on Tensor-CUR Decomposition

Tensor completion is a higher way analog of matrix completion, which has proven to be a powerful tool for data analysis. In this paper, we formulate the missing data recovery problem of a three-way tensor as a tensor completion problem. We propose a novel tensor completion method based on tensor-CUR decomposition to estimate the missing data from limited samples. Computational experiments demonstrate that the proposed method yields a superior performance over other existing approaches.

[1]  Felix J. Herrmann,et al.  Massive 3D seismic data compression and inversion with hierarchical Tucker , 2017 .

[2]  Pierre Comon,et al.  Tensor CP Decomposition With Structured Factor Matrices: Algorithms and Performance , 2016, IEEE Journal of Selected Topics in Signal Processing.

[3]  Konstantinos Kalpakis,et al.  Online Recovery of Missing Values in Vital Signs Data Streams Using Low-Rank Matrix Completion , 2012, 2012 11th International Conference on Machine Learning and Applications.

[4]  Carsten Lund,et al.  Estimating point-to-point and point-to-multipoint traffic matrices: an information-theoretic approach , 2005, IEEE/ACM Transactions on Networking.

[5]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[6]  Walter Willinger,et al.  Spatio-Temporal Compressive Sensing and Internet Traffic Matrices (Extended Version) , 2012, IEEE/ACM Transactions on Networking.

[7]  Mark Crovella,et al.  On traffic matrix completion in the internet , 2012, Internet Measurement Conference.

[8]  M. Kilmer,et al.  A Third-order Generalization of the Matrix Svd as a Product of Third-order Tensors , 2008 .

[9]  Zhihua Zhang,et al.  A Scalable Approach to Column-Based Low-Rank Matrix Approximation , 2013, IJCAI.

[10]  Konstantina Papagiannaki,et al.  Structural analysis of network traffic flows , 2004, SIGMETRICS '04/Performance '04.

[11]  Johan Håstad,et al.  Tensor Rank is NP-Complete , 1989, ICALP.

[12]  Misha Elena Kilmer,et al.  Facial Recognition Using Tensor-Tensor Decompositions , 2013, SIAM J. Imaging Sci..

[13]  Guangdong Feng,et al.  A Tensor Based Method for Missing Traffic Data Completion , 2013 .

[14]  Bin Ran,et al.  Tensor based missing traffic data completion with spatial–temporal correlation , 2016 .

[15]  Gaogang Xie,et al.  Sequential and adaptive sampling for matrix completion in network monitoring systems , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[16]  Minh N. Do,et al.  Efficient Tensor Completion for Color Image and Video Recovery: Low-Rank Tensor Train , 2016, IEEE Transactions on Image Processing.

[17]  Marlin H. Mickle,et al.  Comparative analysis of compressive sensing approaches for recovery of missing samples in implantable wireless Doppler device , 2014, IET Signal Process..

[18]  Arun K. Tangirala,et al.  Reconstruction of missing data using compressed sensing techniques with adaptive dictionary , 2016 .

[19]  Han Liu,et al.  Provable sparse tensor decomposition , 2015, 1502.01425.

[20]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Gaogang Xie,et al.  Learning from the Past: Intelligent On-Line Weather Monitoring Based on Matrix Completion , 2014, 2014 IEEE 34th International Conference on Distributed Computing Systems.

[22]  Christophe Diot,et al.  Diagnosing network-wide traffic anomalies , 2004, SIGCOMM.

[23]  Ameet Talwalkar,et al.  Divide-and-Conquer Matrix Factorization , 2011, NIPS.

[24]  Nuria Oliver,et al.  Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering , 2010, RecSys '10.

[25]  Qihui Wu,et al.  A Joint Tensor Completion and Prediction Scheme for Multi-Dimensional Spectrum Map Construction , 2016, IEEE Access.

[26]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[27]  Yujun Li,et al.  A Simple Approach to Optimal CUR Decomposition , 2015, ArXiv.

[28]  Reinhold Schneider,et al.  Dynamical Approximation by Hierarchical Tucker and Tensor-Train Tensors , 2013, SIAM J. Matrix Anal. Appl..

[29]  Prateek Jain,et al.  Provable Tensor Factorization with Missing Data , 2014, NIPS.

[30]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[31]  Steve Uhlig,et al.  Providing public intradomain traffic matrices to the research community , 2006, CCRV.

[32]  Miao Xu,et al.  CUR Algorithm for Partially Observed Matrices , 2014, ICML.

[33]  Tamara G. Kolda,et al.  Scalable Tensor Factorizations for Incomplete Data , 2010, ArXiv.

[34]  Baoxin Li,et al.  Tensor completion for on-board compression of hyperspectral images , 2010, 2010 IEEE International Conference on Image Processing.

[35]  Mathews Jacob,et al.  Multi-shot multi-channel diffusion data recovery using structured low-rank matrix completion , 2016, 1602.07274.

[36]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[37]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.