Optimality Verification of Tensor Completion Model via Self-Validation

Tensor completion (TC) attempts to estimate the missing tensor entries from partial observations. Over the past decade, a tremendous amount of work has focused on this problem, which has given rise to a few excellent TC methods. Thus, a critical question is how to verify the optimality of TC models, especially when the underlying tensor is unknown, which is a common scenario in practice. The only existing method available—data validation—addresses the problem based on the validation set. While straightforward, this method may lead to a nonoptimal model, especially in scenarios with high missing ratios, and noise. In this work, we propose a self-validation method, which accounts for a metric named the identifiability measure, defined based on the generalization of isomeric conditions in the tensor case. It is noteworthy that the identifiability measure can verify the optimality of TC models without the use of any validation set. Extensive numerical experiments conducted on both synthetic, and real-world datasets empirically validate the superiority of the proposed method over the data validation approach.

[1]  Kun Shang,et al.  Iterative p-shrinkage thresholding algorithm for low Tucker rank tensor recovery , 2019, Inf. Sci..

[2]  Qingshan Liu,et al.  A New Theory for Matrix Completion , 2017, NIPS.

[3]  Huachun Tan,et al.  A Fused CP Factorization Method for Incomplete Tensors , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[5]  Chunsheng Liu,et al.  Tensor p-shrinkage nuclear norm for low-rank tensor completion , 2019, Neurocomputing.

[6]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[7]  Andrzej Cichocki,et al.  Smooth PARAFAC Decomposition for Tensor Completion , 2015, IEEE Transactions on Signal Processing.

[8]  Navid Ghadermarzy,et al.  Learning Tensors From Partial Binary Measurements , 2018, IEEE Transactions on Signal Processing.

[9]  Tie-Yan Liu,et al.  Large-Scale Low-Rank Matrix Learning with Nonconvex Regularizers , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Misha Elena Kilmer,et al.  Novel Methods for Multilinear Data Completion and De-noising Based on Tensor-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Bin Wang,et al.  Robust Online Matrix Completion with Gaussian Mixture Model , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Hao Kong,et al.  t-Schatten-$p$ Norm for Low-Rank Tensor Recovery , 2018, IEEE Journal of Selected Topics in Signal Processing.

[14]  Qingshan Liu,et al.  Selecting Optimal Completion to Partial Matrix via Self-Validation , 2020, IEEE Signal Processing Letters.

[15]  Hong-Yuan Mark Liao,et al.  Simultaneous Tensor Decomposition and Completion Using Factor Priors , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[17]  M. Kilmer,et al.  Factorization strategies for third-order tensors , 2011 .

[18]  Jiangjun Peng,et al.  Hyperspectral Image Restoration Via Total Variation Regularized Low-Rank Tensor Decomposition , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Hanghang Tong,et al.  Factor Matrix Trace Norm Minimization for Low-Rank Tensor Completion , 2014, SDM.

[20]  Jian Yang,et al.  Multilinear Sparse Principal Component Analysis , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Qingshan Liu,et al.  Matrix Completion with Deterministic Sampling: Theories and Methods , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Tamara G. Kolda,et al.  Scalable Tensor Factorizations for Incomplete Data , 2010, ArXiv.