An Implementable Accelerated Alternating Direction Method of Multipliers for Low-Rank Tensor Completion

Low-rank tensor completion has attracted much interest in many applications such as image processing, data mining and machine learning. A widely used method is to minimize the sum of nuclear norms of unfolding matrices of a tensor. In this paper, we study a accelerated alternating direction method of multipliers (ADMM) for solving the sum of nuclear norms of unfolding matrices of a tensor. The basic idea of accelerated ADMM is to incorporate a multistep acceleration scheme into the classical ADMM. We design efficient implementations of the algorithm and present its convergence result. Extensive numerical examples on both random and real world data are presented to validate the superiority of our proposed algorithm over class ADMM.

[1]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[3]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[4]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[5]  Laurence T. Yang,et al.  A Multi-Order Distributed HOSVD with Its Incremental Computing for Big Services in Cyber-Physical-Social Systems , 2020, IEEE Transactions on Big Data.

[6]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[7]  Yunmei Chen,et al.  An Accelerated Linearized Alternating Direction Method of Multipliers , 2014, SIAM J. Imaging Sci..

[8]  F. L. Hitchcock The Expression of a Tensor or a Polyadic as a Sum of Products , 1927 .

[9]  Chunfeng Cui,et al.  An Adaptive Correction Approach for Tensor Completion , 2016, SIAM J. Imaging Sci..

[10]  B. Recht,et al.  Tensor completion and low-n-rank tensor recovery via convex optimization , 2011 .

[11]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[12]  Laurence T. Yang,et al.  A Tensor Computation and Optimization Model for Cyber-Physical-Social Big Data , 2019, IEEE Transactions on Sustainable Computing.

[13]  Laurence T. Yang,et al.  A Cloud-Edge Computing Framework for Cyber-Physical-Social Services , 2017, IEEE Communications Magazine.

[14]  Laurence T. Yang,et al.  A Tensor-Based Big Service Framework for Enhanced Living Environments , 2016, IEEE Cloud Computing.

[15]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..