Exact minimum rank approximation via Schatten p-norm minimization

Abstract Minimizing the rank of a matrix with a given system of affine constraints is to recover the lowest-rank matrix with many important applications in engineering and science. A convex relaxation of the rank minimization problem by minimizing the nuclear norm instead of the rank of the matrix has recently been proposed. Recht and Fazel concluded that nuclear norm minimization subject to affine constraints is equivalent to rank minimization under a certain condition in terms of the rank-restricted isometry property. In this paper, we extend some recent results from nuclear norm minimization to Schatten p -norm minimization and present a theoretical guarantee for the Schatten p -norm minimization if a certain restricted isometry property holds for the linear affine transform. Our results improve on the previous works where recovery is used for nuclear norm minimization. An algorithm based on the Majorization Minimization algorithm has been proposed to solve Schatten p -norm minimization. By using an approximate singular value decomposition procedure, we obtain a fast and robust algorithm. The numerical results on the matrix completion problem with noisy measurements indicate that our algorithm gives a more accurate reconstruction and takes less time compared with some other existing algorithms.

[1]  A. Tsybakov,et al.  Estimation of high-dimensional low-rank matrices , 2009, 0912.5338.

[2]  Wotao Yin,et al.  Improved Iteratively Reweighted Least Squares for Unconstrained Smoothed 퓁q Minimization , 2013, SIAM J. Numer. Anal..

[3]  Kim-Chuan Toh,et al.  SDPT3 — a Matlab software package for semidefinite-quadratic-linear programming, version 3.0 , 2001 .

[4]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[5]  Shiqian Ma,et al.  Fixed point and Bregman iterative methods for matrix rank minimization , 2009, Math. Program..

[6]  Marc Teboulle,et al.  A Linearly Convergent Algorithm for Solving a Class of Nonconvex/Affine Feasibility Problems , 2011, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[7]  Yoram Bresler,et al.  ADMiRA: Atomic Decomposition for Minimum Rank Approximation , 2009, IEEE Transactions on Information Theory.

[8]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[9]  Lieven Vandenberghe,et al.  Interior-Point Method for Nuclear Norm Approximation with Application to System Identification , 2009, SIAM J. Matrix Anal. Appl..

[10]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[11]  G. Papavassilopoulos,et al.  On the rank minimization problem over a positive semidefinite linear matrix inequality , 1997, IEEE Trans. Autom. Control..

[12]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[13]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[14]  Yoram Bresler,et al.  Guaranteed Minimum Rank Approximation from Linear Observations by Nuclear Norm Minimization with an Ellipsoidal Constraint , 2009, ArXiv.

[15]  Maryam Fazel,et al.  Iterative reweighted algorithms for matrix rank minimization , 2012, J. Mach. Learn. Res..

[16]  Emmanuel J. Candès,et al.  The Power of Convex Relaxation: Near-Optimal Matrix Completion , 2009, IEEE Transactions on Information Theory.

[17]  Petros Drineas,et al.  FAST MONTE CARLO ALGORITHMS FOR MATRICES II: COMPUTING A LOW-RANK APPROXIMATION TO A MATRIX∗ , 2004 .

[18]  I. Selesnick Sparse signal restoration , 2009 .

[19]  Robert Tibshirani,et al.  Spectral Regularization Algorithms for Learning Large Incomplete Matrices , 2010, J. Mach. Learn. Res..

[20]  A. Shapiro Weighted minimum trace factor analysis , 1982 .