Alternating strategies with internal ADMM for low-rank matrix reconstruction

This paper focuses on the problem of reconstructing low-rank matrices from underdetermined measurements using alternating optimization strategies. We endeavour to combine an alternating least-squares based estimation strategy with ideas from the alternating direction method of multipliers (ADMM) to recover low-rank matrices with linear parameterized structures, such as Hankel matrices. The use of ADMM helps to improve the estimate in each iteration due to its capability of incorporating information about the direction of estimates achieved in previous iterations. We show that merging these two alternating strategies leads to a better performance and less consumed time than the existing alternating least squares (ALS) strategy. The improved performance is verified via numerical simulations with varying sampling rates and real applications. HighlightsAlternating optimization strategies are good for recovering matrices.Matrices in consideration are low-rank matrices with linear parameterized structures.The algorithm combines an alternating least-squares based strategy with ideas from ADMM.Merging these two strategies leads to a better performance and less consumed time.

[1]  J. Liang,et al.  Adaptive Internal Model Controller Design Using Dynamic Partial Least Squares Decoupling Structure , 2014 .

[2]  Jean-Yves Tourneret,et al.  Frequency estimation based on Hankel matrices and the alternating direction method of multipliers , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[3]  Stephen P. Boyd,et al.  An ADMM Algorithm for a Class of Total Variation Regularized Estimation Problems , 2012, 1203.1828.

[4]  Yi-Kai Liu,et al.  Universal low-rank matrix recovery from Pauli measurements , 2011, NIPS.

[5]  Volkan Cevher,et al.  Randomized Low-Memory Singular Value Projection , 2013, ArXiv.

[6]  Ivan Markovsky,et al.  Software for weighted structured low-rank approximation , 2014, J. Comput. Appl. Math..

[7]  Yin Zhang,et al.  Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm , 2012, Mathematical Programming Computation.

[8]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[9]  Shuang Cong,et al.  A Robust Compressive Quantum State Tomography Algorithm Using ADMM , 2014, ArXiv.

[10]  Magnus Jansson,et al.  Reduced rank linear regression and weighted low rank approximations , 2006, IEEE Transactions on Signal Processing.

[11]  Magnus Jansson,et al.  Subspace Identification and ARX Modeling , 2003 .

[12]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[13]  Bo Wahlberg,et al.  Approximate regularization path for nuclear norm based H2 model reduction , 2014, 53rd IEEE Conference on Decision and Control.

[14]  Zhen Cui,et al.  Automatic motion capture data denoising via filtered subspace clustering and low rank matrix approximation , 2014, Signal Process..

[15]  Ruslan Salakhutdinov,et al.  Practical Large-Scale Optimization for Max-norm Regularization , 2010, NIPS.

[16]  Gang Wei,et al.  Accelerated reweighted nuclear norm minimization algorithm for low rank matrix recovery , 2015, Signal Process..

[17]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[18]  Dave Zachariah,et al.  Alternating Least-Squares for Low-Rank Matrix Reconstruction , 2012, IEEE Signal Processing Letters.

[19]  R. Plemmons,et al.  Structured low rank approximation , 2003 .

[20]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[21]  Tao Ding,et al.  A Rank Minimization Approach to Video Inpainting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Gongguo Tang,et al.  Lower Bounds on the Mean-Squared Error of Low-Rank Matrix Reconstruction , 2011, IEEE Transactions on Signal Processing.

[23]  Paul Tseng,et al.  Hankel Matrix Rank Minimization with Applications to System Identification and Realization , 2013, SIAM J. Matrix Anal. Appl..