Online Bayesian low-rank subspace learning from partial observations

Learning the underlying low-dimensional subspace from streaming incomplete high-dimensional observations data has attracted considerable attention lately. In this paper, we present a new computationally efficient Bayesian scheme for online low-rank subspace learning and matrix completion. The proposed scheme builds upon a properly defined hierarchical Bayesian model that explicitly imposes low rank to the latent subspace by assigning sparsity promoting Student-t priors to the columns of the subspace matrix. The new algorithm is fully automated and as corroborated by numerical simulations, provides higher estimation accuracy and a better estimate of the true subspace rank compared to state of the art methods.

[1]  Bin Yang,et al.  Projection approximation subspace tracking , 1995, IEEE Trans. Signal Process..

[2]  Morteza Mardani,et al.  Subspace Learning and Imputation for Streaming Big Data Matrices and Tensors , 2014, IEEE Transactions on Signal Processing.

[3]  Konstantinos Koutroumbas,et al.  A Variational Bayes Framework for Sparse Adaptive Estimation , 2014, IEEE Transactions on Signal Processing.

[4]  Robert D. Nowak,et al.  Online identification and tracking of subspaces from highly incomplete information , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[5]  A. Robert Calderbank,et al.  PETRELS: Parallel Subspace Estimation and Tracking by Recursive Least Squares From Partial Observations , 2012, IEEE Transactions on Signal Processing.

[6]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[7]  Aggelos K. Katsaggelos,et al.  Sparse Bayesian Methods for Low-Rank Matrix Estimation , 2011, IEEE Transactions on Signal Processing.