1-bit matrix completion under exact low-rank constraint

We consider the problem of noisy 1-bit matrix completion under an exact rank constraint on the true underlying matrix M*. Instead of observing a subset of the noisy continuous-valued entries of a matrix M*, we observe a subset of noisy 1-bit (or binary) measurements generated according to a probabilistic model. We consider constrained maximum likelihood estimation of M*, under a constraint on the entry-wise infinity-norm of M* and an exact rank constraint. This is in contrast to previous work which has used convex relaxations for the rank. We provide an upper bound on the matrix estimation error under this model. Compared to the existing results, our bound has faster convergence rate with matrix dimensions when the fraction of revealed 1-bit observations is fixed, independent of the matrix dimensions. We also propose an iterative algorithm for solving our nonconvex optimization with a certificate of global optimality of the limiting point. This algorithm is based on low rank factorization of M*. We validate the method on synthetic and real data with improved performance over existing methods.

[1]  Jean Ponce,et al.  Convex Sparse Matrix Factorizations , 2008, ArXiv.

[2]  Renato D. C. Monteiro,et al.  A nonlinear programming algorithm for solving semidefinite programs via low-rank factorization , 2003, Math. Program..

[3]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[4]  Ying Zhang,et al.  Localization from connectivity in sensor networks , 2004, IEEE Transactions on Parallel and Distributed Systems.

[5]  Richard G. Baraniuk,et al.  Matrix recovery from quantized and corrupted measurements , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Christopher Ré,et al.  Parallel stochastic gradient algorithms for large-scale matrix completion , 2013, Mathematical Programming Computation.

[7]  S. Chatterjee,et al.  Matrix estimation by Universal Singular Value Thresholding , 2012, 1212.1247.

[8]  Andrea Montanari,et al.  Matrix completion from a few entries , 2009, 2009 IEEE International Symposium on Information Theory.

[9]  Amin Karbasi,et al.  Robust Localization From Incomplete Local Information , 2013, IEEE/ACM Transactions on Networking.

[10]  ZhangYing,et al.  Localization from Connectivity in Sensor Networks , 2004 .

[11]  Wen-Xin Zhou,et al.  A max-norm constrained minimization approach to 1-bit matrix completion , 2013, J. Mach. Learn. Res..

[12]  Prateek Jain,et al.  Universal Matrix Completion , 2014, ICML.

[13]  Ewout van den Berg,et al.  1-Bit Matrix Completion , 2012, ArXiv.

[14]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[15]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.