Robust Matrix Completion with Mixed Data Types

We consider the matrix completion problem of recovering a structured low rank matrix with partially observed entries with mixed data types. Vast majority of the solutions have proposed computationally feasible estimators with strong statistical guarantees for the case where the underlying distribution of data in the matrix is continuous. A few recent approaches have extended using similar ideas these estimators to the case where the underlying distributions belongs to the exponential family. Most of these approaches assume that there is only one underlying distribution and the low rank constraint is regularized by the matrix Schatten Norm. We propose a computationally feasible statistical approach with strong recovery guarantees along with an algorithmic framework suited for parallelization to recover a low rank matrix with partially observed entries for mixed data types in one step. We also provide extensive simulation evidence that corroborate our theoretical results.

[1]  Ewout van den Berg,et al.  1-Bit Matrix Completion , 2012, ArXiv.

[2]  G. Jameson Summing and nuclear norms in Banach space theory , 1987 .

[3]  O. Klopp Noisy low-rank matrix completion with general sampling distribution , 2012, 1203.0108.

[4]  E. Candès,et al.  Exact low-rank matrix completion via convex optimization , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[5]  Emmanuel J. Candès,et al.  The Power of Convex Relaxation: Near-Optimal Matrix Completion , 2009, IEEE Transactions on Information Theory.

[6]  Prateek Jain,et al.  Low-rank matrix completion using alternating minimization , 2012, STOC '13.

[7]  É. Moulines,et al.  Adaptive Multinomial Matrix Completion , 2014, 1408.6218.

[8]  T. Tony Cai,et al.  Matrix completion via max-norm constrained optimization , 2013, ArXiv.

[9]  Makoto Yamada,et al.  Consistent Collective Matrix Completion under Joint Low Rank Structure , 2014, AISTATS.

[10]  Kim-Chuan Toh,et al.  Max-norm optimization for robust matrix recovery , 2016, Mathematical Programming.

[11]  Bingsheng He,et al.  Generalized alternating direction method of multipliers: new theoretical insights and applications , 2015, Math. Program. Comput..

[12]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[13]  A. Bandeira,et al.  Sharp nonasymptotic bounds on the norm of random matrices with independent entries , 2014, 1408.6185.

[14]  Mokhtar Z. Alaya,et al.  Collective Matrix Completion , 2018, J. Mach. Learn. Res..

[15]  Moritz Hardt,et al.  Understanding Alternating Minimization for Matrix Completion , 2013, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[16]  Wen-Xin Zhou,et al.  A max-norm constrained minimization approach to 1-bit matrix completion , 2013, J. Mach. Learn. Res..

[17]  Benjamin Recht,et al.  A Simpler Approach to Matrix Completion , 2009, J. Mach. Learn. Res..

[18]  Adi Shraibman,et al.  Rank, Trace-Norm and Max-Norm , 2005, COLT.

[19]  Jean Lafond,et al.  Low Rank Matrix Completion with Exponential Family Noise , 2015, COLT.

[20]  Tommi S. Jaakkola,et al.  Maximum-Margin Matrix Factorization , 2004, NIPS.

[21]  H. Brezis Functional Analysis, Sobolev Spaces and Partial Differential Equations , 2010 .

[22]  Pradeep Ravikumar,et al.  Exponential Family Matrix Completion under Structural Constraints , 2014, ICML.

[23]  Stephen P. Boyd,et al.  Generalized Low Rank Models , 2014, Found. Trends Mach. Learn..

[24]  Anton van den Hengel,et al.  Semidefinite Programming , 2014, Computer Vision, A Reference Guide.

[25]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[26]  J. Michaelsen,et al.  Use of the gamma distribution to represent monthly rainfall in Africa for drought monitoring applications , 2007 .

[27]  Yang Cao,et al.  Poisson matrix completion , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).