A Novel Approach to Quantized Matrix Completion Using Huber Loss Measure

In this paper, we introduce a novel and robust approach to quantized matrix completion. First, we propose a rank minimization problem with constraints induced by quantization bounds. Next, we form an unconstrained optimization problem by regularizing the rank function with Huber loss. Huber loss is leveraged to control the violation from quantization bounds due to two properties: first, it is differentiable; and second, it is less sensitive to outliers than the quadratic loss. A smooth rank approximation is utilized to endorse lower rank on the genuine data matrix. Thus, an unconstrained optimization problem with differentiable objective function is obtained allowing us to advantage from gradient descent technique. Novel and firm theoretical analysis of the problem model and convergence of our algorithm to the global solution are provided. Another contribution of this letter is that our method does not require projections or initial rank estimation, unlike the state-of-the-art. In the Numerical Experiments section, the noticeable outperformance of our proposed method in learning accuracy and computational complexity compared to those of the state-of-the-art literature methods is illustrated as the main contribution.

[1]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[2]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[3]  Yinyu Ye,et al.  Semidefinite programming for ad hoc wireless sensor network localization , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[4]  Farrokh Marvasti,et al.  Transduction with Matrix Completion Using Smoothed Rank Function , 2018, ArXiv.

[5]  Farrokh Marvasti,et al.  Recovering Quantized Data with Missing Information Using Bilinear Factorization and Augmented Lagrangian Method , 2018, ArXiv.

[6]  Joe H. Chow,et al.  Low-Rank Matrix Recovery From Noisy, Quantized, and Erroneous Measurements , 2018, IEEE Transactions on Signal Processing.

[7]  Richard G. Baraniuk,et al.  Quantized Matrix Completion for Personalized Learning , 2014, EDM.

[8]  Nazanin Rahnavard,et al.  Feedback Acquisition and Reconstruction of Spectrum-Sparse Signals by Predictive Level Comparisons , 2017, IEEE Signal Processing Letters.

[9]  Richard G. Baraniuk,et al.  Matrix recovery from quantized and corrupted measurements , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Christian Jutten,et al.  Recovery of Low-Rank Matrices Under Affine Constraints via a Smoothed Rank Function , 2013, IEEE Transactions on Signal Processing.

[11]  Yang Cao,et al.  Categorical matrix completion , 2015, 2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[12]  Andrea Montanari,et al.  Matrix completion from a few entries , 2009, 2009 IEEE International Symposium on Information Theory.

[13]  Quanquan Gu,et al.  Optimal Statistical and Computational Rates for One Bit Matrix Completion , 2016, AISTATS.

[14]  Joe H. Chow,et al.  Low-rank matrix recovery from quantized and erroneous measurements: Accuracy-preserved data privatization in power grids , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[15]  Anand D. Sarwate,et al.  Randomized requantization with local differential privacy , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Ewout van den Berg,et al.  1-Bit Matrix Completion , 2012, ArXiv.

[17]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[18]  Sonia A. Bhaskar Probabilistic low-rank matrix recovery from quantized measurements: Application to image denoising , 2015, 2015 49th Asilomar Conference on Signals, Systems and Computers.

[19]  Sonia A. Bhaskar,et al.  Probabilistic Low-Rank Matrix Completion from Quantized Measurements , 2016, J. Mach. Learn. Res..

[20]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[21]  Eric Moulines,et al.  Probabilistic low-rank matrix completion on finite alphabets , 2014, NIPS.

[22]  Jarvis D. Haupt,et al.  Noisy Matrix Completion Under Sparse Factor Models , 2014, IEEE Transactions on Information Theory.

[23]  Wen-Xin Zhou,et al.  A max-norm constrained minimization approach to 1-bit matrix completion , 2013, J. Mach. Learn. Res..