Convolution-Consistent Collective Matrix Completion

Collective matrix completion refers to the problem of simultaneously predicting the missing entries in multiple matrices by leveraging the cross-matrix information. It finds abundant applications in various domains such as recommender system, dimensionality reduction, and image recovery. Most of the existing work represents the cross-matrix information in a shared latent structure constrained by the Euclidean-based pairwise similarity, which may fail to capture the nonlinear relationship of the data. To address this problem, in this paper, we propose a new collective matrix completion framework, named C4, which uses the graph spectral filters to capture the non-Euclidean cross-matrix information. To the best of our knowledge, this is the first effort to represent the cross-matrix information in the graph spectral domain. We benchmark our model against 8 recent models on 10 real-world data sets, and our model outperforms state-of-the-art methods in most tasks.

[1]  Yin Zhang,et al.  An alternating direction algorithm for matrix completion with nonnegative factors , 2011, Frontiers of Mathematics in China.

[2]  Yin Zhang,et al.  Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm , 2012, Mathematical Programming Computation.

[3]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[4]  Yousef Saad,et al.  Scaled Gradients on Grassmann Manifolds for Matrix Completion , 2012, NIPS.

[5]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[6]  El-hadi Zahzah,et al.  Matrix and tensor completion algorithms for background model initialization: A comparative evaluation , 2017, Pattern Recognit. Lett..

[7]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[8]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jingrui He,et al.  MUVIR: Multi-View Rare Category Detection , 2015, IJCAI.

[10]  Fei Wang,et al.  Multi-View Graph Convolutional Network and Its Applications on Neuroimage Analysis for Parkinson's Disease , 2018, AMIA.

[11]  Jieping Ye,et al.  Orthogonal Rank-One Matrix Pursuit for Low Rank Matrix Completion , 2014, SIAM J. Sci. Comput..

[12]  Kun Li,et al.  Foreground–Background Separation From Video Clips via Motion-Assisted Matrix Restoration , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Jingrui He,et al.  A Randomized Approach for Crowdsourcing in the Presence of Multiple Views , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[14]  Stephen J. Wright,et al.  On GROUSE and incremental SVD , 2013, 2013 5th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[15]  Hanghang Tong,et al.  Graph Convolutional Networks: Algorithms, Applications and Open Challenges , 2018, CSoNet.

[16]  Jingrui He,et al.  Crowdsourcing via Tensor Augmentation and Completion , 2016, IJCAI.

[17]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[18]  Jingrui He,et al.  SPARC: Self-Paced Network Representation for Few-Shot Rare Category Characterization , 2018, KDD.

[19]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.