Multi-view embedding learning via robust joint nonnegative matrix factorization

Real data often are comprised of multiple modalities or different views, which provide complementary and consensus information to each other. Exploring those information is important for the multi-view data clustering and classification. Multiview embedding is an effective method for multiple view data which uncovers the common latent structure shared by different views. Previous studies assumed that each view is clean, or at least there are not contaminated by noises. However, in real tasks, it is often that every view might be suffered from noises or even some views are partially missing, which renders the traditional multi-view embedding algorithm fail to those cases. In this paper, we propose a novel multi-view embedding algorithm via robust joint nonnegative matrix factorization. We utilize the correntropy induced metric to measure the reconstruction error for each view, which are robust to the noises by assigning different weight for different entries. In order to uncover the common subspace shared by different views, we define a consensus matrix subspace to constrain the disagreement of different views. For the non-convex objective function, we formulate it into half quadratic minimization and solve it via update scheme efficiently. The experiments results show its effectiveness and robustness in multiview clustering.

[1]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Michael Lindenbaum,et al.  Nonnegative Matrix Factorization with Earth Mover's Distance Metric for Image Analysis , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Raymond H. Chan,et al.  The Equivalence of Half-Quadratic Minimization and the Gradient Linearization Iteration , 2007, IEEE Transactions on Image Processing.

[4]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[5]  V. D. Sa Spectral Clustering with Two Views , 2007 .

[6]  Xiaolei Wang,et al.  Non-negative matrix factorization by maximizing correntropy for cancer clustering , 2013, BMC Bioinformatics.

[7]  Xuan Li,et al.  Robust Nonnegative Matrix Factorization via Half-Quadratic Minimization , 2012, 2012 IEEE 12th International Conference on Data Mining.

[8]  Sham M. Kakade,et al.  Multi-view clustering via canonical correlation analysis , 2009, ICML '09.

[9]  Hal Daumé,et al.  A Co-training Approach for Multi-view Spectral Clustering , 2011, ICML.

[10]  Chun Chen,et al.  Graph Regularized Sparse Coding for Image Representation , 2011, IEEE Transactions on Image Processing.

[11]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Martha White,et al.  Convex Multi-view Subspace Learning , 2012, NIPS.

[13]  Jian Yang,et al.  Regularized Robust Coding for Face Recognition , 2012, IEEE Transactions on Image Processing.

[14]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[15]  Bao-Gang Hu,et al.  Robust feature extraction via information theoretic learning , 2009, ICML '09.

[16]  Christopher J. C. Burges,et al.  Spectral clustering and transductive learning with multiple views , 2007, ICML '07.

[17]  Xin Liu,et al.  Document clustering based on non-negative matrix factorization , 2003, SIGIR.

[18]  Ralf Herbrich,et al.  Learning Kernel Classifiers: Theory and Algorithms , 2001 .

[19]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[20]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.