Dual local learning regularized nonnegative matrix factorization and its semi-supervised extension for clustering

Nonnegative matrix factorization (NMF) has received considerable attention in data representation due to its strong interpretability. However, traditional NMF methods neglect the discriminative information and geometric structure of both the data space and the feature space, simultaneously. In this paper, we propose a dual local learning regularized nonnegative matrix factorization (DLLNMF) method, which not only considers the geometric structure of both the data manifold and the feature manifold, simultaneously, but also takes advantage of the discriminative information of both the data space and the feature space. To make full use of the partial label information among samples, we further propose its semi-supervised extension, called dual local learning regularized nonnegative matrix factorization with label constraint (DLLNMF-LC), which imposes the label information as a hard constraint without additional parameters. Experimental results on some benchmark datasets have demonstrated the effectiveness of our proposed methods.

[1]  Xiao Wang,et al.  Robust semi-supervised nonnegative matrix factorization , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[2]  Tommy W. S. Chow,et al.  A two-dimensional Neighborhood Preserving Projection for appearance-based face recognition , 2012, Pattern Recognit..

[3]  Jim Jing-Yan Wang,et al.  Domain transfer nonnegative matrix factorization , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[4]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[5]  Wei Liu,et al.  Nonnegative Local Coordinate Factorization for Image Representation , 2011, IEEE Transactions on Image Processing.

[6]  Ling Shao,et al.  A rapid learning algorithm for vehicle classification , 2015, Inf. Sci..

[7]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[8]  Sam Kwong,et al.  Efficient Motion and Disparity Estimation Optimization for Low Complexity Multiview Video Coding , 2015, IEEE Transactions on Broadcasting.

[9]  Quanquan Gu,et al.  Co-clustering on manifolds , 2009, KDD.

[10]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[11]  George Trigeorgis,et al.  A Deep Matrix Factorization Method for Learning Attribute Representations , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Chunxia Zhang,et al.  Graph-based discriminative concept factorization for data representation , 2017, Knowl. Based Syst..

[13]  Zhifeng Li,et al.  Fishervioce: A discriminant subspace framework for speaker recognition , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[14]  Thomas S. Huang,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation. , 2011, IEEE transactions on pattern analysis and machine intelligence.

[15]  Honghui Fan,et al.  The Optimal Graph Regularized Sparse Coding with Application to Image Representation , 2019, PRCV.

[16]  Kai Lu,et al.  CURE: Flexible Categorical Data Representation by Hierarchical Coupling Learning , 2019, IEEE Transactions on Knowledge and Data Engineering.

[17]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[18]  Jun Ye,et al.  Dual-graph regularized concept factorization for clustering , 2014, Neurocomputing.

[19]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[20]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[21]  Badong Chen,et al.  Dual Graph Regularized Sparse Nonnegative Matrix Factorization for Data Representation , 2019, 2019 IEEE International Symposium on Circuits and Systems (ISCAS).

[22]  Jiawei Han,et al.  Non-negative Matrix Factorization on Manifold , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[23]  Fei Wang,et al.  Graph dual regularization non-negative matrix factorization for co-clustering , 2012, Pattern Recognit..

[24]  Xiaojun Wu,et al.  Multiple Laplacian graph regularised low-rank representation with application to image representation , 2017, IET Image Process..