Robust non-negative matrix factorization with multiple correntropy-induced hypergraph regularizer

Abstract Non-negative matrix factorization (NMF) is a popular learning tool, which has widely used in computer vision and image processing. Many variants and extensions of NMF have been proposed, where the manifold regularized NMF methods have achieved promising performance due to the preservation of the geometric structures of the data. However, for many applications, the data is usually contaminated by complex noise. The noise leads the data to deviate from the intrinsic manifold, resulting in the degenerate performance. To make the NMF methods reflect the underlying manifold structure well, we propose a novel robust non-negative matrix factorization model. Our model proposes a novel ensemble manifold regularizer, which combines multiple robust hypergraphs to estimate the underlying manifold. Specifically, the correntropy-induced hypergraph is used as the initial manifold estimation. By incorporating the proposed regularizer into the original NMF framework, two novel manifold regularized NMF methods are proposed. The clustering results on the noisy image datasets demonstrate that our model is effective, which achieves the state-of-the-art performance.

[1]  Wei Liu,et al.  Nonnegative Local Coordinate Factorization for Image Representation , 2011, IEEE Transactions on Image Processing.

[2]  Seungjin Choi,et al.  Manifold-respecting discriminant nonnegative matrix factorization , 2011, Pattern Recognit. Lett..

[3]  Bin Fang,et al.  Feature fusion and non-negative matrix factorization based active contours for texture segmentation , 2019, Signal Process..

[4]  Serge J. Belongie,et al.  Higher order learning with graphs , 2006, ICML.

[5]  Meng Wang,et al.  Adaptive Hypergraph Learning and its Application in Image Classification , 2012, IEEE Transactions on Image Processing.

[6]  Anastasios Tefas,et al.  Subclass discriminant Nonnegative Matrix Factorization for facial image analysis , 2012, Pattern Recognit..

[7]  Xian-Sheng Hua,et al.  Ensemble Manifold Regularization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[9]  Ioannis Pitas,et al.  A Novel Discriminant Non-Negative Matrix Factorization Algorithm With Applications to Facial Image Characterization Problems , 2007, IEEE Transactions on Information Forensics and Security.

[10]  Renato D. C. Monteiro,et al.  Group Sparsity in Nonnegative Matrix Factorization , 2012, SDM.

[11]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[12]  Edwin R. Hancock,et al.  Joint hypergraph learning and sparse regression for feature selection , 2017, Pattern Recognit..

[13]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[14]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[15]  Chia-Hsiang Lin,et al.  A Convex Optimization-Based Coupled Nonnegative Matrix Factorization Algorithm for Hyperspectral and Multispectral Data Fusion , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Xiaoshuai Sun,et al.  Robust ℓ2-Hypergraph and its applications , 2019, Inf. Sci..

[17]  Jim Jing-Yan Wang,et al.  Multiple graph regularized nonnegative matrix factorization , 2013, Pattern Recognit..

[18]  Jonathan J. Hull,et al.  A Database for Handwritten Text Recognition Research , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Sebastian Nowozin,et al.  Image Segmentation UsingHigher-Order Correlation Clustering , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yukihiko Yamashita,et al.  Smooth nonnegative matrix and tensor factorizations for robust multi-way data analysis , 2015, Signal Process..

[22]  Yihong Gong,et al.  Unsupervised Image Categorization by Hypergraph Partition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Anup Basu,et al.  Graph regularized Lp smooth non-negative matrix factorization for data representation , 2019, IEEE/CAA Journal of Automatica Sinica.

[24]  Pietro Perona,et al.  Beyond pairwise clustering , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Meng Wang,et al.  Visual Classification by ℓ1-Hypergraph Modeling , 2015, IEEE Trans. Knowl. Data Eng..

[26]  Jane You,et al.  Image clustering by hyper-graph regularized non-negative matrix factorization , 2014, Neurocomputing.

[27]  Jane You,et al.  Low-rank matrix factorization with multiple Hypergraph regularizer , 2015, Pattern Recognit..

[28]  Haifeng Zhao,et al.  A sparse nonnegative matrix factorization technique for graph matching problems , 2014, Pattern Recognit..

[29]  Václav Šmídl,et al.  Bayesian Non-Negative Matrix Factorization With Adaptive Sparsity and Smoothness Prior , 2019, IEEE Signal Processing Letters.

[30]  Xuelong Li,et al.  Manifold Regularized Sparse NMF for Hyperspectral Unmixing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Thomas S. Huang,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation. , 2011, IEEE transactions on pattern analysis and machine intelligence.

[32]  Qingshan Liu,et al.  Image retrieval via probabilistic hypergraph ranking , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Liangpei Zhang,et al.  Spatial Group Sparsity Regularized Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Gang Hua,et al.  Hyperspectral Image Classification Through Bilayer Graph-Based Learning , 2014, IEEE Transactions on Image Processing.

[35]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[36]  Ahmed M. Elgammal,et al.  Learning Hypergraph-regularized Attribute Predictors , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Shuicheng Yan,et al.  Correntropy Induced L2 Graph for Robust Subspace Clustering , 2013, 2013 IEEE International Conference on Computer Vision.

[38]  Liang-Tien Chia,et al.  Laplacian Sparse Coding, Hypergraph Laplacian Sparse Coding, and Applications , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Zhigang Luo,et al.  Correntropy supervised non-negative matrix factorization , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[40]  Dong Zhou,et al.  Label consistent semi-supervised non-negative matrix factorization for maintenance activities identification , 2016, Eng. Appl. Artif. Intell..

[41]  Xiaoping Min,et al.  Nonnegative matrix factorization with Hessian regularizer , 2018, Pattern Analysis and Applications.

[42]  Qingshan Liu,et al.  Elastic Net Hypergraph Learning for Image Clustering and Semi-Supervised Classification , 2016, IEEE Transactions on Image Processing.

[43]  Li Chen,et al.  Multi-focus image fusion based on non-negative matrix factorization and difference images , 2014, Signal Process..

[44]  Yuanyuan Wang,et al.  Correntropy induced metric based graph regularized non-negative matrix factorization , 2014, Proceedings 2014 IEEE International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[45]  Chun Chen,et al.  Graph Regularized Sparse Coding for Image Representation , 2011, IEEE Transactions on Image Processing.

[46]  Yue Gao,et al.  Correntropy-Induced Robust Low-Rank Hypergraph , 2019, IEEE Transactions on Image Processing.

[47]  Xiaolei Wang,et al.  Non-negative matrix factorization by maximizing correntropy for cancer clustering , 2013, BMC Bioinformatics.

[48]  Zhenyue Zhang,et al.  Low-Rank Matrix Approximation with Manifold Regularization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.