Graph Regularized Non-negative Matrix Factorization By Maximizing Correntropy

Non-negative matrix factorization (NMF) has proved effective in many clustering and classification tasks. The classic ways to measure the errors between the original and the reconstructed matrix are $l_2$ distance or Kullback-Leibler (KL) divergence. However, nonlinear cases are not properly handled when we use these error measures. As a consequence, alternative measures based on nonlinear kernels, such as correntropy, are proposed. However, the current correntropy-based NMF only targets on the low-level features without considering the intrinsic geometrical distribution of data. In this paper, we propose a new NMF algorithm that preserves local invariance by adding graph regularization into the process of max-correntropy-based matrix factorization. Meanwhile, each feature can learn corresponding kernel from the data. The experiment results of Caltech101 and Caltech256 show the benefits of such combination against other NMF algorithms for the unsupervised image clustering.

[1]  Honggang Zhang,et al.  Adaptive Learning of Region-based pLSA Model for Total Scene Annotation , 2013, ArXiv.

[2]  Ye Xu,et al.  Unbiased Metric Learning: On the Utilization of Multiple Datasets and Web Images for Softening Bias , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[4]  Michael W. Berry,et al.  Document clustering using nonnegative matrix factorization , 2006, Inf. Process. Manag..

[5]  Zongming Fei,et al.  Broadcasting with Prediction and Selective Forwarding in Vehicular Networks , 2013, Int. J. Distributed Sens. Networks.

[6]  Yin Wang,et al.  Fairness based dynamic channel allocation in wireless mesh networks , 2014, 2014 International Conference on Computing, Networking and Communications (ICNC).

[7]  Yi Wang,et al.  SciMATE: A Novel MapReduce-Like Framework for Multiple Scientific Data Formats , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[8]  Xin Liu,et al.  Document clustering based on non-negative matrix factorization , 2003, SIGIR.

[9]  HeRan,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011 .

[10]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[12]  Qi Hao,et al.  Space encoding based human activity modeling and situation perception , 2013, 2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[13]  D. Perrett,et al.  Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque. , 1994, Cerebral cortex.

[14]  Chris H. Q. Ding,et al.  Orthogonal nonnegative matrix t-factorizations for clustering , 2006, KDD '06.

[15]  CaiDeng,et al.  Constrained Nonnegative Matrix Factorization for Image Representation , 2012 .

[16]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Zhen Qin,et al.  Improving multi-target tracking via social grouping , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Peter Xiang Gao.  Facial age estimation using Clustered Multi-task Support Vector Regression Machine , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[19]  Rayman Preet Singh,et al.  On hourly home peak load prediction , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[20]  Lorenzo Torresani,et al.  Measuring Image Distances via Embedding in a Semantic Manifold , 2012, ECCV.

[21]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[22]  Le Li.  Evaluating Information Retrieval Systems With Multiple Non-Expert Assessors , 2013 .

[23]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[24]  Qi Hao,et al.  Mobile Target Scenario Recognition Via Low-Cost Pyroelectric Sensing System: Toward a Context-Enhanced Accurate Identification , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  HeXiaofei,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2011 .

[26]  Sebastian Nowozin,et al.  On feature combination for multiclass object classification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[27]  Oscar C. Au,et al.  An adaptive unsupervised approach toward pixel clustering and color image segmentation , 2010, Pattern Recognit..

[28]  S. Palmer.  Hierarchical structure in perceptual representation , 1977, Cognitive Psychology.

[29]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[30]  Xiongfei Li,et al.  Image Annotation Refinement Using Dynamic Weighted Voting Based on Mutual Information , 2011, J. Softw..

[31]  Andrew McCallum,et al.  Distributional clustering of words for text classification , 1998, SIGIR '98.

[32]  Shouhuai Xu,et al.  Cross-layer detection of malicious websites , 2013, CODASPY.

[33]  Xiaoming Chen,et al.  Distributed Spectrum-Aware Clustering in Cognitive Radio Sensor Networks , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[34]  Xiaolei Wang,et al.  Non-negative matrix factorization by maximizing correntropy for cancer clustering , 2013, BMC Bioinformatics.

[35]  Stefanos Zafeiriou,et al.  Nonlinear Nonnegative Component Analysis , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Gerard Salton,et al.  Research and Development in Information Retrieval , 1982, Lecture Notes in Computer Science.

[37]  Ju Shen,et al.  Layer Depth Denoising and Completion for Structured-Light RGB-D Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Luo Si,et al.  Non-Negative Matrix Factorization Clustering on Multiple Manifolds , 2010, AAAI.

[39]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[40]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[41]  Alan L. Yuille,et al.  Non-negative matrix factorization of multimodal MRI, fMRI and phenotypic data reveals differential changes in default mode subnetworks in ADHD , 2014, NeuroImage.

[42]  Song Cui,et al.  Interpreting atomic force microscopy measurements of hydrodynamic and surface forces with nonlinear parametric estimation. , 2012, The Review of scientific instruments.

[43]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[44]  Daoqiang Zhang,et al.  Non-negative Matrix Factorization on Kernels , 2006, PRICAI.

[45]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[46]  Xin Gao,et al.  Adaptive graph regularized Nonnegative Matrix Factorization via feature selection , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[47]  Ju Shen,et al.  Virtual Mirror Rendering With Stationary RGB-D Cameras and Stored 3-D Background , 2013, IEEE Transactions on Image Processing.

[48]  Yihong Gong,et al.  Document clustering by concept factorization , 2004, SIGIR '04.

[49]  M. Tarr,et al.  Visual Object Recognition , 1996, ISTCS.

[50]  Yanhui Xiao,et al.  Class-Driven Non-Negative Matrix Factorization for Image Representation , 2013, Journal of Computer Science and Technology.

[51]  Honggang Zhang,et al.  Region-based high-level semantics extraction with CEDD , 2010, 2010 2nd IEEE InternationalConference on Network Infrastructure and Digital Content.

[52]  Zhen Qin,et al.  Social grouping for target handover in multi-view video , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[53]  Peng Wu,et al.  Unsupervised Multi-Level Non-Negative Matrix Factorization Model: Binary Data Case , 2012, J. Information Security.

[54]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[55]  Chih-Jen Lin,et al.  Projected Gradient Methods for Nonnegative Matrix Factorization , 2007, Neural Computation.

[56]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[57]  Srinivasan Keshav,et al.  SPOT: a smart personalized office thermal control system , 2013, e-Energy '13.

[58]  Mark D. Smucker,et al.  Tolerance of Effectiveness Measures to Relevance Judging Errors , 2014, ECIR.

[59]  Jiawei Han,et al.  Non-negative Matrix Factorization on Manifold , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[60]  Xin Liu,et al.  Document clustering with cluster refinement and model selection capabilities , 2002, SIGIR '02.

[61]  Oscar C. Au,et al.  Nonparametric density estimation on a graph: Learning framework, fast approximation and application in image segmentation , 2011, CVPR 2011.

[62]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Michael Lindenbaum,et al.  Nonnegative Matrix Factorization with Earth Mover's Distance Metric for Image Analysis , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  Shifei Ding,et al.  Novel Image Recognition Based on Subspace and SIFT , 2013, J. Softw..

[65]  Li Zhang,et al.  Software Defect Prediction Using Non-Negative Matrix Factorization , 2011, J. Softw..