Efficient Data Representation Combining with ELM and GNMF

Nonnegative Matrix Factorization (NMF) is a powerful data representation method, which has been applied in many applications such as dimension reduction, data clustering etc. As the process of NMF needs huge computation cost, especially when the dimensional of data is large. Thus a ELM feature mapping based NMF is proposed [1], which combined Extreme Learning Machine (ELM) feature mapping with NMF (EFM NMF), can reduce the computational of NMF. However, the random parameter generating based ELM feature mapping is nonlinear. And this will lower the representation ability of the subspace generated by NMF without sufficiently constrains. In order to solve this problem, this chapter propose a novel method named Extreme Learning Machine feature mapping based graph regulated NMF (EFM GNMF), which combines ELM feature mapping with Graph Regularized Nonnegative Matrix Factorization (GNMF). Experiments on the COIL20 image library, the CMU PIE face database and TDT2 corpus show the efficiency of the proposed method.

[1]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[2]  Qing He,et al.  Extreme Support Vector Machine Classifier , 2008, PAKDD.

[3]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[4]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[5]  Andrzej Cichocki,et al.  Fast Nonnegative Matrix/Tensor Factorization Based on Low-Rank Approximation , 2012, IEEE Transactions on Signal Processing.

[6]  Anastasios Tefas,et al.  Subclass discriminant Nonnegative Matrix Factorization for facial image analysis , 2012, Pattern Recognit..

[7]  Zhigang Luo,et al.  Non-Negative Patch Alignment Framework , 2011, IEEE Transactions on Neural Networks.

[8]  Xindong Wu,et al.  Nonnegative Matrix Factorization on Orthogonal Subspace , 2010, Pattern Recognit. Lett..

[9]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jiawei Han,et al.  Document clustering using locality preserving indexing , 2005, IEEE Transactions on Knowledge and Data Engineering.

[11]  P. Rossini,et al.  Non-invasive electrical and magnetic stimulation of the brain, spinal cord and roots: basic principles and procedures for routine clinical application. Report of an IFCN committee. , 1994, Electroencephalography and clinical neurophysiology.

[12]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[13]  Stan Z. Li,et al.  Learning spatially localized, parts-based representation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[15]  Fuzhen Zhuang,et al.  Clustering in extreme learning machine feature space , 2014, Neurocomputing.

[16]  Guang-Bin Huang,et al.  Convex incremental extreme learning machine , 2007, Neurocomputing.

[17]  Yu-Jin Zhang,et al.  Nonnegative Matrix Factorization: A Comprehensive Review , 2013, IEEE Transactions on Knowledge and Data Engineering.

[18]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[19]  Xin Liu,et al.  Document clustering based on non-negative matrix factorization , 2003, SIGIR.