A Factorized Extreme Learning Machine and Its Applications in EEG-Based Emotion Recognition

Extreme learning machine (ELM) is an efficient learning algorithm for single hidden layer feed forward neural networks. Its main feature is the random generation of the hidden layer weights and biases and then we only need to determine the output weights in model learning. However, the random mapping in ELM impairs the discriminative information of data to certain extent, which brings side effects for the output weight matrix to well capture the essential data properties. In this paper, we propose a factorized extreme learning machine (FELM) by incorporating another hidden layer between the ELM hidden layer and the output layer. Mathematically, the original output matrix is factorized so as to effectively explore the structured discriminative information of data. That is, we constrain the group sparsity of data representation in the new hidden layer, which will be further projected to the output layer. An efficient learning algorithm is proposed to optimize the objective of the proposed FELM model. Extensive experiments on EEG-based emotion recognition show the effectiveness of FELM.

[1]  W. Zhang,et al.  Fuzzy extreme learning machine for classification , 2013 .

[2]  Yong Peng,et al.  Discriminative extreme learning machine with supervised sparsity preserving for image classification , 2017, Neurocomputing.

[3]  Punyaphol Horata,et al.  Robust extreme learning machine , 2013, Neurocomputing.

[4]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Bao-Liang Lu,et al.  Differential entropy feature for EEG-based emotion classification , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[6]  Ruimin Shen,et al.  Sparse Group Restricted Boltzmann Machines , 2010, AAAI.

[7]  Guang-Bin Huang,et al.  Learning to Rank with Extreme Learning Machine , 2013, Neural Processing Letters.

[8]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[9]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[10]  Bao-Liang Lu,et al.  EEG-based vigilance estimation using extreme learning machines , 2013, Neurocomputing.

[11]  Yong Peng,et al.  EEG-based emotion recognition with manifold regularized extreme learning machine , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Chee Kheong Siew,et al.  Incremental extreme learning machine with fully complex hidden nodes , 2008, Neurocomputing.