Ensembling Extreme Learning Machines

Extreme learning machine (ELM) is a novel learning algorithm much faster than the traditional gradient-based learning algorithms for single-hidden-layer feedforward neural networks (SLFNs). Neural network ensemble is a learning paradigm where several neural networks are jointly used to solve a problem. In our work, we investigated the performance of ELMs ensemble on regression problems. A simple ensembling approach Product Index based Excluding ensemble(PIEx) was proposed to ensemble accurate and diverse member networks. The experimental results show that the ensemble can effectively improve the performance compared with the generalization ability of single ELM and PIEx outperforms Bagging and Simple Averaging. The results also show ELM training can generate diverse neural networks even though using the same training set.