Extreme Learning Machines for Data Classification Tuning by Improved Bat Algorithm

Single hidden layer feed forward neural networks are widely used for various practical problems. However, the training process for determining synaptic weights of such neural networks can be computationally very expensive. In this paper we propose a new learning algorithm for learning the synaptic weights of the single hidden layer feedforward neural networks in order to reduce the learning time. We propose combining the upgraded bat algorithm with the extreme learning machine. The proposed approach reduces the number of evaluations needed to train a neural network and efficiently finds optimal input weights and the hidden biases. The proposed algorithm was tested on standard benchmark classification problems and functions and compared with other approaches from literature. The results have shown that our approach produces a satisfactory performance in almost all cases and that it can obtains solutions much faster than the traditional learning algorithms.

[1]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[2]  Milan Tuba,et al.  Multilevel image thresholding using elephant herding optimization algorithm , 2017, 2017 14th International Conference on Engineering of Modern Electric Systems (EMES).

[3]  Hongming Yang,et al.  Extreme learning machine based genetic algorithm and its application in power system economic dispatch , 2013, Neurocomputing.

[4]  Zhenxing Qian,et al.  Evolutionary selection extreme learning machine optimization for regression , 2012, Soft Comput..

[5]  A.H. Nizar,et al.  Power Utility Nontechnical Loss Analysis With Extreme Learning Machine Method , 2008, IEEE Transactions on Power Systems.

[6]  Guang-Bin Huang,et al.  Classification ability of single hidden layer feedforward neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[7]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[8]  Weiping Zhang,et al.  Tuning extreme learning machine by an improved artificial bee colony to model and optimize the boiler efficiency , 2014, Knowl. Based Syst..

[9]  De-Shuang Huang,et al.  Improved extreme learning machine for function approximation by encoding a priori information , 2006, Neurocomputing.

[10]  Carlos Henggeler Antunes,et al.  Learning of a single-hidden layer feedforward neural network using an optimized extreme learning machine , 2014, Neurocomputing.

[11]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[12]  Yuan Lan,et al.  Ensemble of online sequential extreme learning machine , 2009, Neurocomputing.

[13]  Dong Sun Park,et al.  Online sequential extreme learning machine with forgetting mechanism , 2012, Neurocomputing.

[14]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[15]  A. Kai Qin,et al.  Evolutionary extreme learning machine , 2005, Pattern Recognit..

[16]  Hongming Zhou,et al.  Face Recognition Based on Kernelized Extreme Learning Machine , 2011, AIS.

[17]  Jianhua Yang,et al.  Genetic ensemble of extreme learning machine , 2014, Neurocomputing.

[18]  Pierre Courrieu,et al.  Straight monotonic embedding of data sets in Euclidean spaces , 2002, Neural Networks.

[19]  R. Venkatesh Babu,et al.  No-reference image quality assessment using modified extreme learning machine classifier , 2009, Appl. Soft Comput..

[20]  Milan Tuba,et al.  Unmanned aerial vehicle path planning problem by adjusted elephant herding optimization , 2017, 2017 25th Telecommunication Forum (TELFOR).

[21]  Milan Tuba,et al.  Adjusted Fireworks Algorithm Applied to Retinal Image Registration , 2017 .

[22]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[23]  Teresa Bernarda Ludermir,et al.  Investigating the use of alternative topologies on performance of the PSO-ELM , 2014, Neurocomputing.

[24]  Hak-Keung Lam,et al.  Tuning of the structure and parameters of a neural network using an improved genetic algorithm , 2003, IEEE Trans. Neural Networks.

[25]  Zhiping Lin,et al.  Self-Adaptive Evolutionary Extreme Learning Machine , 2012, Neural Processing Letters.

[26]  Milan Tuba,et al.  Adjusted bat algorithm for tuning of support vector machine parameters , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[27]  D. Serre Matrices: Theory and Applications , 2002 .

[28]  Milan Tuba,et al.  Unmanned Combat Aerial Vehicle Path Planning by Brain Storm Optimization Algorithm , 2018 .

[29]  Sundaram Suresh,et al.  Performance enhancement of extreme learning machine for multi-category sparse data classification problems , 2010, Eng. Appl. Artif. Intell..

[30]  José Luis López-Bonilla,et al.  On the Moore-Penrose generalized inverse matrix , 2018 .

[31]  Xin-She Yang,et al.  Efficiency Analysis of Swarm Intelligence and Randomization Techniques , 2012, 1303.6342.

[32]  Milan Tuba,et al.  JPEG Quantization Table Optimization by Guided Fireworks Algorithm , 2017, IWCIA.

[33]  Yang Shu,et al.  Evolutionary Extreme Learning Machine : Based on Particle Swarm Optimization , 2006 .

[34]  Zhihong Man,et al.  On improving the conditioning of extreme learning machine: A linear case , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[35]  Milan Tuba,et al.  Hybridized bat algorithm for multi-objective radio frequency identification (RFID) network planning , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[36]  Guang-Bin Huang,et al.  Convex incremental extreme learning machine , 2007, Neurocomputing.

[37]  Milan Tuba,et al.  Handwritten digit recognition by support vector machine optimized by Bat algorithm , 2016 .

[38]  Milan Tuba,et al.  An algorithm for automated segmentation for bleeding detection in endoscopic images , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).