Neural Network Training by Hybrid Accelerated Cuckoo Particle Swarm Optimization Algorithm

Metaheuristic algorithm is one of the most popular methods in solving many optimization problems. This paper presents a new hybrid approach comprising of two natures inspired metaheuristic algorithms i.e. Cuckoo Search (CS) and Accelerated Particle Swarm Optimization (APSO) for training Artificial Neural Networks (ANN). In order to increase the probability of the egg’s survival, the cuckoo bird migrates by traversing more search space. It can successfully search better solutions by performing levy flight with APSO. In the proposed Hybrid Accelerated Cuckoo Particle Swarm Optimization (HACPSO) algorithm, the communication ability for the cuckoo birds have been provided by APSO, thus making cuckoo bird capable of searching for the best nest with better solution. Experimental results are carried-out on benchmarked datasets, and the performance of the proposed hybrid algorithm is compared with Artificial Bee Colony (ABC) and similar hybrid variants. The results show that the proposed HACPSO algorithm performs better than other algorithms in terms of convergence and accuracy.

[1]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[2]  David Taniar,et al.  Computational Science and Its Applications – ICCSA 2013 , 2013, Lecture Notes in Computer Science.

[3]  Nazri Mohd Nawi,et al.  A New Back-Propagation Neural Network Optimized with Cuckoo Search Algorithm , 2013, ICCSA.

[4]  Alberto Tesi,et al.  On the Problem of Local Minima in Backpropagation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Xin-She Yang,et al.  Engineering Optimization: An Introduction with Metaheuristic Applications , 2010 .

[6]  Xinghuo Yu,et al.  A general backpropagation algorithm for feedforward neural networks learning , 2002, IEEE Trans. Neural Networks.

[7]  Michael R. Lyu,et al.  A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training , 2007, Appl. Math. Comput..

[8]  Rozaida Ghazali,et al.  An Improved Back Propagation Neural Network Algorithm on Classification Problems , 2010, FGIT-DTA/BSBT.

[9]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[10]  Nazri Mohd Nawi,et al.  The 4 th International Conference on Electrical Engineering and Informatics ( ICEEI 2013 ) A New Levenberg Marquardt Based Back Propagation Algorithm Trained with Cuckoo Search , 2013 .

[11]  Nazri Mohd Nawi,et al.  A New Cuckoo Search Based Levenberg-Marquardt (CSLM) Algorithm , 2013, ICCSA.

[12]  Simon Fong,et al.  Accelerated Particle Swarm Optimization and Support Vector Machine for Business Optimization and Applications , 2011, NDT.

[13]  Maode Ma,et al.  Information Computing and Applications - First International Conference, ICICA 2010, Tangshan, China, October 15-18, 2010. Proceedings , 2010, ICICA.

[14]  M. Tuba,et al.  Modified cuckoo search algorithm for unconstrained optimization problems , 2011 .

[15]  Xin-She Yang,et al.  Engineering optimisation by cuckoo search , 2010 .

[16]  Nazri Mohd Nawi,et al.  A New Bat Based Back-Propagation (BAT-BP) Algorithm , 2013, ICSS.

[17]  Nazri Mohd Nawi,et al.  BPGD-AG: A New Improvement Of Back-Propagation Neural Network Learning Algorithms With Adaptive Gain , 2010 .

[18]  Kenneth Morgan,et al.  Modified cuckoo search: A new gradient free optimisation algorithm , 2011 .

[19]  Rozaida Ghazali,et al.  The Development of Improved Back-Propagation Neural Networks Algorithm for Predicting Patients with Heart Disease , 2010, ICICA.

[20]  M. Z. Rehman,et al.  IMPROVING THE ACCURACY OF GRADIENT DESCENT BACK PROPAGATIONALGORITHM (GDAM) ON CLASSIFICATION PROBLEMS , 2011 .

[21]  Christian Blum,et al.  Training feed-forward neural networks with ant colony optimization: an application to pattern classification , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[22]  Randall S. Sexton,et al.  Optimization of neural networks: A comparative analysis of the genetic algorithm and simulated annealing , 1999, Eur. J. Oper. Res..

[23]  Mohamed Najim,et al.  A fast feedforward training algorithm using a modified form of the standard backpropagation algorithm , 2001, IEEE Trans. Neural Networks.

[24]  Jakub M. Tomczak,et al.  Advances in Systems Science , 2014 .