An alternative approach to neural network training based on hybrid bio meta-heuristic algorithm

Metaheuristic algorithms are popular techniques used to solve several optimization problems. Among the key algorithms, cuckoo search (CS) is a comparatively novel and promising metaheuristic algorithm. Various researchers have shown that it performs better when compared to other metaheuristic algorithms while searching for optimal value and is being used to solve various real-world problems. However, the basic CS algorithm can be improved by enhancing the probabilities of survival of the eggs. It will decrease the possibility of the eggs getting ruined by the host bird. The cuckoo birds move to a new position looking for more search space to get better solutions. Furthermore, better search space can be obtained by executing levy flight with accelerated particle swarm optimization (APSO). This research proposes a new method known as hybrid accelerated cuckoo particle swarm optimization (HACPSO) algorithm, based on two metaheuristic algorithms. In the proposed HACPSO algorithm, APSO provides communication for looking better place having the best nest with greater survivability for cuckoo birds. Different simulation has been carried using standard dataset and efficiency of the proposed algorithm is compared with CS, artificial bee colony and other similar hybrid variants. The simulation results demonstrate that the HACPSO algorithm performs better as compared to other algorithms in term of accuracy, MSE, SD, and with fast convergence rate to the target space.

[1]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[2]  Nazri Mohd Nawi,et al.  BPGD-AG: A New Improvement Of Back-Propagation Neural Network Learning Algorithms With Adaptive Gain , 2010 .

[3]  Nazri Mohd Nawi,et al.  A New Back-Propagation Neural Network Optimized with Cuckoo Search Algorithm , 2013, ICCSA.

[4]  Derviş Karaboğa,et al.  NEURAL NETWORKS TRAINING BY ARTIFICIAL BEE COLONY ALGORITHM ON PATTERN CLASSIFICATION , 2009 .

[5]  Nazri Mohd Nawi,et al.  A New Bat Based Back-Propagation (BAT-BP) Algorithm , 2013, ICSS.

[6]  Alberto Tesi,et al.  On the Problem of Local Minima in Backpropagation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Kenneth Morgan,et al.  Modified cuckoo search: A new gradient free optimisation algorithm , 2011 .

[8]  Mohamed Najim,et al.  A fast feedforward training algorithm using a modified form of the standard backpropagation algorithm , 2001, IEEE Trans. Neural Networks.

[9]  Michael R. Lyu,et al.  A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training , 2007, Appl. Math. Comput..

[10]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[11]  Blum,et al.  [IEEE Fifth International Conference on Hybrid Intelligent Systems (HIS\'05) - Rio de Janeiro, Brazil (2005.11.6-2005.11.9)] Fifth International Conference on Hybrid Intelligent Systems (HIS\'05) - Training feed-forward neural networks with ant colony optimization: an application to pattern classifi , 2005 .

[12]  Xin-She Yang,et al.  Engineering Optimization: An Introduction with Metaheuristic Applications , 2010 .

[13]  Rozaida Ghazali,et al.  An Improved Back Propagation Neural Network Algorithm on Classification Problems , 2010, FGIT-DTA/BSBT.

[14]  Jing Peng,et al.  An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories , 1990, Neural Computation.

[15]  Shahram Rahimi,et al.  Soft computing in intrusion detection: the state of the art , 2010, J. Ambient Intell. Humaniz. Comput..

[16]  Randall S. Sexton,et al.  Optimization of neural networks: A comparative analysis of the genetic algorithm and simulated annealing , 1999, Eur. J. Oper. Res..

[17]  Loganathan Agilandeeswari,et al.  An intelligent lung cancer diagnosis system using cuckoo search optimization and support vector machine classifier , 2017, Journal of Ambient Intelligence and Humanized Computing.

[18]  Apichat Heednacram,et al.  Implementation of Cuckoo Search in RBF Neural Network for Flood Forecasting , 2012, 2012 Fourth International Conference on Computational Intelligence, Communication Systems and Networks.

[19]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[20]  M. Tuba,et al.  Performance of a Modified Cuckoo Search Algorithm for Unconstrained Optimization Problems , 2012 .

[21]  Rozaida Ghazali,et al.  The Development of Improved Back-Propagation Neural Networks Algorithm for Predicting Patients with Heart Disease , 2010, ICICA.

[22]  Nazri Mohd Nawi,et al.  The 4 th International Conference on Electrical Engineering and Informatics ( ICEEI 2013 ) A New Levenberg Marquardt Based Back Propagation Algorithm Trained with Cuckoo Search , 2013 .

[23]  Nazri Mohd Nawi,et al.  A New Cuckoo Search Based Levenberg-Marquardt (CSLM) Algorithm , 2013, ICCSA.

[24]  Simon Fong,et al.  Accelerated Particle Swarm Optimization and Support Vector Machine for Business Optimization and Applications , 2011, NDT.

[25]  Xin-She Yang,et al.  Engineering optimisation by cuckoo search , 2010 .

[26]  Ilya Pavlyukevich Lévy flights, non-local search and simulated annealing , 2007, J. Comput. Phys..

[27]  Xinghuo Yu,et al.  A general backpropagation algorithm for feedforward neural networks learning , 2002, IEEE Trans. Neural Networks.

[28]  M. Z. Rehman,et al.  IMPROVING THE ACCURACY OF GRADIENT DESCENT BACK PROPAGATIONALGORITHM (GDAM) ON CLASSIFICATION PROBLEMS , 2011 .

[29]  Christian Blum,et al.  Training feed-forward neural networks with ant colony optimization: an application to pattern classification , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[30]  Jemal H. Abawajy,et al.  Neural Network Training by Hybrid Accelerated Cuckoo Particle Swarm Optimization Algorithm , 2014, ICONIP.