A New Bat Based Back-Propagation (BAT-BP) Algorithm

Metaheuristic algorithm such as BAT algorithm is becoming a popular method in solving many hard optimization problems. This paper investigates the use of Bat algorithm in combination with Back-propagation neural network (BPNN) algorithm to solve the local minima problem in gradient descent trajectory and to increase the convergence rate. The performance of the proposed Bat based Back-Propagation (Bat-BP) algorithm is compared with Artificial Bee Colony using BPNN algorithm (ABC-BP) and simple BPNN algorithm. Specifically, OR and XOR datasets are used for training the network. The simulation results show that the computational efficiency of BPNN training process is highly enhanced when combined with BAT algorithm.

[1]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[2]  Dervis Karaboga,et al.  Artificial Bee Colony (ABC) Optimization Algorithm for Training Feed-Forward Neural Networks , 2007, MDAI.

[3]  Nazri Mohd Nawi,et al.  Noise-Induced Hearing Loss Prediction in Malaysian Industrial Workers using Gradient Descent with Adaptive Momentum Algorithm , 2011 .

[4]  Wen-Chin Chen,et al.  Back-propagation neural network based importance-performance analysis for determining critical service attributes , 2008, Expert Syst. Appl..

[5]  Germán Terrazas,et al.  Nature Inspired Cooperative Strategies for Optimization, NICSO 2010, May 12-14, 2010, Granada, Spain , 2012, NISCO.

[6]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[7]  Xin Yao,et al.  Evolutionary Artificial Neural Networks , 1993, Int. J. Neural Syst..

[8]  Ben Coppin,et al.  Artificial Intelligence Illuminated , 2004 .

[9]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[10]  Achintya Das,et al.  Training a Feed-forward Neural Network with Artificial Bee Colony Based Backpropagation Method , 2012, ArXiv.

[11]  Li Cheng,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010 .

[12]  Tsung-Lin Lee,et al.  Back-propagation neural network for the prediction of the short-term storm surge in Taichung harbor, Taiwan , 2008, Eng. Appl. Artif. Intell..

[13]  Nazri Mohd Nawi,et al.  An Improved Conjugate Gradient Based Learning Algorithm for Back Propagation Neural Networks , 2008 .

[14]  Nazri Mohd Nawi,et al.  The Effect of Adaptive Momentum in Improving the Accuracy of Gradient Descent Back Propagation Algorithm on Classification Problems , 2012, ICSECS.

[15]  David Levy,et al.  Book review: Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence by Bart Kosko (Prentice Hall 1992) , 1992, CARN.

[16]  Paulo Cortez,et al.  Particle swarms for feedforward neural network training , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[17]  Vladimir M. Krasnopolsky,et al.  Some neural network applications in environmental sciences. Part II: advancing computational efficiency of environmental numerical models , 2003, Neural Networks.

[18]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[19]  I A Basheer,et al.  Artificial neural networks: fundamentals, computing, design, and application. , 2000, Journal of microbiological methods.

[20]  Mohd Imran Ghazali,et al.  PREDICTING NOISE-INDUCED HEARING LOSS (NIHL) AND HEARING DETERIORATION INDEX (HDI) IN MALAYSIAN INDUSTRIAL WORKERS USING GDAM ALGORITHM , 2012 .

[21]  David E. Booth,et al.  A comparison of supervised and unsupervised neural networks in predicting bankruptcy of Korean firms , 2005, Expert Syst. Appl..