Novel Back Propagation Optimization by Cuckoo Search Algorithm

The traditional Back Propagation (BP) has some significant disadvantages, such as training too slowly, easiness to fall into local minima, and sensitivity of the initial weights and bias. In order to overcome these shortcomings, an improved BP network that is optimized by Cuckoo Search (CS), called CSBP, is proposed in this paper. In CSBP, CS is used to simultaneously optimize the initial weights and bias of BP network. Wine data is adopted to study the prediction performance of CSBP, and the proposed method is compared with the basic BP and the General Regression Neural Network (GRNN). Moreover, the parameter study of CSBP is conducted in order to make the CSBP implement in the best way.

[1]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[2]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[3]  Ibrahim Eksin,et al.  A new optimization method: Big Bang-Big Crunch , 2006, Adv. Eng. Softw..

[4]  Guang-Bin Huang,et al.  Convex incremental extreme learning machine , 2007, Neurocomputing.

[5]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[6]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[7]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[8]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[9]  A. Kaveh,et al.  Size optimization of space trusses using Big Bang-Big Crunch algorithm , 2009 .

[10]  Siamak Talatahari,et al.  Optimal design of Schwedler and ribbed domes via hybrid Big Bang–Big Crunch algorithm , 2010 .

[11]  Xin-She Yang,et al.  Engineering optimisation by cuckoo search , 2010, Int. J. Math. Model. Numer. Optimisation.

[12]  Xin-She Yang,et al.  Firefly algorithm, stochastic test functions and design optimisation , 2010, Int. J. Bio Inspired Comput..

[13]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[14]  A. Kaveh,et al.  A novel heuristic optimization method: charged system search , 2010 .

[15]  A. Kaveh,et al.  A DISCRETE BIG BANG - BIG CRUNCH ALGORITHM FOR OPTIMAL DESIGN OF SKELETAL STRUCTURES , 2010 .

[16]  Amir Hossein Gandomi,et al.  Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems , 2011, Engineering with Computers.

[17]  Fu-Ding Xie,et al.  Image segmentation using PSO and PCM with Mahalanobis distance , 2011, Expert Syst. Appl..

[18]  A. Gandomi,et al.  Mixed variable structural optimization using Firefly Algorithm , 2011 .

[19]  Minghao Yin,et al.  Application of Differential Evolution Algorithm on Self-Potential Data , 2012, PloS one.

[20]  Rajesh Kumar,et al.  An Intelligent Tuned Harmony Search algorithm for optimisation , 2012, Inf. Sci..

[21]  Siti Zaiton Mohd Hashim,et al.  Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm , 2012, Appl. Math. Comput..

[22]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .

[23]  Amir Hossein Gandomi,et al.  Firefly Algorithm for solving non-convex economic dispatch problems with valve loading effect , 2012, Appl. Soft Comput..

[24]  Liping Xie,et al.  Selection strategies for gravitational constant G in artificial physics optimisation based on analysis of convergence properties , 2012, Int. J. Bio Inspired Comput..

[25]  R. J. Kuo,et al.  Integration of particle swarm optimization and genetic algorithm for dynamic clustering , 2012, Inf. Sci..

[26]  Amir Hossein Gandomi,et al.  A multi-stage particle swarm for optimum design of truss structures , 2013, Neural Computing and Applications.

[27]  Xin-She Yang,et al.  Bat algorithm: a novel approach for global engineering optimization , 2012, 1211.6663.

[28]  Gaige Wang,et al.  Incorporating mutation scheme into krill herd algorithm for global numerical optimization , 2014, Neural Computing and Applications.

[29]  Amir Hossein Gandomi,et al.  Bat algorithm for constrained optimization tasks , 2012, Neural Computing and Applications.

[30]  Ying Tan,et al.  Light responsive curve selection for photosynthesis operator of APOA , 2012, Int. J. Bio Inspired Comput..

[31]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[32]  Xin-She Yang,et al.  Cuckoo search: recent advances and applications , 2013, Neural Computing and Applications.

[33]  Gai-Ge Wang,et al.  An Effective Hybrid Firefly Algorithm with Harmony Search for Global Numerical Optimization , 2013, TheScientificWorldJournal.

[34]  Minghao Yin,et al.  Multiobjective Binary Biogeography Based Optimization for Feature Selection Using Gene Expression Data , 2013, IEEE Transactions on NanoBioscience.

[35]  Gaige Wang,et al.  Wavelet Neural Network Using Multiple Wavelet Functions in Target Threat Assessment , 2013, TheScientificWorldJournal.

[36]  Luo Liu,et al.  Hybridizing harmony search with biogeography based optimization for global numerical optimization , 2013 .

[37]  Minghao Yin,et al.  Animal migration optimization: an optimization algorithm inspired by animal migration behavior , 2014, Neural Computing and Applications.

[38]  Amir Hossein Gandomi,et al.  A chaotic particle-swarm krill herd algorithm for global numerical optimization , 2013, Kybernetes.

[39]  Amir Hossein Gandomi,et al.  Hybrid krill herd algorithm with differential evolution for global numerical optimization , 2014, Neural Computing and Applications.

[40]  Xiangtao Li,et al.  An opposition-based differential evolution algorithm for permutation flow shop scheduling based on diversity measure , 2013, Adv. Eng. Softw..

[41]  Xin-She Yang,et al.  Swarm Intelligence and Bio-Inspired Computation , 2013 .

[42]  Xin-She Yang,et al.  Binary bat algorithm , 2013, Neural Computing and Applications.

[43]  Felipe Trujillo-Romero,et al.  Generation of neural networks using a genetic algorithm approach , 2013, Int. J. Bio Inspired Comput..

[44]  S. Gholizadeh,et al.  Shape optimization of structures for frequency constraints by sequential harmony search algorithm , 2013 .

[45]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[46]  Amir Hossein Gandomi,et al.  Stud krill herd algorithm , 2014, Neurocomputing.

[47]  Amir Hossein Alavi,et al.  An effective krill herd algorithm with migration operator in biogeography-based optimization , 2014 .

[48]  Andrew Lewis,et al.  Let a biogeography-based optimizer train your Multi-Layer Perceptron , 2014, Inf. Sci..

[49]  Xin-She Yang,et al.  Flower pollination algorithm: A novel approach for multiobjective optimization , 2014, ArXiv.

[50]  Gai-Ge Wang,et al.  A New Improved Firefly Algorithm for Global Numerical Optimization , 2014 .