A new approach to find optimum architecture of ANN and tuning it's weights using krill-herd algorithm

Data classification is an important branch of data mining and there are different methods for its implementation. Neural networks are one of the best ways for classification in machine learning. Structure and weights of neural network are most important in their precision. In recent years, due to the defects in gradient-based search algorithms in neural network training algorithms, metahuristic algorithms have been of interest for researchers. Due to the random nature of these algorithms, the defects of trapped in local minimum can be largely resolved but Since training the weights of the neural network was done on specific network architecture, there were no guarantees for selecting the best architecture. So, in our work krill herd algorithm was used to improve the structure addition of network weights. Task of optimizing the network structure was on the three components of this algorithm (movement induced by the other krill, random diffusion, and foraging motion) along with a genetic operator; also dimensions of krill showed the desired structure for the neural network In this paper, the performance of the proposed method was tested on five UCI data sets and the results compared with the previous methods showed that the classification accuracy of the proposed method was considerably higher and the mean square error was low.

[1]  Diptam Dutta,et al.  Training Artificial Neural Network using Particle Swarm Optimization Algorithm , 2013 .

[2]  Michael R. Lyu,et al.  A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training , 2007, Appl. Math. Comput..

[3]  Yoav Freund,et al.  The Alternating Decision Tree Learning Algorithm , 1999, ICML.

[4]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .

[5]  B.M. Wilamowski,et al.  Neural network architectures and learning algorithms , 2009, IEEE Industrial Electronics Magazine.

[6]  Sebastián Ventura,et al.  Multi-Objective Ant Programming for Mining Classification Rules , 2012, EuroGP.

[7]  Yu-Jun Zheng,et al.  Population Classification in Fire Evacuation: A Multiobjective Particle Swarm Optimization Approach , 2014, IEEE Transactions on Evolutionary Computation.

[8]  Mohammad Saniee Abadeh,et al.  Training artificial neural network by krill-herd algorithm , 2014, 2014 IEEE 7th Joint International Information Technology and Artificial Intelligence Conference.

[9]  D. N. Ranasinghe,et al.  Adaptive Structural Optimisation of Neural Networks , 2009 .

[10]  Khulood AlYahya,et al.  Artificial Bee Colony Training of Neural Networks , 2013, NICSO.

[11]  Rafi L. Muhanna,et al.  A Particle Swarm Optimization Approach for Training Artificial Neural Networkswith Uncertain Data , 2012 .

[12]  Aurora Trinidad Ramirez Pozo,et al.  Multiple objective particle swarm for classification-rule discovery , 2007, 2007 IEEE Congress on Evolutionary Computation.

[13]  Prasant Kumar Pattnaik,et al.  Artificial Neural Network trained by Particle Swarm Optimization for non-linear channel equalization , 2014, Expert Syst. Appl..

[14]  Hong Ding,et al.  Evolving Neural Network Using Hybrid Genetic Algorithm and Simulated Annealing for Rainfall-Runoff Forecasting , 2012, ICSI.

[15]  Rajib Mall,et al.  Application of elitist multi-objective genetic algorithm for classification rule generation , 2008, Appl. Soft Comput..