Co-operation of Biology Related Algorithms meta-heuristic in ANN-based classifiers design

Meta-heuristic called Co-Operation of Biology Related Algorithms (COBRA), that has earlier demonstrated its usefulness on CEC'2013 real-valued optimization competition benchmark, is applied to ANN-based classifiers design. The basic idea consists in representation of ANN's structure as a binary string and the use of the binary modification of COBRA for the ANN's structure selection. Neural network's weight coefficients represented as a string of real-valued variables are adjusted with the original version of COBRA. Four benchmark classification problems (two bank scoring problems and two medical diagnostic problems) are solved with this approach. Multilayered feed-forward ANNs with maximum 5 hidden layers and maximum 5 neurons on each layer are used. It means that ANN's structure optimal selection requires solving an optimization problem with 100 binary variables. Fitness function calculation for each bit string requires solving an optimization problem with up to 225 real-valued variables. Experiments showed that both variants of COBRA demonstrate high performance and reliability in spite of the complexity of solved optimization problems. ANN-based classifiers developed in this way outperform many alternative methods on mentioned benchmark classification problems. The workability and usefulness of proposed meta-heuristic optimization algorithms are confirmed.

[1]  Fevzullah Temurtas,et al.  A comparative study on diabetes disease diagnosis using neural networks , 2009, Expert Syst. Appl..

[2]  Eugene Semenkin,et al.  Co-Operation of Biology Related Algorithms , 2013, 2013 IEEE Congress on Evolutionary Computation.

[3]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[4]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[5]  Joel Quintanilla-Domínguez,et al.  WBCD breast cancer database classification applying artificial metaplasticity neural network , 2011, Expert Syst. Appl..

[6]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[7]  Luca Maria Gambardella,et al.  Flexible, High Performance Convolutional Neural Networks for Image Classification , 2011, IJCAI.

[8]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[9]  E. Semenkin,et al.  NEW OPTIMIZATION METAHEURISTIC BASED ON CO-OPERATION OF BIOLOGY RELATED ALGORITHMS , 2014 .

[10]  Thomas G. Dietterich Machine-Learning Research Four Current Directions , 1997 .

[11]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[12]  Shakhnaz Akhmedova,et al.  Development and investigation of biologically inspired algorithms cooperation metaheuristic , 2013, GECCO '13 Companion.

[13]  Long Wang,et al.  The Crucial Problem of the NSS in the Ecommerce , 2007 .

[14]  Takahiro Sasaki,et al.  Evolving Learnable Neural Networks Under Changing Environments with Various Rates of Inheritance of Acquired Characters: Comparison of Darwinian and Lamarckian Evolution , 1999, Artificial Life.

[15]  Jih-Jeng Huang,et al.  Two-stage genetic programming (2SGP) for the credit scoring model , 2006, Appl. Math. Comput..

[16]  Xuyan Tu,et al.  Algorithm of Marriage in Honey Bees Optimization Based on the Wolf Pack Search , 2007, The 2007 International Conference on Intelligent Pervasive Computing (IPC 2007).