A Honey Bee Mating Optimization Based Gradient Descent Learning – FLANN (HBMO-GDL-FLANN) for Classification

Motivated from successful use of the Honey Bee Mating Optimization (HMBO) in many applications, in this paper, a HMBO based Gradient Descent Learning for FLANN classifier is proposed and compared with FLANN, GA based FLANN and PSO based FLANN classifiers. The proposed method mimics the iterative mating process of honey bees and strategies to select eligible drones for mating process, for selection of best weights for FLANN classifiers. The classification accuracy of HMBO-GDL-FLANN is investigated and compared with FLANN, GA-based FLANN and PSO-based FLANN. These models have been implemented using MATLAB and results are statistically analyzed under one way ANOVA test. To obtain generalized performance, the proposed method has been tested under 5-fold cross validation.

[1]  D. Pham,et al.  THE BEES ALGORITHM, A NOVEL TOOL FOR COMPLEX OPTIMISATION PROBLEMS , 2006 .

[2]  Sung-Bae Cho,et al.  A comprehensive survey on functional link neural networks and an adaptive PSO–BP learning for CFLNN , 2010, Neural Computing and Applications.

[3]  Ali Maroosi,et al.  Application of honey-bee mating optimization algorithm on clustering , 2007, Appl. Math. Comput..

[4]  José R. Álvarez,et al.  Artificial Intelligence and Knowledge Engineering Applications: A Bioinspired Approach: First International Work-Conference on the Interplay Between Natural and Artificial Computation, IWINAC 2005, Las Palmas, Canary Islands, Spain, June 15-18, 2005, Proceedings, Part II , 2005, IWINAC.

[5]  Jagdish Chandra Patra,et al.  Computationally efficient FLANN-based intelligent stock price prediction system , 2009, 2009 International Joint Conference on Neural Networks.

[6]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[7]  Alberto Prieto,et al.  Computational intelligence and bioinspired systems , 2007, Neurocomputing.

[8]  Y. Marinakis,et al.  Honey Bees Mating Optimization for the location routing problem , 2008, 2008 IEEE International Engineering Management Conference.

[9]  Sreejit Chakravarty,et al.  Forecasting stock market indices using hybrid network , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[10]  Sung-Bae Cho,et al.  Genetic Feature Selection for Optimal Functional Link Artificial Neural Network in Classification , 2008, IDEAL.

[11]  Magdalene Marinaki,et al.  A Hybrid Clustering Algorithm Based on Honey Bees Mating Optimization and Greedy Randomized Adaptive Search Procedure , 2008, LION.

[12]  Jagdish Chandra Patra,et al.  Functional Link Artificial Neural Network-based disease gene prediction , 2009, 2009 International Joint Conference on Neural Networks.

[13]  Georgios Dounias,et al.  Honey Bees Mating Optimization algorithm for large scale vehicle routing problems , 2010, Natural Computing.

[14]  Sung-Bae Cho,et al.  An improved swarm optimized functional link artificial neural network (ISO-FLANN) for classification , 2012, J. Syst. Softw..

[15]  Hussein A. Abbass,et al.  MBO: marriage in honey bees optimization-a Haplometrosis polygynous swarming approach , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[16]  Magdalene Marinaki,et al.  A hybrid Honey Bees Mating Optimization algorithm for the Probabilistic Traveling Salesman Problem , 2009, 2009 IEEE Congress on Evolutionary Computation.

[17]  Ganapati Panda,et al.  Classification of Consumer Behavior Using Functional Link Artificial Neural Network , 2010, 2010 International Conference on Advances in Computer Engineering.

[18]  Magdalene Marinaki,et al.  Honey Bees Mating Optimization algorithm for financial classification problems , 2010, Appl. Soft Comput..

[19]  B. B. Misra,et al.  Index prediction with neuro-genetic hybrid network: A comparative analysis of performance , 2012, 2012 International Conference on Computing, Communication and Applications.

[20]  Ataollah Ebrahimzadeh,et al.  A novel technique for blind source separation using bees colony algorithm and efficient cost functions , 2014, Swarm Evol. Comput..

[21]  Hussein A. Abbass,et al.  A Monogenous MBO Approach to Satisfiability , 2001 .

[22]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[23]  Y. Takefuji,et al.  Functional-link net computing: theory, system architecture, and functionalities , 1992, Computer.

[24]  F. Mili,et al.  A comparative study of expansion functions for evolutionary hybrid functional link artificial neural networks for data mining and classification , 2013, 2013 International Conference on Computer Applications Technology (ICCAT).

[25]  Ahmad Mozaffari,et al.  Comprehensive preference optimization of an irreversible thermal engine using pareto based mutable smart bee algorithm and generalized regression neural network , 2013, Swarm Evol. Comput..

[26]  Srikanta Patnaik,et al.  An enhanced classifier fusion model for classifying biomedical data , 2012, Int. J. Comput. Vis. Robotics.

[27]  Yue Zhang,et al.  BeeHive: An Efficient Fault-Tolerant Routing Algorithm Inspired by Honey Bee Behavior , 2004, ANTS Workshop.

[28]  Himansu Sekhar Behera,et al.  A Novel FLANN with a Hybrid PSO and GA Based Gradient Descent Learning for Classification , 2014, FICTA.

[29]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[30]  B. B. Misra,et al.  Functional Link Artificial Neural Network for Classification Task in Data Mining , 2007 .

[31]  Babita Majhi,et al.  Reduced Feature Based Efficient Cancer Classification Using Single Layer Neural Network , 2012 .

[32]  Thomas Stützle,et al.  Ant Colony Optimization and Swarm Intelligence , 2008 .

[33]  Jonathan Timmis,et al.  Artificial Immune Systems: A New Computational Intelligence Approach , 2003 .

[34]  Barry J. Adams,et al.  Honey-bee mating optimization (HBMO) algorithm for optimal reservoir operation , 2007, J. Frankl. Inst..

[35]  Jagdish Chandra Patra,et al.  Financial Prediction of Major Indices using Computational Efficient Artificial Neural Networks , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[36]  Ahmad Mozaffari,et al.  Optimal design of classic Atkinson engine with dynamic specific heat using adaptive neuro-fuzzy inference system and mutable smart bee algorithm , 2013, Swarm Evol. Comput..

[37]  Omid Bozorg Haddad,et al.  Honey-Bees Mating Optimization (HBMO) Algorithm: A New Heuristic Approach for Water Resources Optimization , 2006 .

[38]  Xin-She Yang,et al.  Engineering Optimizations via Nature-Inspired Virtual Bee Algorithms , 2005, IWINAC.

[39]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[40]  P. K. Dash,et al.  Forecasting and classification of Indian stocks using different polynomial functional link artificial neural networks , 2012, 2012 Annual IEEE India Conference (INDICON).

[41]  Jesús Alcalá-Fdez,et al.  KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework , 2011, J. Multiple Valued Log. Soft Comput..

[42]  Habiba Drias,et al.  Cooperative Bees Swarm for Solving the Maximum Weighted Satisfiability Problem , 2005, IWANN.

[43]  Giuseppe Nicosia,et al.  Nature Inspired Cooperative Strategies for Optimization (NICSO 2007) (Studies in Computational Intelligence) (Studies in Computational Intelligence) XXXX , 2008 .

[44]  Debahuti Mishra,et al.  A New Meta-heuristic Bat Inspired Classification Approach for Microarray Data , 2012 .

[45]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[46]  Georgios Dounias,et al.  Honey Bees Mating Optimization Algorithm for the Vehicle Routing Problem , 2007, NICSO.

[47]  H A Abbass,et al.  MARRIAGE IN HONEY-BEE OPTIMIZATION (MBO): A HAPLOMETROSIS POLYGYNOUS SWARMING APPROACH , 2001 .