Bees Algorithm : theory, improvements and applications

In this thesis, a new population-based search algorithm called the Bees Algorithm (BA) is presented. The algorithm mimics the food foraging behaviour of swarms of honey bees. In its basic version, the algorithm performs a kind of neighbourhood search combined with random search and can be used for both combinatorial and functional optimisation. In the context of this thesis both domains are considered. Following a description of the algorithm, the thesis gives the results obtained for a number of complex problems demonstrating the efficiency and robustness of the new algorithm. Enhancements of the Bees Algorithm are also presented. Several additional features are considered to improve the efficiency of the algorithm. Dynamic recruitment, proportional shrinking and site abandonment strategies are presented. An additional feature is an evaluation of several different functions and of the performance of the algorithm compared with some other well-known algorithms, including genetic algorithms and simulated annealing. The Bees Algorithm can be applied to many complex optimisations problems including multi-layer perceptrons, neural networks training for statistical process control and the identification of wood defects in wood veneer sheets. Also, the algorithm can be used to design 2D electronic recursive filters, to show its potential in electronics applications. A new structure is proposed so that the algorithm can work in combinatorial domains. In addition, several applications are presented to show the robustness of the algorithm in various conditions. Also, some minor modifications are proposed for representations of the problems since it was originally developed for continuous domains. In the final part, a new algorithm is introduced as a successor to the original algorithm. A new neighbourhood structure called Gaussian patch is proposed to reduce the complexity of the algorithm as well as increasing its efficiency. The performance of the algorithm is tested by use on several multi-model complex optimisation problems and this is compared to the performance of some well-known algorithms.

[1]  M. Dorigo,et al.  The Ant Colony Optimization MetaHeuristic 1 , 1999 .

[2]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[3]  Ian C. Parmee,et al.  The Ant Colony Metaphor for Searching Continuous Design Spaces , 1995, Evolutionary Computing, AISB Workshop.

[4]  M. Simon Probability distributions involving Gaussian random variables : a handbook for engineers and scientists , 2002 .

[5]  Sung Hoon Jung,et al.  Queen-bee evolution for genetic algorithms , 2003 .

[6]  Horst F. Wedde,et al.  BeeAdHoc: an energy efficient routing algorithm for mobile ad hoc networks inspired by bee behavior , 2005, GECCO '05.

[7]  T. Seeley,et al.  Deciding on a new home: how do honeybees agree? , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[8]  T. Seeley,et al.  Modeling and analysis of nest-site selection by honeybee swarms: the speed and accuracy trade-off , 2005, Behavioral Ecology and Sociobiology.

[9]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[10]  Ercan Oztemel,et al.  Control chart pattern recognition using neural networks , 1992 .

[11]  LI Shi-jie A Discrete Particle Swarm Optimization for TSP , 2008 .

[12]  Nikos E. Mastorakis,et al.  Design of two-dimensional recursive filters by using neural networks , 2001, IEEE Trans. Neural Networks.

[13]  Chandrasekharan Rajendran,et al.  Ant-colony algorithms for permutation flowshop scheduling to minimize makespan/total flowtime of jobs , 2004, Eur. J. Oper. Res..

[14]  Craig A. Tovey,et al.  The Pattern and Effectiveness of Forager Allocation Among Flower Patches by Honey Bee Colonies , 1993 .

[15]  Zne-Jung Lee,et al.  An Intelligent Algorithm for Scheduling Jobs on a Single Machine with a Common Due Date , 2007, KES.

[16]  Nancy Lea Hyer,et al.  Research issues in cellular manufacturing , 1987 .

[17]  Yves Crama,et al.  Local Search in Combinatorial Optimization , 2018, Artificial Neural Networks.

[18]  Israel A. Wagner,et al.  Discrete bee dance algorithm for pattern formation on a grid , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[19]  A. Kan Machine Scheduling Problems: Classification, Complexity and Computations , 1976 .

[20]  E. Nowicki,et al.  A Fast Taboo Search Algorithm for the Job Shop Problem , 1996 .

[21]  Duc Truong Pham,et al.  Unsupervised adaptive resonance theory neural networks for control chart pattern recognition , 2001 .

[22]  Débora P. Ronconi,et al.  Minimizing earliness and tardiness penalties in a single-machine problem with a common due date , 2005, Eur. J. Oper. Res..

[23]  Y. Yonezawa,et al.  Ecological algorithm for optimal ordering used by collective honey bee behavior , 1996, MHS'96 Proceedings of the Seventh International Symposium on Micro Machine and Human Science.

[24]  Yue Zhang,et al.  BeeHive: An Efficient Fault-Tolerant Routing Algorithm Inspired by Honey Bee Behavior , 2004, ANTS Workshop.

[25]  David B. Fogel,et al.  Evolutionary computation - toward a new philosophy of machine intelligence (3. ed.) , 1995 .

[26]  J. A. Hoogeveen,et al.  Scheduling around a small common due date , 1991 .

[27]  Takeshi Yamada,et al.  Genetic Algorithms, Path Relinking, and the Flowshop Sequencing Problem , 1998, Evolutionary Computation.

[28]  David G. Dannenbring,et al.  An Evaluation of Flow Shop Sequencing Heuristics , 1977 .

[29]  S. M. Johnson,et al.  Optimal two- and three-stage production schedules with setup times included , 1954 .

[30]  M. Azeem,et al.  Modified queen bee evolution based genetic algorithm for tuning of scaling factors of fuzzy knowledge base controller , 2004, Proceedings of the IEEE INDICON 2004. First India Annual Conference, 2004..

[31]  R. A. Dudek,et al.  A Heuristic Algorithm for the n Job, m Machine Sequencing Problem , 1970 .

[32]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[33]  Dana S. Nau,et al.  Manufacturing cell formation by state-space search , 1996, Ann. Oper. Res..

[34]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[35]  J. Miltenburg,et al.  A comparative evaluation of nine well-known algorithms for solving the cell formation problem in group technology , 1991 .

[36]  V. K. Jayaraman,et al.  Ant Colony Approach to Continuous Function Optimization , 2000 .

[37]  T. Kaczorek Two-Dimensional Linear Systems , 1985 .

[38]  Xin-She Yang,et al.  Engineering Optimizations via Nature-Inspired Virtual Bee Algorithms , 2005, IWINAC.

[39]  Anan Mungwattana,et al.  Design of Cellular Manufacturing Systems for Dynamic and Uncertain Production Requirements with Presence of Routing Flexibility , 2000 .

[40]  F. Boctor A Jinear formulation of the machine-part cell formation problem , 1991 .

[41]  M. Rockstein Bees. Their Vision, Chemical Senses, and Language , 1952 .

[42]  S. Camazine,et al.  A model of collective nectar source selection by honey bees , 1991 .

[43]  D. Karaboga,et al.  Artificial Bee Colony (ABC) Algorithm on Training Artificial Neural Networks , 2007, 2007 IEEE 15th Signal Processing and Communications Applications.

[44]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[45]  Rainer Storn,et al.  Differential Evolution-A simple evolution strategy for fast optimization , 1997 .

[46]  Thomas Schmickl,et al.  Costs of Environmental Fluctuations and Benefits of Dynamic Decentralized Foraging Decisions in Honey Bees , 2004, Adapt. Behav..

[47]  Q.Y. Jiang,et al.  A queen-bee evolution based on genetic algorithm for economic power dispatch , 2004, 39th International Universities Power Engineering Conference, 2004. UPEC 2004..

[48]  Karl Tuyls,et al.  Bee System with inhibition Pheromones , 2007 .

[49]  Duc Truong Pham,et al.  An Integrated Neural Network and Expert System Tool for Statistical Process Control , 1995 .

[50]  Gary D. Scudder,et al.  Sequencing with Earliness and Tardiness Penalties: A Review , 1990, Oper. Res..

[51]  Duc Truong Pham,et al.  Automatic Detection of Defects on Birch Wood Boards , 1996 .

[52]  Guy Theraulaz,et al.  Self-Organization in Biological Systems , 2001, Princeton studies in complexity.