Hierarchical multi-swarm cooperative teaching–learning-based optimization for global optimization

Hierarchical cooperation mechanism, which is inspired by the features of specialization and cooperation in the social organizations, has been successfully used to increase the diversity of the population and avoid premature convergence for solving complex optimization problems. In this paper, a new two-level hierarchical multi-swarm cooperative TLBO variant called HMCTLBO is presented to solve global optimization problems. In the proposed HMCTLBO algorithm, all learners are randomly divided into several sub-swarms with equal amounts of learners at the bottom level of the hierarchy. The learners of each swarm evolve only in their corresponding swarm in parallel independently to maintain the diversity and improve the exploration capability of the population. Moreover, all the best learners from each swarm compose the new swarm at the top level of the hierarchy, and each learner of the swarm evolves according to Gaussian sampling learning. Furthermore, a randomized regrouping strategy is performed, and a subspace searching strategy based on Latin hypercube sampling is introduced to maintain the diversity of the population. To verify the performance of the proposed approaches, 48 benchmark test functions are evaluated. Conducted experiments indicate that the proposed HMCTLBO algorithm is competitive to some existing TLBO variants and other optimization algorithms.

[1]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[2]  Ali R. Yildiz,et al.  Optimization of multi-pass turning operations using hybrid teaching learning-based approach , 2013 .

[3]  R. Venkata Rao,et al.  An improved teaching-learning-based optimization algorithm for solving unconstrained optimization problems , 2012, Sci. Iran..

[4]  Feng Zou,et al.  An improved teaching-learning-based optimization algorithm for solving global optimization problem , 2015, Inf. Sci..

[5]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[6]  Chang-Huang Chen.  Group Leader Dominated Teaching-Learning Based Optimization , 2013, 2013 International Conference on Parallel and Distributed Computing, Applications and Technologies.

[7]  Taher Niknam,et al.  A new teaching-learning-based optimization algorithm for distribution system state estimation , 2015, J. Intell. Fuzzy Syst..

[8]  Feng Zou,et al.  Bare-Bones Teaching-Learning-Based Optimization , 2014, TheScientificWorldJournal.

[9]  Charles V. Camp,et al.  Design of space trusses using modified teaching–learning based optimization , 2014 .

[10]  Feng Zou,et al.  SAMCCTLBO: a multi-class cooperative teaching–learning-based optimization algorithm with simulated annealing , 2016, Soft Comput..

[11]  D. McShea,et al.  Individual versus social complexity, with particular reference to ant colonies , 2001, Biological reviews of the Cambridge Philosophical Society.

[12]  Feng Zou,et al.  Teaching-learning-based optimization with dynamic group strategy for global optimization , 2014, Inf. Sci..

[13]  Vivek Patel,et al.  An elitist teaching-learning-based optimization algorithm for solving complex constrained optimization problems , 2012 .

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  Taher Niknam,et al.  A new multi objective optimization approach based on TLBO for location of automatic voltage regulators in distribution systems , 2012, Eng. Appl. Artif. Intell..

[16]  Feng Zou,et al.  Teaching-learning-based optimization with variable-population scheme and its application for ANN and global optimization , 2016, Neurocomputing.

[17]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[18]  Dexuan Zou,et al.  Teaching-learning based optimization with global crossover for global optimization problems , 2015, Appl. Math. Comput..

[19]  Ye Xu,et al.  An effective teaching-learning-based optimization algorithm for the flexible job-shop scheduling problem with fuzzy processing time , 2015, Neurocomputing.

[20]  Taher Niknam,et al.  $\theta$-Multiobjective Teaching–Learning-Based Optimization for Dynamic Economic Emission Dispatch , 2012, IEEE Systems Journal.

[21]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[22]  Mahdi Taghizadeh,et al.  Solving optimal reactive power dispatch problem using a novel teaching-learning-based optimization algorithm , 2015, Eng. Appl. Artif. Intell..

[23]  Mojtaba Hoseini,et al.  A new multi objective optimization approach in distribution systems , 2014, Optim. Lett..

[24]  Yong-Tae Kim,et al.  Optimal design of electromagnet for Maglev vehicles using hybrid optimization algorithm , 2015, Soft Comput..

[25]  Sahand Ghavidel,et al.  Modified teaching learning algorithm and double differential evolution algorithm for optimal reactive power dispatch problem: A comparative study , 2014, Inf. Sci..

[26]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[27]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[28]  Anima Naik,et al.  Weighted Teaching-Learning-Based Optimization for Global Function Optimization , 2013 .

[29]  Feng Zou,et al.  An improved teaching-learning-based optimization with neighborhood search for applications of ANN , 2014, Neurocomputing.

[30]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[31]  Sahand Ghavidel,et al.  A novel hybrid algorithm of imperialist competitive algorithm and teaching learning algorithm for optimal power flow problem with non-smooth cost functions , 2014, Eng. Appl. Artif. Intell..

[32]  R. Rao,et al.  Multi-objective optimization of heat exchangers using a modified teaching-learning-based optimization algorithm , 2013 .

[33]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[34]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[35]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[36]  Provas Kumar Roy,et al.  Multi-objective optimal power flow using quasi-oppositional teaching learning based optimization , 2014, Appl. Soft Comput..

[37]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[38]  Yangyang Li,et al.  An improved cooperative quantum-behaved particle swarm optimization , 2012, Soft Computing.

[39]  A. Wandersman,et al.  The importance of neighbors: The social, cognitive, and affective components of neighboring , 1985 .

[40]  Anima Naik,et al.  A teaching learning based optimization based on orthogonal design for solving global optimization problems , 2013, SpringerPlus.

[41]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[42]  P. John Clarkson,et al.  Erratum: A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2003, Evolutionary Computation.

[43]  Xinyu Shao,et al.  An effective hybrid teaching-learning-based optimization algorithm for permutation flow shop scheduling problem , 2014, Adv. Eng. Softw..

[44]  Antonio José Gil Mena,et al.  Optimal distributed generation location and size using a modified teaching–learning based optimization algorithm , 2013 .

[45]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[46]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).