Teaching–learning-based optimization with differential and repulsion learning for global optimization and nonlinear modeling

Teaching–learning-based optimization (TLBO) algorithm is one of the recently proposed optimization algorithms. It has been successfully used for solving optimization problems in continuous spaces. To improve the optimization performance of the TLBO algorithm, a modified TLBO algorithm with differential and repulsion learning (DRLTLBO) is presented in this paper. In the proposed algorithm, the differential evolution (DE) operators are introduced into the teacher phase of DRLTLBO to increase the diversity of the new population. In the learner phase of DRLLBO, local learning method or repulsion learning method are adopted according to a certain probability to make learners search knowledge from different directions. In the local learning method, learners learn knowledge not only from the best learner but also from another random learner of their neighbors. In the repulsion learning method, learners learn knowledge from the best learner and keep away from the worst learner of their neighbors. Moreover, self-learning method is adopted to improve the exploitation ability of learners when they are not changed in some continuous generations. To decrease the blindness of random self-learning method, the history information of the corresponding learners in some continuous generations is used in self-learning phase. Furthermore, all learners are regrouped after a certain iterations to improve the local diversity of the learners. In the end, DRLTLBO is tested on 32 benchmark functions with different characteristics and two typical nonlinear modeling problems, and the comparison results show that the proposed DRLTLBO algorithm has shown interesting outcomes in some aspects.

[1]  Feng Zou,et al.  Teaching-learning-based optimization with dynamic group strategy for global optimization , 2014, Inf. Sci..

[2]  Suresh Chandra Satapathy,et al.  Social group optimization (SGO): a new population evolutionary optimization technique , 2016, Complex & Intelligent Systems.

[3]  Jun Zhang,et al.  Competitive and cooperative particle swarm optimization with information sharing mechanism for global optimization problems , 2015, Inf. Sci..

[4]  Ping Li,et al.  Selective recursive kernel learning for online identification of nonlinear systems with NARX form , 2010 .

[5]  Vivek Patel,et al.  An elitist teaching-learning-based optimization algorithm for solving complex constrained optimization problems , 2012 .

[6]  R. Venkata Rao,et al.  Teaching-Learning-Based Optimization: An optimization method for continuous non-linear large scale problems , 2012, Inf. Sci..

[7]  Anima Naik,et al.  Weighted Teaching-Learning-Based Optimization for Global Function Optimization , 2013 .

[8]  Nenad Mladenovic,et al.  DE-VNS: Self-adaptive Differential Evolution with crossover neighborhood search for continuous global optimization , 2013, Comput. Oper. Res..

[9]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[10]  Taher Niknam,et al.  $\theta$-Multiobjective Teaching–Learning-Based Optimization for Dynamic Economic Emission Dispatch , 2012, IEEE Systems Journal.

[11]  R. Venkata Rao,et al.  An improved teaching-learning-based optimization algorithm for solving unconstrained optimization problems , 2012, Sci. Iran..

[12]  D. Lowther,et al.  Differential Evolution Strategy for Constrained Global Optimization and Application to Practical Engineering Problems , 2006, IEEE Transactions on Magnetics.

[13]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[14]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[15]  R. Venkata Rao,et al.  Parameter optimization of modern machining processes using teaching-learning-based optimization algorithm , 2013, Eng. Appl. Artif. Intell..

[16]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[17]  R. Venkata Rao,et al.  Teaching Learning Based Optimization Algorithm: And Its Engineering Applications , 2015 .

[18]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[19]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[20]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[21]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[22]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[23]  Dervis Karaboga,et al.  A modified Artificial Bee Colony algorithm for real-parameter optimization , 2012, Inf. Sci..

[24]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[25]  Olivier François,et al.  An evolutionary strategy for global minimization and its Markov chain analysis , 1998, IEEE Trans. Evol. Comput..

[26]  Sanyang Liu,et al.  A Cluster-Based Differential Evolution With Self-Adaptive Strategy for Multimodal Optimization , 2014, IEEE Transactions on Cybernetics.

[27]  Sung Nam Jung,et al.  Advanced particle swarm assisted genetic algorithm for constrained optimization problems , 2014, Computational Optimization and Applications.

[28]  Seyedali Mirjalili,et al.  Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems , 2015, Neural Computing and Applications.

[29]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[30]  Christian Blum,et al.  Ant colony optimization: Introduction and recent trends , 2005 .

[31]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[32]  Vedat Toğan,et al.  Design of planar steel frames using Teaching–Learning Based Optimization , 2012 .

[33]  Shi-Jim Yen,et al.  Adoptive population differential evolution with local search for solving large scale global optimization , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[34]  Feng Zou,et al.  A teaching–learning-based optimization algorithm with producer–scrounger model for global optimization , 2014, Soft Computing.

[35]  Feng Zou,et al.  An improved teaching-learning-based optimization algorithm for solving global optimization problem , 2015, Inf. Sci..

[36]  Jiashu Zhang,et al.  A novel adaptive bilinear filter based on pipelined architecture , 2010, Digit. Signal Process..

[37]  Vivek K. Patel,et al.  A multi-objective improved teaching-learning based optimization algorithm (MO-ITLBO) , 2016, Inf. Sci..

[38]  R. V. Rao,et al.  Teaching–learning-based optimization algorithm for unconstrained and constrained real-parameter optimization problems , 2012 .

[39]  Leandro dos Santos Coelho,et al.  Coevolutionary Particle Swarm Optimization Using Gaussian Distribution for Solving Constrained Optimization Problems , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[40]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[41]  S. O. Degertekin,et al.  Sizing truss structures using teaching-learning-based optimization , 2013 .

[42]  R. Venkata Rao,et al.  Review of applications of TLBO algorithm and a tutorial for beginners to solve the unconstrained and constrained optimization problems , 2016 .

[43]  Suresh Chandra Satapathy,et al.  Modified Teaching-Learning-Based Optimization algorithm for global numerical optimization - A comparative study , 2014, Swarm Evol. Comput..

[44]  Chunming Yang,et al.  A new particle swarm optimization technique , 2005, 18th International Conference on Systems Engineering (ICSEng'05).

[45]  Jianxin Zhou,et al.  An improved teaching-learning-based optimization algorithm and its application to a combinatorial optimization problem in foundry industry , 2017, Appl. Soft Comput..

[46]  Feng Zou,et al.  An improved teaching-learning-based optimization with neighborhood search for applications of ANN , 2014, Neurocomputing.

[47]  Mengnan Tian,et al.  Differential evolution with improved individual-based parameter setting and selection strategy , 2017, Appl. Soft Comput..

[48]  Yong Lu,et al.  A robust stochastic genetic algorithm (StGA) for global numerical optimization , 2004, IEEE Transactions on Evolutionary Computation.

[49]  Feng Zou,et al.  A hybridization of teaching–learning-based optimization and differential evolution for chaotic time series prediction , 2014, Neural Computing and Applications.

[50]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[51]  Wenyin Gong,et al.  A clustering-based differential evolution for global optimization , 2011, Appl. Soft Comput..

[52]  Patrick Siarry,et al.  A multi-swarm PSO using charged particles in a partitioned search space for continuous optimization , 2012, Comput. Optim. Appl..

[53]  Yaochu Jin,et al.  A social learning particle swarm optimization algorithm for scalable optimization , 2015, Inf. Sci..

[54]  Wei-Der Chang Differential evolution-based nonlinear system modeling using a bilinear series model , 2012, Appl. Soft Comput..

[55]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[56]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..