A novel improved teaching-learning based optimization for functional optimization

Despite the global fast coarse search capability of Teaching-Learning Based Optimization (TLBO), analysis in literature on the performance of TLBO reveals it often risks getting prematurely stuck in local optima for numerical optimization problems. In this study, Broyden-Fletcher-Goldfarb-Shanno (BFGS) quasi-Newton method is incorporated into the conventional TLBO to enhance its local searching performance through local search operators. The proposed TLBO-BFGS would enrich the searching modes and behaviors, and balance the global exploration and local exploitation as well. Simulation results on six well-known benchmark problems and comparisons with Genetic Algorithm (GA), Particle Swarm Optimization (PSO), and standard TLBO show that our proposed TLBO-BFGS can effectively enhance the searching efficiency and greatly improve the searching quality.

[1]  Abdolhamid Eshraghniaye Jahromi,et al.  A particle swarm-BFGS algorithm for nonlinear programming problems , 2013, Comput. Oper. Res..

[2]  Bo Liu,et al.  Improved particle swarm optimization combined with chaos , 2005 .

[3]  Xinyu Shao,et al.  An effective hybrid teaching-learning-based optimization algorithm for permutation flow shop scheduling problem , 2014, Adv. Eng. Softw..

[4]  Zexuan Zhu,et al.  Wrapper–Filter Feature Selection Algorithm Using a Memetic Framework , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Longquan Yong,et al.  An Improved Harmony Search Based on Teaching-Learning Strategy for Unconstrained Optimization Problems , 2013 .

[6]  R. Venkata Rao,et al.  Teaching-Learning-Based Optimization: An optimization method for continuous non-linear large scale problems , 2012, Inf. Sci..

[7]  Yew-Soon Ong,et al.  Memetic Computation—Past, Present & Future [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[8]  Peifeng Niu,et al.  Model NOx emissions by least squares support vector machine with tuning based on ameliorated teaching–learning-based optimization , 2013 .

[9]  Feng Zou,et al.  A hybridization of teaching–learning-based optimization and differential evolution for chaotic time series prediction , 2014, Neural Computing and Applications.

[10]  William E. Hart,et al.  Recent Advances in Memetic Algorithms , 2008 .

[11]  Ying Liu,et al.  A unified framework for population-based metaheuristics , 2011, Ann. Oper. Res..

[12]  Ling Wang,et al.  An effective teaching–learning-based optimisation algorithm for RCPSP with ordinal interval numbers , 2015 .

[13]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[14]  Nikhil Gupta,et al.  Simultaneous allocation of distributed resources using improved teaching learning based optimization , 2015 .

[15]  Jie Chen,et al.  Optimal Contraction Theorem for Exploration–Exploitation Tradeoff in Search and Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[16]  Alper Hamzadayi,et al.  Testing the performance of teaching-learning based optimization (TLBO) algorithm on combinatorial problems: Flow shop and job shop scheduling cases , 2014, Inf. Sci..

[17]  Hisao Ishibuchi,et al.  Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling , 2003, IEEE Trans. Evol. Comput..

[18]  Ye Xu,et al.  An effective teaching-learning-based optimization algorithm for the flexible job-shop scheduling problem with fuzzy processing time , 2015, Neurocomputing.

[19]  Anima Naik,et al.  A teaching learning based optimization based on orthogonal design for solving global optimization problems , 2013, SpringerPlus.

[20]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[21]  Taowen Liu,et al.  Convergence of the BFGS-SQP Method for Degenerate Problems , 2007 .

[22]  Swagat Pati,et al.  Teaching-learning based optimization algorithm based fuzzy-PID controller for automatic generation control of multi-area power system , 2015, Appl. Soft Comput..

[23]  Feng Zou,et al.  An improved teaching-learning-based optimization algorithm for solving global optimization problem , 2015, Inf. Sci..

[24]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[26]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[27]  Tansel Dökeroglu,et al.  Hybrid teaching-learning-based optimization algorithms for the Quadratic Assignment Problem , 2015, Comput. Ind. Eng..

[28]  R. Venkata Rao,et al.  Multi-objective optimization of two stage thermoelectric cooler using a modified teaching-learning-based optimization algorithm , 2013, Eng. Appl. Artif. Intell..

[29]  Hisao Ishibuchi,et al.  Special Issue on Memetic Algorithms , 2007, IEEE Trans. Syst. Man Cybern. Part B.

[30]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[31]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[32]  Mustafa Mamat,et al.  The Hybrid BFGS-CG Method in Solving Unconstrained Optimization Problems , 2014 .

[33]  Kay Chen Tan,et al.  A Multi-Facet Survey on Memetic Computation , 2011, IEEE Transactions on Evolutionary Computation.

[34]  Yew-Soon Ong,et al.  A Conceptual Modeling of Meme Complexes in Stochastic Search , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[35]  Mahdi Taghizadeh,et al.  Solving optimal reactive power dispatch problem using a novel teaching-learning-based optimization algorithm , 2015, Eng. Appl. Artif. Intell..

[36]  Xiaoyi Feng,et al.  Parameter estimation of nonlinear chaotic system by improved TLBO strategy , 2016, Soft Comput..

[37]  Jie Chen,et al.  Hybridizing Differential Evolution and Particle Swarm Optimization to Design Powerful Optimizers: A Review and Taxonomy , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[38]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[39]  Chao Wang,et al.  Multi-criteria group decision making with incomplete hesitant fuzzy preference relations , 2015, Appl. Soft Comput..

[40]  Zelda B. Zabinsky,et al.  A Numerical Evaluation of Several Stochastic Algorithms on Selected Continuous Global Optimization Test Problems , 2005, J. Glob. Optim..

[41]  Jie Zhang,et al.  Consistencies and Contradictions of Performance Metrics in Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[42]  Hisao Ishibuchi,et al.  Special issue on emerging trends in soft computing: memetic algorithms , 2009, Soft Comput..