Teaching-learning-based optimization with variable-population scheme and its application for ANN and global optimization

A teaching-learning-based optimization algorithm (TLBO) which uses a variable population size in the form of a triangle form (VTTLBO) is proposed in the paper. The main goal of the proposed method is to decrease the computing cost of original TLBO and extend it for optimizing the parameters of artificial neural network (ANN). In the proposed algorithm, the evolutionary process is divided into some equal periods according to the maximal generation. The population size in each period is changed in form of triangle. In the linear increasing phase of population's number, some new individuals are generated with gauss distribution by using the adaptive mean and variance of the population. In the linear decreasing phase of population's number, some highly similar individuals are deleted. To compare the performance of the proposed method with some other methods, Saw-tooth teaching-learning-based optimization algorithm is also designed with simulating the basic principle of Saw-tooth genetic algorithm (STGA), and some other EAs with the fixed population size are also simulated. A variety of benchmark problems and system modeling and prediction problems with ANN are tested in this paper, the results indicate that the computation cost of the given method is small and the convergence accuracy and speed of it are high.

[1]  Feng Zou,et al.  Teaching-learning-based optimization with dynamic group strategy for global optimization , 2014, Inf. Sci..

[2]  Provas Kumar Roy,et al.  Multi-objective quasi-oppositional teaching learning based optimization for optimal location of distributed generator in radial distribution systems , 2014 .

[3]  Vedat Toğan,et al.  Design of planar steel frames using Teaching–Learning Based Optimization , 2012 .

[4]  Kwong-Sak Leung,et al.  Genetic Algorithm with adaptive elitist-population strategies for multimodal function optimization , 2011, Appl. Soft Comput..

[5]  Pravat Kumar Rout,et al.  Application of Multi-Objective Teaching Learning based Optimization Algorithm to Optimal Power Flow Problem☆ , 2012 .

[6]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[7]  Anima Naik,et al.  A teaching learning based optimization based on orthogonal design for solving global optimization problems , 2013, SpringerPlus.

[8]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[9]  R. Venkata Rao,et al.  Teaching-Learning-Based Optimization: An optimization method for continuous non-linear large scale problems , 2012, Inf. Sci..

[10]  Anima Naik,et al.  Weighted Teaching-Learning-Based Optimization for Global Function Optimization , 2013 .

[11]  Suresh Chandra Satapathy,et al.  Modified Teaching-Learning-Based Optimization algorithm for global numerical optimization - A comparative study , 2014, Swarm Evol. Comput..

[12]  Liang Gao,et al.  Disassembly sequence planning using a Simplified Teaching-Learning-Based Optimization algorithm , 2014, Adv. Eng. Informatics.

[13]  Sahand Ghavidel,et al.  Modified teaching learning algorithm and double differential evolution algorithm for optimal reactive power dispatch problem: A comparative study , 2014, Inf. Sci..

[14]  R. Rao,et al.  Multi-objective optimization of heat exchangers using a modified teaching-learning-based optimization algorithm , 2013 .

[15]  Babak Amiri,et al.  Application of Teaching-Learning-Based Optimization Algorithm on Cluster Analysis , 2012 .

[16]  Xin Yao,et al.  A Large Population Size Can Be Unhelpful in Evolutionary Algorithms a Large Population Size Can Be Unhelpful in Evolutionary Algorithms , 2022 .

[17]  R. Venkata Rao,et al.  An improved teaching-learning-based optimization algorithm for solving unconstrained optimization problems , 2012, Sci. Iran..

[18]  Provas Kumar Roy,et al.  Optimal short-term hydro-thermal scheduling using quasi-oppositional teaching learning based optimization , 2013, Eng. Appl. Artif. Intell..

[19]  Feng Zou,et al.  An improved teaching-learning-based optimization with neighborhood search for applications of ANN , 2014, Neurocomputing.

[20]  Quan-Ke Pan,et al.  A discrete teaching-learning-based optimisation algorithm for realistic flowshop rescheduling problems , 2015, Eng. Appl. Artif. Intell..

[21]  Feng Zou,et al.  A teaching–learning-based optimization algorithm with producer–scrounger model for global optimization , 2014, Soft Computing.

[22]  Vivek Patel,et al.  An elitist teaching-learning-based optimization algorithm for solving complex constrained optimization problems , 2012 .

[23]  ChunXia Zhao,et al.  Particle swarm optimization with adaptive population size and its application , 2009, Appl. Soft Comput..

[24]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[25]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[26]  V. K. Koumousis,et al.  A saw-tooth genetic algorithm combining the effects of variable population size and reinitialization to enhance performance , 2006, IEEE Transactions on Evolutionary Computation.

[27]  Yang Tang,et al.  Adaptive population tuning scheme for differential evolution , 2013, Inf. Sci..

[28]  Hailin Zhang,et al.  A Variable-Population Evolutionary Game Model for Resource Allocation in Cooperative Cognitive Relay Networks , 2013, IEEE Communications Letters.

[29]  Taher Niknam,et al.  A new multi objective optimization approach based on TLBO for location of automatic voltage regulators in distribution systems , 2012, Eng. Appl. Artif. Intell..

[30]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[31]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[32]  Thomas Bräunl,et al.  Dynamic population variation in genetic programming , 2009, Inf. Sci..

[33]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[34]  Chang-Huang Chen Group Leader Dominated Teaching-Learning Based Optimization , 2013, 2013 International Conference on Parallel and Distributed Computing, Applications and Technologies.

[35]  Taher Niknam,et al.  $\theta$-Multiobjective Teaching–Learning-Based Optimization for Dynamic Economic Emission Dispatch , 2012, IEEE Systems Journal.

[36]  Gary G. Yen,et al.  PSO-Based Multiobjective Optimization With Dynamic Population Size and Adaptive Local Archives , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Bin Wang,et al.  Multi-objective optimization using teaching-learning-based optimization algorithm , 2013, Eng. Appl. Artif. Intell..

[38]  Ye Xu,et al.  An effective teaching-learning-based optimization algorithm for the flexible job-shop scheduling problem with fuzzy processing time , 2015, Neurocomputing.

[39]  Provas Kumar Roy,et al.  Multi-objective optimal power flow using quasi-oppositional teaching learning based optimization , 2014, Appl. Soft Comput..

[40]  H. K. Verma,et al.  Teaching–learning-based Optimization Algorithm for Parameter Identification in the Design of IIR Filters , 2013 .

[41]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[42]  Xinyu Shao,et al.  An effective hybrid teaching-learning-based optimization algorithm for permutation flow shop scheduling problem , 2014, Adv. Eng. Softw..

[43]  Carlos A. Coello Coello,et al.  Reactive Power Handling by a Multi-Objective Teaching Learning Optimizer Based on Decomposition , 2013, IEEE Transactions on Power Systems.

[44]  S. Satapathy,et al.  High dimensional real parameter optimization with teaching learning based optimization , 2012 .

[45]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[46]  Anima Naik,et al.  Improvement of Initial Cluster Center of C-means using Teaching Learning based Optimization☆ , 2012 .

[47]  Murat İhsan Kömürcü,et al.  Prediction of berm geometry using a set of laboratory tests combined with teaching–learning-based optimization and artificial bee colony algorithms , 2014 .

[48]  Prakash Kotecha,et al.  Multi-level production planning in a petrochemical industry using elitist Teaching-Learning-Based-Optimization , 2015, Expert Syst. Appl..

[49]  Thomas Bräunl,et al.  Population variation in genetic programming , 2007, Inf. Sci..

[50]  Tianjun Liao,et al.  Artificial bee colony algorithm with dynamic population size to combined economic and emission dispatch problem , 2014 .

[51]  Chunmei Zhang,et al.  Differential evolution with adaptive population size combining lifetime and extinction mechanisms , 2011, 2011 8th Asian Control Conference (ASCC).

[52]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[53]  R. Venkata Rao,et al.  Parameter optimization of modern machining processes using teaching-learning-based optimization algorithm , 2013, Eng. Appl. Artif. Intell..