Elitist teaching–learning-based optimization (ETLBO) with higher-order Jordan Pi-sigma neural network: a comparative performance analysis

This paper presents the performance analysis of a newly developed elitist teaching–learning-based optimization algorithm applied with an efficient higher-order Jordan Pi-sigma neural network (JPSNN) for real-world data classification. Teaching–learning-based optimization (TLBO) algorithm is a recent metaheuristic, which is inspired through the teaching and learning process of both teacher and learner. As compared to other algorithms, it is efficient and robust due to its non-controlling parameter adjustments feature. Elitist TLBO is an improved version of TLBO with the addition of elitist solutions, which makes it more efficient. During the experiment, first the TLBO and then ETLBO algorithm are applied with only Pi-sigma neural network and its performance has been compared with other methods such as GA and PSO. Then, the ETLBO algorithm is applied with JPSNN and found better results over other methods. The proposed method has been tested with real-world benchmark datasets considered from UCI machine learning repository, and the performance has been compared with all seven approaches along with other HONN to prove the effectiveness of the method. Simulation results and statistical analysis show the superiority in the performance of the proposed approach as well as prove the potentiality over other existing approaches.

[1]  Provas Kumar Roy,et al.  Optimal reactive power dispatch using quasi-oppositional teaching learning based optimization , 2013 .

[2]  A. Kaveh,et al.  A novel heuristic optimization method: charged system search , 2010 .

[3]  Taher Niknam,et al.  $\theta$-Multiobjective Teaching–Learning-Based Optimization for Dynamic Economic Emission Dispatch , 2012, IEEE Systems Journal.

[4]  S. Balarama Murty,et al.  Character Recognition Using Teaching Learning Based Optimization , 2014, FICTA.

[5]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[6]  Bijaya Ketan Panigrahi,et al.  Optimal coordination of directional over-current relays using Teaching Learning-Based Optimization (TLBO) algorithm , 2013 .

[7]  Vedat Toğan,et al.  Design of planar steel frames using Teaching–Learning Based Optimization , 2012 .

[8]  Shikha Agrawal,et al.  Teaching Learning Based Optimization (TLBO) Based Improved Iris Recognition System , 2014, ICSEng.

[9]  Mahdi Taghizadeh,et al.  Solving optimal reactive power dispatch problem using a novel teaching-learning-based optimization algorithm , 2015, Eng. Appl. Artif. Intell..

[10]  Provas Kumar Roy,et al.  Optimal capacitor placement in radial distribution systems using teaching learning based optimization , 2014 .

[11]  Robert C. Green,et al.  Training neural networks using Central Force Optimization and Particle Swarm Optimization: Insights and comparisons , 2012, Expert Syst. Appl..

[12]  Longquan Yong,et al.  An Improved Harmony Search Based on Teaching-Learning Strategy for Unconstrained Optimization Problems , 2013 .

[13]  Shu-Cherng Fang,et al.  An Electromagnetism-like Mechanism for Global Optimization , 2003, J. Glob. Optim..

[14]  V. V. S. S. S. Chakravarthy,et al.  Linear Array Optimization Using Teaching Learning Based Optimization , 2015 .

[15]  Feng Zou,et al.  An improved teaching-learning-based optimization algorithm for solving global optimization problem , 2015, Inf. Sci..

[16]  Vivek Patel,et al.  An elitist teaching-learning-based optimization algorithm for solving complex constrained optimization problems , 2012 .

[17]  Mojtaba Ghasemi,et al.  An improved teaching–learning-based optimization algorithm using Lévy mutation strategy for non-smooth optimal power flow , 2015 .

[18]  M. Friedman.  A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[19]  D. L. Gonzalez-Alvarez,et al.  Multiobjective Teaching-Learning-Based Optimization (MO-TLBO) for motif finding , 2012, 2012 IEEE 13th International Symposium on Computational Intelligence and Informatics (CINTI).

[20]  Joydeep Ghosh,et al.  The pi-sigma network: an efficient higher-order neural network for pattern classification and function approximation , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[21]  Jesús Alcalá-Fdez,et al.  KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework , 2011, J. Multiple Valued Log. Soft Comput..

[22]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[23]  J. Won,et al.  7th World Congresses of Structural and Multidisciplinary Optimization , 2005 .

[24]  Liang Gao,et al.  A Simplified Teaching-Learning-Based Optimization Algorithm for Disassembly Sequence Planning , 2013, 2013 IEEE 10th International Conference on e-Business Engineering.

[25]  Pavan Kumar Mummareddy,et al.  An Hybrid Approach for Data Clustering Using K-Means and Teaching Learning Based Optimization , 2015 .

[26]  Ajith Abraham,et al.  Particle Swarm Optimization Based Higher Order Neural Network for Classification , 2015 .

[27]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[28]  Ali Reza Seifi,et al.  Fuzzy-TLBO optimal reactive power control variables planning for energy loss minimization , 2014 .

[29]  Sung-Bae Cho,et al.  Towards Crafting an Improved Functional Link Artificial Neural Network Based on Differential Evolution and Feature Selection , 2015, Informatica.

[30]  Bilal Alatas,et al.  Chaotic bee colony algorithms for global numerical optimization , 2010, Expert Syst. Appl..

[31]  Francisco Herrera,et al.  A study on the use of statistical tests for experimentation with neural networks: Analysis of parametric test conditions and non-parametric tests , 2007, Expert Syst. Appl..

[32]  M. Basu,et al.  Teaching–learning-based optimization algorithm for multi-area economic dispatch , 2014 .

[33]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[34]  Ajith Abraham,et al.  Elitist Teaching Learning Opposition based algorithm for global optimization , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[35]  Himansu Sekhar Behera,et al.  A Honey Bee Mating Optimization Based Gradient Descent Learning – FLANN (HBMO-GDL-FLANN) for Classification , 2015 .

[36]  Provas Kumar Roy,et al.  Teaching learning based optimization for short-term hydrothermal scheduling problem considering valve point effect and prohibited discharge constraint , 2013 .

[37]  J. Tukey.  Comparing individual means in the analysis of variance. , 1949, Biometrics.

[38]  Miguel A. Vega-Rodríguez,et al.  Finding Patterns in Protein Sequences by Using a Hybrid Multiobjective Teaching Learning Based Optimization Algorithm , 2015, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[39]  Ajith Abraham,et al.  A self adaptive harmony search based functional link higher order ANN for non-linear data classification , 2016, Neurocomputing.

[40]  Provas Kumar Roy,et al.  Multi-objective quasi-oppositional teaching learning based optimization for economic emission load dispatch problem , 2013 .

[41]  Provas Kumar Roy,et al.  Optimal short-term hydro-thermal scheduling using quasi-oppositional teaching learning based optimization , 2013, Eng. Appl. Artif. Intell..

[42]  Wagner F. Sacco,et al.  A New Stochastic Optimization Algorithm based on a Particle Collision Metaheuristic , 2005 .

[43]  Ajith Abraham,et al.  An optimal design of coordinated PI based PSS with TCSC controller using modified Teaching Learning based Optimization , 2013, 2013 World Congress on Nature and Biologically Inspired Computing.

[44]  H. S. Behera,et al.  A higher order evolutionary Jordan Pi-Sigma Neural Network with gradient descent learning for classification , 2014, 2014 International Conference on High Performance Computing and Applications (ICHPCA).

[45]  Reza Tavakkoli-Moghaddam,et al.  A hybridization of simulated annealing and electromagnetism-like mechanism for a periodic job shop scheduling problem , 2011, Expert Syst. Appl..

[46]  Swagat Pati,et al.  Teaching-learning based optimization algorithm based fuzzy-PID controller for automatic generation control of multi-area power system , 2015, Appl. Soft Comput..

[47]  Xiangtao Li,et al.  A novel hybrid K-harmonic means and gravitational search algorithm approach for clustering , 2011, Expert Syst. Appl..

[48]  Antonio José Gil Mena,et al.  Optimal distributed generation location and size using a modified teaching–learning based optimization algorithm , 2013 .

[49]  Richard A. Formato,et al.  CENTRAL FORCE OPTIMIZATION: A NEW META-HEURISTIC WITH APPLICATIONS IN APPLIED ELECTROMAGNETICS , 2007 .

[50]  Pravat Kumar Rout,et al.  Application of Multi-Objective Teaching Learning based Optimization Algorithm to Optimal Power Flow Problem☆ , 2012 .

[51]  Himansu Sekhar Behera,et al.  A Global-best Harmony Search based Gradient Descent Learning FLANN (GbHS-GDL-FLANN) for data classification , 2016 .

[52]  Hossein Nezamabadi-pour,et al.  BGSA: binary gravitational search algorithm , 2010, Natural Computing.

[53]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[54]  H. S. Behera,et al.  A hybrid PSO-GA based Pi sigma neural network (PSNN) with standard back propagation gradient descent learning for classification , 2014, 2014 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT).

[55]  Himansu Sekhar Behera,et al.  An efficient FLANN model with CRO-based gradient descent learning for classification , 2016, Int. J. Bus. Inf. Syst..

[56]  M. S. Bartlett,et al.  Statistical methods and scientific inference. , 1957 .

[57]  Bin Wu,et al.  The improvement of glowworm swarm optimization for continuous optimization problems , 2012, Expert Syst. Appl..

[58]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[59]  Atul Koshti,et al.  Anticipatory load shedding for line overload alleviation using Teaching learning based optimization (TLBO) , 2014 .

[60]  Anima Naik,et al.  A teaching learning based optimization based on orthogonal design for solving global optimization problems , 2013, SpringerPlus.

[61]  Joydeep Ghosh,et al.  Efficient Higher-Order Neural Networks for Classification and Function Approximation , 1992, Int. J. Neural Syst..

[62]  C. Dunnett.  A Multiple Comparison Procedure for Comparing Several Treatments with a Control , 1955 .

[63]  R. V. Rao,et al.  Optimal design of the heat pipe using TLBO (teaching–learning-based optimization) algorithm , 2015 .

[64]  Himansu Sekhar Behera,et al.  A novel Chemical Reaction Optimization based Higher order Neural Network (CRO-HONN) for nonlinear classification , 2015 .

[65]  B. Alatas.  Uniform Big Bang–Chaotic Big Crunch optimization , 2011 .

[66]  Zhihua Cui,et al.  General framework of Artificial Physics Optimization Algorithm , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[67]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[68]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[69]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[70]  Bin Wang,et al.  Multi-objective optimization using teaching-learning-based optimization algorithm , 2013, Eng. Appl. Artif. Intell..

[71]  Mohammad Reza Khalghani,et al.  A novel self-tuning control method based on regulated bi-objective emotional learning controller's structure with TLBO algorithm to control DVR compensator , 2014, Appl. Soft Comput..

[72]  Yu-Huei Cheng.  Estimation of Teaching-Learning-Based Optimization Primer Design Using Regression Analysis for Different Melting Temperature Calculations , 2015, IEEE Transactions on NanoBioscience.

[73]  H. T. Jadhav,et al.  Modified teaching learning based algorithm for economic load dispatch incorporating wind power , 2012, 2012 11th International Conference on Environment and Electrical Engineering.

[74]  Tshilidzi Marwala,et al.  Teaching - Learning-based optimization approach for enhancing remanufacturability pre-evaluation system's reliability , 2013, 2013 IEEE Symposium on Swarm Intelligence (SIS).

[75]  Y. Takefuji,et al.  Functional-link net computing: theory, system architecture, and functionalities , 1992, Computer.

[76]  Zhile Yang,et al.  A new self-learning TLBO algorithm for RBF neural modelling of batteries in electric vehicles , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[77]  Rozaida Ghazali,et al.  An Application of Jordan Pi-Sigma Neural Network for the Prediction of Temperature Time Series Signal , 2012 .

[78]  R. Venkata Rao,et al.  Teaching-Learning-Based Optimization: An optimization method for continuous non-linear large scale problems , 2012, Inf. Sci..

[79]  Anima Naik,et al.  Weighted Teaching-Learning-Based Optimization for Global Function Optimization , 2013 .

[80]  R. Iman,et al.  Approximations of the critical region of the fbietkan statistic , 1980 .

[81]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[82]  R. Venkata Rao,et al.  An improved teaching-learning-based optimization algorithm for solving unconstrained optimization problems , 2012, Sci. Iran..

[83]  Kang Li,et al.  An improved TLBO with elite strategy for parameters identification of PEM fuel cell and solar cell models , 2014 .

[84]  Ajit Kumar Barisal,et al.  Comparative performance analysis of teaching learning based optimization for automatic load frequency control of multi-source power systems , 2015 .

[85]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[86]  Debasish Ghose,et al.  Glowworm swarm based optimization algorithm for multimodal functions with collective robotics applications , 2006, Multiagent Grid Syst..

[87]  Michael I. Jordan.  Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[88]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[89]  Ibrahim Eksin,et al.  A new optimization method: Big Bang-Big Crunch , 2006, Adv. Eng. Softw..

[90]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[91]  Tayfun Dede,et al.  Estimates of energy consumption in Turkey using neural networks with the teaching–learning-based optimization algorithm , 2014 .

[92]  Vimal J. Savsani,et al.  Optimized trajectory planning of a robotic arm using teaching learning based optimization (TLBO) and artificial bee colony (ABC) optimization techniques , 2013, 2013 IEEE International Systems Conference (SysCon).

[93]  Rory A. Fisher,et al.  Statistical methods and scientific inference. , 1957 .

[94]  R. A. Fisher,et al.  Statistical methods and scientific inference. , 1957 .

[95]  Erhan Akin,et al.  FCACO: Fuzzy Classification Rules Mining Algorithm with Ant Colony Optimization , 2005, ICNC.

[96]  Chandrasekhar Yammani,et al.  Optimal placement and sizing of DER's with load models using a modified teaching learning based optimization algorithm , 2014, 2014 International Conference on Green Computing Communication and Electrical Engineering (ICGCCEE).

[97]  M. Friedman.  The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[98]  S. Larson.  The shrinkage of the coefficient of multiple correlation. , 1931 .

[99]  Taher Niknam,et al.  Short-term scheduling of thermal power systems using hybrid gradient based modified teaching–learning optimizer with black hole algorithm , 2014 .

[100]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[101]  R. Venkata Rao,et al.  Parameter optimization of modern machining processes using teaching-learning-based optimization algorithm , 2013, Eng. Appl. Artif. Intell..

[102]  Anima Naik,et al.  Teaching Learning Based Optimization for Neural Networks Learning Enhancement , 2012, SEMCCO.

[103]  Joydeep Ghosh,et al.  Realization of Boolean Functions Using Binary Pi-sigma Networks , 1991 .

[104]  R. Venkata Rao,et al.  A comparative study of a teaching-learning-based optimization algorithm on multi-objective unconstrained and constrained functions , 2014, J. King Saud Univ. Comput. Inf. Sci..

[105]  A. Kaveh,et al.  A novel hybrid charge system search and particle swarm optimization method for multi-objective optimization , 2011, Expert Syst. Appl..

[106]  Hui Bin Wang,et al.  Teaching-Learning-Based Optimization Algorithm for Dealing with Real-Parameter Optimization Problems , 2013 .

[107]  Ziwu Ren,et al.  An Improved Teaching-Learning-Based Optimization , 2018, 2018 37th Chinese Control Conference (CCC).

[108]  Carlos A. Coello Coello,et al.  Reactive Power Handling by a Multi-Objective Teaching Learning Optimizer Based on Decomposition , 2013, IEEE Transactions on Power Systems.