SGOA: annealing-behaved grasshopper optimizer for global tasks

An improved grasshopper optimization algorithm (GOA) is proposed in this paper, termed as SGOA, which combines simulated annealing (SA) mechanism with the original GOA that is a natural optimizer widely used in finance, medical and other fields, and receives more promising results based on grasshopper behavior. To compare performance of the SGOA and other algorithms, an investigation to select CEC2017 benchmark function as the test set was carried out. Also, the Friedman assessment was performed to check the significance of the proposed method against other counterparts. In comparison with ten meta-heuristic algorithms such as differential evolution (DE), the proposed SGOA can rank first in the CEC2017, and also ranks first in comparison with ten advanced algorithms. The simulation results reveal that the SA strategy notably improves the exploration and exploitation capacity of GOA. Moreover, the SGOA is also applied to engineering problems and parameter optimization of the kernel extreme learning machine (KELM). After optimizing the parameters of KELM using SGOA, the model was applied to two datasets, Cleveland Heart Dataset and Japanese Bankruptcy Dataset, and they achieved an accuracy of 79.2% and 83.5%, respectively, which were better than the KELM model obtained other algorithms. In these practical applications, it is indicated that the proposed SGOA can provide effective assistance in settling complex optimization problems with impressive results.

[1]  Lorenzo Bruzzone,et al.  Superpixel-Based Unsupervised Band Selection for Classification of Hyperspectral Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[3]  Qiang Miao,et al.  A parameter-adaptive VMD method based on grasshopper optimization algorithm to analyze vibration signals from rotating machinery , 2018, Mechanical Systems and Signal Processing.

[4]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[5]  Huiling Chen,et al.  Orthogonally-designed adapted grasshopper optimization: A comprehensive analysis , 2020, Expert Syst. Appl..

[6]  Huimin Zhao,et al.  An Enhanced MSIQDE Algorithm With Novel Multiple Strategies for Global Optimization Problems , 2022, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  Xiao Xue,et al.  Social Learning Evolution (SLE): Computational Experiment-Based Modeling Framework of Social Manufacturing , 2019, IEEE Transactions on Industrial Informatics.

[8]  Xiang Zhang,et al.  Multi-population following behavior-driven fruit fly optimization: A Markov chain convergence proof and comprehensive analysis , 2020, Knowl. Based Syst..

[9]  Pengjun Wang,et al.  Efficient multi-population outpost fruit fly-driven optimizers: Framework and advances in support vector machines , 2020, Expert Syst. Appl..

[10]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[11]  Fausto Giunchiglia,et al.  Deep Feature-Based Text Clustering and its Explanation , 2022, IEEE Transactions on Knowledge and Data Engineering.

[12]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[13]  Alexander Hapfelmeier,et al.  Nonparametric Subgroup Identification by PRIM and CART: A Simulation and Application Study , 2017, Comput. Math. Methods Medicine.

[14]  Yungang Liu,et al.  A Hybrid Bat Algorithm for Economic Dispatch With Random Wind Power , 2018, IEEE Transactions on Power Systems.

[15]  Gang Wang,et al.  An efficient hybrid kernel extreme learning machine approach for early diagnosis of Parkinson's disease , 2016, Neurocomputing.

[16]  Marco Dorigo,et al.  Ant colony optimization theory: A survey , 2005, Theor. Comput. Sci..

[17]  Amir H. Gandomi,et al.  Multi-population differential evolution-assisted Harris hawks optimization: Framework and case studies , 2020, Future Gener. Comput. Syst..

[18]  Jun Li,et al.  Grey wolf optimization evolving kernel extreme learning machine: Application to bankruptcy prediction , 2017, Eng. Appl. Artif. Intell..

[19]  Qian Zhang,et al.  Multi-strategy boosted mutative whale-inspired optimization approaches , 2019, Applied Mathematical Modelling.

[20]  Ying Chen,et al.  Towards augmented kernel extreme learning models for bankruptcy prediction: Algorithmic behavior and comprehensive analysis , 2020, Neurocomputing.

[21]  Ling Wang,et al.  An effective differential evolution with level comparison for constrained engineering design , 2010 .

[22]  Veda C. Storey,et al.  Naive Semantics to Support Automated Database Design , 2002, IEEE Trans. Knowl. Data Eng..

[23]  Yang Li,et al.  Deep Spatial-Temporal Feature Fusion From Adaptive Dynamic Functional Connectivity for MCI Identification , 2020, IEEE Transactions on Medical Imaging.

[24]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[25]  Huiling Chen,et al.  An Improved Grasshopper Optimizer for Global Tasks , 2020, Complex..

[26]  S. N. Kramer,et al.  An Augmented Lagrange Multiplier Based Method for Mixed Integer Discrete Continuous Optimization and Its Applications to Mechanical Design , 1994 .

[27]  Hongbo Zhang,et al.  Grasshopper optimization algorithm with principal component analysis for global optimization , 2019, The Journal of Supercomputing.

[28]  J. Klafter,et al.  Introduction to the Theory of Lévy Flights , 2008 .

[29]  Wenjian Luo,et al.  Differential evolution with dynamic stochastic selection for constrained optimization , 2008, Inf. Sci..

[30]  Xiaoqin Zhang,et al.  An enhanced Bacterial Foraging Optimization and its application for training kernel extreme learning machine , 2020, Appl. Soft Comput..

[31]  Yanan Zhang,et al.  Boosted binary Harris hawks optimizer and feature selection , 2020, Engineering with Computers.

[32]  Changcheng Huang,et al.  Orthogonally adapted Harris hawks optimization for parameter estimation of photovoltaic models , 2020 .

[33]  Wu Deng,et al.  An effective improved co-evolution ant colony optimisation algorithm with multi-strategies and its application , 2020, Int. J. Bio Inspired Comput..

[34]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[35]  Carlos A. Coello Coello,et al.  Modified Differential Evolution for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[36]  Oguz Bayat,et al.  A grasshopper optimizer approach for feature selection and optimizing SVM parameters utilizing real biomedical data sets , 2019, Neural Computing and Applications.

[37]  Akash Saxena,et al.  A comprehensive study of chaos embedded bridging mechanisms and crossover operators for grasshopper optimisation algorithm , 2019, Expert Syst. Appl..

[38]  Haodong Liu,et al.  Performance Prediction Using High-Order Differential Mathematical Morphology Gradient Spectrum Entropy and Extreme Learning Machine , 2020, IEEE Transactions on Instrumentation and Measurement.

[39]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[40]  Huiling Chen,et al.  Boosted mutation-based Harris hawks optimizer for parameters identification of single-diode solar cell models , 2020 .

[41]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[42]  Huiling Chen,et al.  Chaotic multi-swarm whale optimizer boosted support vector machine for medical diagnosis , 2020, Appl. Soft Comput..

[43]  Zhun Fan,et al.  Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique , 2009 .

[44]  Zuguo Chen,et al.  Information synergy entropy based multi-feature information fusion for the operating condition identification in aluminium electrolysis , 2021, Inf. Sci..

[45]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[46]  Ying Huang,et al.  Chaos enhanced grey wolf optimization wrapped ELM for diagnosis of paraquat-poisoned patients , 2019, Comput. Biol. Chem..

[47]  Xiao-Zhi Gao,et al.  MPPCEDE: Multi-population parallel co-evolutionary differential evolution for parameter optimization , 2021 .

[48]  Ying Tan,et al.  Improving Metaheuristic Algorithms With Information Feedback Models , 2019, IEEE Transactions on Cybernetics.

[49]  Anna Wang,et al.  Coordinated Operation of Multi-Integrated Energy System Based on Linear Weighted Sum and Grasshopper Optimization Algorithm , 2018, IEEE Access.

[50]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[51]  Xu Chen,et al.  An opposition-based sine cosine approach with local search for parameter estimation of photovoltaic models , 2019, Energy Conversion and Management.

[52]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[53]  Xin Xu,et al.  Adaptive computational chemotaxis based on field in bacterial foraging optimization , 2014, Soft Comput..

[54]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[55]  Qian Zhang,et al.  An efficient chaotic mutative moth-flame-inspired optimizer for global optimization tasks , 2019, Expert Syst. Appl..

[56]  Sankalap Arora,et al.  Chaotic grasshopper optimization algorithm for global optimization , 2019, Neural Computing and Applications.

[57]  Arezoo Zakeri,et al.  Efficient feature selection method using real-valued grasshopper optimization algorithm , 2019, Expert Syst. Appl..

[58]  Huiling Chen,et al.  An Effective Computational Model for Bankruptcy Prediction Using Kernel Extreme Learning Machine Approach , 2017 .

[59]  Hui Huang,et al.  Toward an optimal kernel extreme learning machine using a chaotic moth-flame optimization strategy with applications in medical diagnoses , 2017, Neurocomputing.

[60]  Tong Liu,et al.  A fast approach for detection of erythemato-squamous diseases based on extreme learning machine with maximum relevance minimum redundancy feature selection , 2015, Int. J. Syst. Sci..

[61]  Xuehua Zhao,et al.  Parameters identification of photovoltaic cells and modules using diversification-enriched Harris hawks optimization with chaotic drifts , 2020 .

[62]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[63]  Huiru Zhao,et al.  Short-Term Wind Electric Power Forecasting Using a Novel Multi-Stage Intelligent Algorithm , 2018 .

[64]  Huiling Chen,et al.  Using Blood Indexes to Predict Overweight Statuses: An Extreme Learning Machine-Based Approach , 2015, PloS one.

[65]  Heming Jia,et al.  Modified Grasshopper Algorithm-Based Multilevel Thresholding for Color Image Segmentation , 2019, IEEE Access.

[66]  Hossam Faris,et al.  An enhanced associative learning-based exploratory whale optimizer for global optimization , 2019, Neural Computing and Applications.

[67]  Kiran Kumar Dama,et al.  Diagnosis of faulty gears by modified AlexNet and improved grasshopper optimization algorithm (IGOA) , 2020 .

[68]  Huiling Chen,et al.  Chaotic random spare ant colony optimization for multi-threshold image segmentation of 2D Kapur entropy , 2020, Knowl. Based Syst..

[69]  Yongquan Zhou,et al.  Lévy Flight Trajectory-Based Whale Optimization Algorithm for Global Optimization , 2017, IEEE Access.

[70]  Donghui Wang,et al.  A content-based recommender system for computer science publications , 2018, Knowl. Based Syst..

[71]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[72]  Ardeshir Bahreininejad,et al.  Water cycle algorithm - A novel metaheuristic optimization method for solving constrained engineering optimization problems , 2012 .

[73]  Ziad M. Ali,et al.  An improved approach for robust control of dynamic voltage restorer and power quality enhancement using grasshopper optimization algorithm. , 2019, ISA transactions.

[74]  Chengye Li,et al.  Gaussian mutational chaotic fruit fly-built optimization and feature selection , 2020, Expert Syst. Appl..

[75]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[76]  Yong Wang,et al.  Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization , 2010, Appl. Soft Comput..

[77]  Dacheng Tao,et al.  Top-k Feature Selection Framework Using Robust 0–1 Integer Programming , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[78]  Qiang Li,et al.  An Enhanced Grey Wolf Optimization Based Feature Selection Wrapped Kernel Extreme Learning Machine for Medical Diagnosis , 2017, Comput. Math. Methods Medicine.

[79]  Hui Huang,et al.  Epileptic Seizure Detection in EEG Signals Using a Unified Temporal-Spectral Squeeze-and-Excitation Network , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[80]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[81]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[82]  K. M. Ragsdell,et al.  Optimal Design of a Class of Welded Structures Using Geometric Programming , 1976 .

[83]  Heming Jia,et al.  Hybrid Grasshopper Optimization Algorithm and Differential Evolution for Multilevel Satellite Image Segmentation , 2019, Remote. Sens..

[84]  Rajesh Kumar,et al.  Application and Development of Enhanced Chaotic Grasshopper Optimization Algorithms , 2018 .

[85]  Huiling Chen,et al.  Horizontal and vertical crossover of Harris hawk optimizer with Nelder-Mead simplex for parameter estimation of photovoltaic models , 2020 .

[86]  Azhar Khairuddin,et al.  Placement and sizing of multiple distributed generation and battery swapping stations using grasshopper optimizer algorithm , 2018, Energy.

[87]  Zhang Yi,et al.  IGD Indicator-Based Evolutionary Algorithm for Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[88]  Rabeh Abbassi,et al.  Parameters identification of photovoltaic cell models using enhanced exploratory salp chains-based approach , 2020, Energy.

[89]  Vadlamani Ravi,et al.  Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review , 2007, Eur. J. Oper. Res..

[90]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[91]  Heming Jia,et al.  Hybrid grasshopper optimization algorithm and differential evolution for global optimization , 2019, J. Intell. Fuzzy Syst..

[92]  Ke Li,et al.  Epileptic seizure detection in EEG signals using sparse multiscale radial basis function networks and the Fisher vector approach , 2019, Knowl. Based Syst..

[93]  Pengjun Wang,et al.  Chaos-enhanced synchronized bat optimizer , 2020 .

[94]  Xin-She Yang,et al.  Economic dispatch using chaotic bat algorithm , 2016 .

[95]  Amir Hossein Gandomi,et al.  Chaotic Krill Herd algorithm , 2014, Inf. Sci..

[96]  Seyedali Mirjalili,et al.  Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems , 2015, Neural Computing and Applications.

[97]  Xuehua Zhao,et al.  Dimension decided Harris hawks optimization with Gaussian mutation: Balance analysis and diversity patterns , 2021, Knowl. Based Syst..

[98]  Ahmed A. Ewees,et al.  Improved grasshopper optimization algorithm using opposition-based learning , 2018, Expert Syst. Appl..

[99]  Hong Zhou,et al.  Ultrasound-based differentiation of malignant and benign thyroid Nodules: An extreme learning machine approach , 2017, Comput. Methods Programs Biomed..

[100]  Witold Pedrycz,et al.  Solving Fuzzy Job-Shop Scheduling Problem Using DE Algorithm Improved by a Selection Mechanism , 2020, IEEE Transactions on Fuzzy Systems.

[101]  Xuehua Zhao,et al.  A balanced whale optimization algorithm for constrained engineering design problems , 2019, Applied Mathematical Modelling.

[102]  Carlos A. Coello Coello,et al.  THEORETICAL AND NUMERICAL CONSTRAINT-HANDLING TECHNIQUES USED WITH EVOLUTIONARY ALGORITHMS: A SURVEY OF THE STATE OF THE ART , 2002 .

[103]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[104]  Carlos A. Coello Coello,et al.  An empirical study about the usefulness of evolution strategies to solve constrained optimization problems , 2008, Int. J. Gen. Syst..

[105]  Mingjing Wang,et al.  Orthogonal Nelder-Mead moth flame method for parameters identification of photovoltaic modules , 2020 .

[106]  Huiling Chen,et al.  Multi-objective optimization and multi-criteria decision-making methods for optimal design of standalone photovoltaic system: A comprehensive review , 2021, Renewable and Sustainable Energy Reviews.

[107]  Huimin Zhao,et al.  An Improved Quantum-Inspired Differential Evolution Algorithm for Deep Belief Network , 2020, IEEE Transactions on Instrumentation and Measurement.

[108]  Wenhan Luo,et al.  Video Deblurring via Spatiotemporal Pyramid Network and Adversarial Gradient Prior , 2021, Comput. Vis. Image Underst..

[109]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[110]  Xiaoqin Zhang,et al.  Enhanced Moth-flame optimizer with mutation strategy for global optimization , 2019, Inf. Sci..

[111]  Honglun Wang,et al.  Distributed trajectory optimization for multiple solar-powered UAVs target tracking in urban environment by Adaptive Grasshopper Optimization Algorithm , 2017 .

[112]  Mohd Wazir Mustafa,et al.  Optimal Voltage and Frequency Control of an Islanded Microgrid using Grasshopper Optimization Algorithm , 2018, Energies.

[113]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[114]  Xuehua Zhao,et al.  An improved grasshopper optimization algorithm with application to financial stress prediction , 2018, Applied Mathematical Modelling.

[115]  Huiling Chen,et al.  Ant colony optimization with horizontal and vertical crossover search: Fundamental visions for multi-threshold image segmentation , 2020, Expert Syst. Appl..

[116]  Zhihua Cui,et al.  Monarch butterfly optimization , 2015, Neural Computing and Applications.

[117]  Xuehua Zhao,et al.  Evaluation of constraint in photovoltaic models by exploiting an enhanced ant lion optimizer , 2020 .

[118]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[119]  Amir Hossein Alavi,et al.  An improved NSGA-III algorithm with adaptive mutation operator for Big Data optimization problems , 2018, Future Gener. Comput. Syst..

[120]  Andrew Lewis,et al.  Grasshopper Optimisation Algorithm: Theory and application , 2017, Adv. Eng. Softw..

[121]  Dayou Liu,et al.  Evolving support vector machines using fruit fly optimization for medical data classification , 2016, Knowl. Based Syst..

[122]  Lufeng Hu,et al.  An efficient machine learning approach for diagnosis of paraquat-poisoned patients , 2015, Comput. Biol. Medicine.

[123]  Xiaoqin Zhang,et al.  Pyramid Channel-based Feature Attention Network for image dehazing , 2020, Comput. Vis. Image Underst..

[124]  Kalyanmoy Deb,et al.  GeneAS: A Robust Optimal Design Technique for Mechanical Component Design , 1997 .

[125]  Antonio LaTorre,et al.  A comparison of three large-scale global optimizers on the CEC 2017 single objective real parameter numerical optimization benchmark , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[126]  Shihui Ying,et al.  Projective parameter transfer based sparse multiple empirical kernel learning Machine for diagnosis of brain disease , 2020, Neurocomputing.

[127]  Carlos García-Martínez,et al.  Global and local real-coded genetic algorithms based on parent-centric crossover operators , 2008, Eur. J. Oper. Res..

[128]  A. Kaveh,et al.  A new meta-heuristic method: Ray Optimization , 2012 .

[129]  Huiling Chen,et al.  A multi-strategy enhanced sine cosine algorithm for global optimization and constrained practical engineering problems , 2020, Appl. Math. Comput..

[130]  Junjie Xu,et al.  An effective improved co-evolution ant colony optimisation algorithm with multi-strategies and its application , 2020, Int. J. Bio Inspired Comput..

[131]  Zhengyuan Zhou,et al.  Robust Low-Rank Tensor Recovery with Rectification and Alignment , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[132]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[133]  Seyed Mohammad Mirjalili,et al.  Multi-Verse Optimizer: a nature-inspired algorithm for global optimization , 2015, Neural Computing and Applications.

[134]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..