Solving high-dimensional global optimization problems using an improved sine cosine algorithm

Abstract The sine cosine algorithm (SCA) is a relatively novel population-based optimization technique that has been proven competitive with other algorithms and it has received significant interest from researchers in different fields. However, similar to other population-based algorithms, SCA tends to be trapped in local optima and unbalanced exploitation. Additionally, to our limited knowledge, the present SCA and its variants have not been applied to the high-dimensional global optimization problems. This paper presents an improved version of the SCA (ISCA) for solving high-dimensional problems. A modified position-updating equation by introducing inertia weight is proposed to accelerate convergence and avoid falling into the local optima. In addition, to balance the exploration and exploitation of the SCA, we present a new nonlinear conversion parameter decreasing strategy based on the Gaussian function. The effectiveness of the proposed ISCA is evaluated using 24 benchmark high-dimensional (D = 30, 100, 500, 1000, and 5000) functions, large-scale global optimization problems from the IEEE CEC2010 competition, and several real-world engineering applications. The comparisons show that the proposed ISCA can better escape from local optima with faster convergence than both the traditional SCA and other population-based algorithms.

[1]  A. Gandomi Interior search algorithm (ISA): a novel approach for global optimization. , 2014, ISA transactions.

[2]  Vimal J. Savsani,et al.  Multi-objective sine-cosine algorithm (MO-SCA) for multi-objective engineering design problems , 2017, Neural Computing and Applications.

[3]  Qin Zhang,et al.  A best-path-updating information-guided ant colony optimization algorithm , 2018, Inf. Sci..

[4]  Dipti Srinivasan,et al.  Hybridizing genetic algorithm with differential evolution for solving the unit commitment scheduling problem , 2015, Swarm Evol. Comput..

[5]  Carlos A. Coello Coello,et al.  Constraint-handling in genetic algorithms through the use of dominance-based tournament selection , 2002, Adv. Eng. Informatics.

[6]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[7]  Mostafa Meshkat,et al.  A novel weighted update position mechanism to improve the performance of sine cosine algorithm , 2017, 2017 5th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS).

[8]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[9]  Amir Hossein Gandomi,et al.  Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems , 2011, Engineering with Computers.

[10]  Aboul Ella Hassanien,et al.  ASCA-PSO: Adaptive sine cosine optimization algorithm integrated with particle swarm for pairwise local sequence alignment , 2018, Expert Syst. Appl..

[11]  Ravi Kumar Jatoth,et al.  Hybridizing sine cosine algorithm with differential evolution for global optimization and object tracking , 2018, Appl. Soft Comput..

[12]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[13]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[14]  P. N. Suganthan,et al.  Multi-population differential evolution with balanced ensemble of mutation strategies for large-scale global optimization , 2015, Appl. Soft Comput..

[15]  R. M. Rizk-Allah,et al.  Hybridizing sine cosine algorithm with multi-orthogonal search strategy for engineering design problems , 2018, J. Comput. Des. Eng..

[16]  Christian Blum,et al.  An iterated greedy algorithm for the large-scale unrelated parallel machines scheduling problem , 2013, Comput. Oper. Res..

[17]  Bin Li,et al.  Variance priority based cooperative co-evolution differential evolution for large scale global optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[18]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[19]  Jianzhou Wang,et al.  A novel hybrid forecasting system of wind speed based on a newly developed multi-objective sine cosine algorithm , 2018 .

[20]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[21]  Jianjun Jiao,et al.  An exploration-enhanced grey wolf optimizer to solve high-dimensional numerical optimization , 2018, Eng. Appl. Artif. Intell..

[22]  Jenn-Long Liu,et al.  Novel orthogonal simulated annealing with fractional factorial analysis to solve global optimization problems , 2005 .

[23]  Francisco Herrera,et al.  MA-SW-Chains: Memetic algorithm based on local search chains for large scale continuous global optimization , 2010, IEEE Congress on Evolutionary Computation.

[24]  Shang He,et al.  An improved particle swarm optimizer for mechanical design optimization problems , 2004 .

[25]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[26]  Kedar Nath Das,et al.  A modified competitive swarm optimizer for large scale optimization problems , 2017, Appl. Soft Comput..

[27]  Marcin Wozniak,et al.  Hybrid neuro-heuristic methodology for simulation and control of dynamic systems over time interval , 2017, Neural Networks.

[28]  Ling Wang,et al.  An effective co-evolutionary differential evolution for constrained optimization , 2007, Appl. Math. Comput..

[29]  M. Hariharan,et al.  Sine–cosine algorithm for feature selection with elitism strategy and new updating mechanism , 2017, Neural Comput. Appl..

[30]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[31]  Alkin Yurtkuran,et al.  An adaptive artificial bee colony algorithm for global optimization , 2015, Appl. Math. Comput..

[32]  Wenjian Luo,et al.  Differential evolution with dynamic stochastic selection for constrained optimization , 2008, Inf. Sci..

[33]  Bin Xu,et al.  An ensemble algorithm with self-adaptive learning techniques for high-dimensional numerical optimization , 2014, Appl. Math. Comput..

[34]  Siamak Talatahari,et al.  An improved ant colony optimization for constrained engineering design problems , 2010 .

[35]  Qian Wang,et al.  A modified artificial bee colony algorithm based on converge-onlookers approach for global optimization , 2013, Appl. Math. Comput..

[36]  José Manuel Benítez,et al.  A high performance memetic algorithm for extremely high-dimensional problems , 2015, Inf. Sci..

[37]  Seema Agrawal,et al.  Self organizing migrating algorithm with quadratic interpolation for solving large scale global optimization problems , 2016, Appl. Soft Comput..

[38]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[39]  Parham Moradi,et al.  Velocity based artificial bee colony algorithm for high dimensional continuous optimization problems , 2014, Eng. Appl. Artif. Intell..

[40]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[41]  Masao Fukushima,et al.  Derivative-Free Filter Simulated Annealing Method for Constrained Continuous Global Optimization , 2006, J. Glob. Optim..

[42]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[43]  Yong Wang,et al.  Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization , 2010, Appl. Soft Comput..

[44]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[45]  Adil Baykasoglu,et al.  Adaptive firefly algorithm with chaos for mechanical design optimization problems , 2015, Appl. Soft Comput..

[46]  Xuelong Li,et al.  Harmonious Genetic Clustering , 2018, IEEE Transactions on Cybernetics.

[47]  Changyong Liang,et al.  An effective multiagent evolutionary algorithm integrating a novel roulette inversion operator for engineering optimization , 2009, Appl. Math. Comput..

[48]  Xiaoyong Liu,et al.  Parameter optimization of support vector regression based on sine cosine algorithm , 2018, Expert Syst. Appl..

[49]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[50]  Marcin Wozniak,et al.  Polar Bear Optimization Algorithm: Meta-Heuristic with Fast Population Movement and Dynamic Birth and Death Mechanism , 2017, Symmetry.

[51]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[52]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[53]  Zhijian Wu,et al.  Parallel differential evolution with self-adapting control parameters and generalized opposition-based learning for solving high-dimensional optimization problems , 2013, J. Parallel Distributed Comput..

[54]  F. Liu,et al.  An improved QPSO algorithm and its application in the high-dimensional complex problems , 2014 .

[55]  Diego Oliva,et al.  An improved Opposition-Based Sine Cosine Algorithm for global optimization , 2017, Expert Syst. Appl..

[56]  Bijaya K. Panigrahi,et al.  Ageist Spider Monkey Optimization algorithm , 2016, Swarm Evol. Comput..

[57]  Wenbing Tao,et al.  Iterative image segmentation with feature driven heuristic four-color labeling , 2018, Pattern Recognit..

[58]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[59]  Michel Gendreau,et al.  An efficient variable neighborhood search heuristic for very large scale vehicle routing problems , 2007, Comput. Oper. Res..

[60]  Longquan Yong,et al.  A harmony search algorithm for high-dimensional multimodal optimization problems , 2015, Digit. Signal Process..

[61]  Tapabrata Ray,et al.  A socio-behavioural simulation model for engineering design optimization , 2002 .

[62]  Antônio José da Silva Neto,et al.  A constrained ITGO heuristic applied to engineering optimization , 2018, Expert Syst. Appl..

[63]  Adil Baykasoglu,et al.  Design optimization with chaos embedded great deluge algorithm , 2012, Appl. Soft Comput..

[64]  Carlos A. Coello Coello,et al.  An empirical study about the usefulness of evolution strategies to solve constrained optimization problems , 2008, Int. J. Gen. Syst..

[65]  Mostafa Meshkat,et al.  A novel sine and cosine algorithm for global optimization , 2017, 2017 7th International Conference on Computer and Knowledge Engineering (ICCKE).

[66]  Sebastián Ventura,et al.  Extremely high-dimensional optimization with MapReduce: Scaling functions and algorithm , 2017, Inf. Sci..

[67]  Zheng Li,et al.  Expert Systems With Applications , 2022 .

[68]  Hossam Faris,et al.  Optimizing connection weights in neural networks using the whale optimization algorithm , 2016, Soft Computing.

[69]  Alberto Cano,et al.  100 Million dimensions large-scale global optimization using distributed GPU computing , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[70]  Sanyang Liu,et al.  A Novel Artificial Bee Colony Algorithm Based on Modified Search Equation and Orthogonal Learning , 2013, IEEE Transactions on Cybernetics.

[71]  Nitin Gupta,et al.  Optimal planning of distributed energy resources in harmonics polluted distribution system , 2017, Swarm Evol. Comput..

[72]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[73]  Vijander Singh,et al.  A novel nature-inspired algorithm for optimization: Squirrel search algorithm , 2019, Swarm Evol. Comput..

[74]  Mir M. Atiqullah,et al.  SIMULATED ANNEALING AND PARALLEL PROCESSING: AN IMPLEMENTATION FOR CONSTRAINED GLOBAL DESIGN OPTIMIZATION , 2000 .

[75]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[76]  Tung-Kuan Liu,et al.  Hybrid Taguchi-genetic algorithm for global numerical optimization , 2004, IEEE Transactions on Evolutionary Computation.

[77]  Marcin Wozniak,et al.  Bio-inspired methods modeled for respiratory disease detection from medical images , 2018, Swarm Evol. Comput..

[78]  Ajoy Kumar Chakraborty,et al.  Solution of short-term hydrothermal scheduling using sine cosine algorithm , 2018, Soft Comput..

[79]  Seyed Mohammad Mirjalili,et al.  Multi-Verse Optimizer: a nature-inspired algorithm for global optimization , 2015, Neural Computing and Applications.

[80]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[81]  Mustafa Servet Kiran,et al.  A modification of tree-seed algorithm using Deb's rules for constrained optimization , 2018, Appl. Soft Comput..

[82]  Chao Wang,et al.  A differential evolution algorithm with cooperative coevolutionary selection operation for high-dimensional optimization , 2014, Optim. Lett..

[83]  Ivona Brajevic,et al.  An upgraded artificial bee colony (ABC) algorithm for constrained optimization problems , 2012, Journal of Intelligent Manufacturing.

[84]  Steven Li,et al.  Solving large-scale multidimensional knapsack problems with a new binary harmony search algorithm , 2015, Comput. Oper. Res..

[85]  Wei Chu,et al.  A new evolutionary search strategy for global optimization of high-dimensional problems , 2011, Inf. Sci..

[86]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[87]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[88]  Tapabrata Ray,et al.  Society and civilization: An optimization algorithm based on the simulation of social behavior , 2003, IEEE Trans. Evol. Comput..

[89]  Hsiao-Dong Chiang,et al.  A Novel Consensus-Based Particle Swarm Optimization-Assisted Trust-Tech Methodology for Large-Scale Global Optimization , 2017, IEEE Transactions on Cybernetics.