SCA: A Sine Cosine Algorithm for solving optimization problems

Abstract This paper proposes a novel population-based optimization algorithm called Sine Cosine Algorithm (SCA) for solving optimization problems. The SCA creates multiple initial random candidate solutions and requires them to fluctuate outwards or towards the best solution using a mathematical model based on sine and cosine functions. Several random and adaptive variables also are integrated to this algorithm to emphasize exploration and exploitation of the search space in different milestones of optimization. The performance of SCA is benchmarked in three test phases. Firstly, a set of well-known test cases including unimodal, multi-modal, and composite functions are employed to test exploration, exploitation, local optima avoidance, and convergence of SCA. Secondly, several performance metrics (search history, trajectory, average fitness of solutions, and the best solution during optimization) are used to qualitatively observe and confirm the performance of SCA on shifted two-dimensional test functions. Finally, the cross-section of an aircraft's wing is optimized by SCA as a real challenging case study to verify and demonstrate the performance of this algorithm in practice. The results of test functions and performance metrics prove that the algorithm proposed is able to explore different regions of a search space, avoid local optima, converge towards the global optimum, and exploit promising regions of a search space during optimization effectively. The SCA algorithm obtains a smooth shape for the airfoil with a very low drag, which demonstrates that this algorithm can highly be effective in solving real problems with constrained and unknown search spaces. Note that the source codes of the SCA algorithm are publicly available at http://www.alimirjalili.com/SCA.html .

[1]  Stephen Chen,et al.  Particle swarm optimization with pbest crossover , 2012, 2012 IEEE Congress on Evolutionary Computation.

[2]  Carlos Artemio Coello-Coello,et al.  Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art , 2002 .

[3]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[4]  Xavier Gandibleux,et al.  Hybrid Metaheuristics for Multi-objective Combinatorial Optimization , 2008, Hybrid Metaheuristics.

[5]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[6]  Xin-She Yang,et al.  Flower pollination algorithm: A novel approach for multiobjective optimization , 2014, ArXiv.

[7]  Thomas Stützle,et al.  Stochastic Local Search: Foundations & Applications , 2004 .

[8]  Andrew Lewis,et al.  Biogeography-based optimisation with chaos , 2014, Neural Computing and Applications.

[9]  Gai-Ge Wang,et al.  Image Matching Using a Bat Algorithm with Mutation , 2012 .

[10]  Zhijun Yang,et al.  An ant colony optimization algorithm based on mutation and dynamic pheromone updating , 2004 .

[11]  Thomas Jansen,et al.  UNIVERSITY OF DORTMUND REIHE COMPUTATIONAL INTELLIGENCE COLLABORATIVE RESEARCH CENTER 531 Design and Management of Complex Technical Processes and Systems by means of Computational Intelligence Methods Upper and Lower Bounds for Randomized Search Heuristics in Black-Box Optimization , 2004 .

[12]  Gaige Wang,et al.  A Bat Algorithm with Mutation for UCAV Path Planning , 2012, TheScientificWorldJournal.

[13]  Seyed Taghi Akhavan Niaki,et al.  Optimization of a multiproduct economic production quantity problem with stochastic constraints using sequential quadratic programming , 2015, Knowl. Based Syst..

[14]  Xin-She Yang Test Problems in Optimization , 2010, 1008.0549.

[15]  Gaige Wang,et al.  A Hybrid Metaheuristic DE/CS Algorithm for UCAV Three-Dimension Path Planning , 2012, TheScientificWorldJournal.

[16]  Luo Liu,et al.  A hybrid meta-heuristic DE/CS Algorithm for UCAV path planning , 2012 .

[17]  Wen Yi Lin,et al.  A GA–DE hybrid evolutionary algorithm for path synthesis of four-bar linkage , 2010 .

[18]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[19]  Nasser Ghasem-Aghaee,et al.  A novel ACO-GA hybrid algorithm for feature selection in protein function prediction , 2009, Expert Syst. Appl..

[20]  M. Drela XFOIL: An Analysis and Design System for Low Reynolds Number Airfoils , 1989 .

[21]  Amir Hossein Gandomi,et al.  A chaotic particle-swarm krill herd algorithm for global numerical optimization , 2013, Kybernetes.

[22]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[23]  Anupriya Gogna,et al.  Metaheuristics: review and application , 2013, J. Exp. Theor. Artif. Intell..

[24]  Hamid Salimi,et al.  Stochastic Fractal Search: A powerful metaheuristic algorithm , 2015, Knowl. Based Syst..

[25]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[26]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[27]  Yong Wang,et al.  Combining Multiobjective Optimization With Differential Evolution to Solve Constrained Optimization Problems , 2012, IEEE Transactions on Evolutionary Computation.

[28]  A. M. Natarajan,et al.  A New Approach for Data Clustering Based on PSO with Local Search , 2008, Comput. Inf. Sci..

[29]  Ardeshir Bahreininejad,et al.  Mine blast algorithm: A new population based algorithm for solving constrained engineering optimization problems , 2013, Appl. Soft Comput..

[30]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[31]  Sebastián Lozano,et al.  Metaheuristic optimization frameworks: a survey and benchmarking , 2011, Soft Computing.

[32]  Yuelin Gao,et al.  Particle Swarm Optimization Algorithm with Exponent Decreasing Inertia Weight and Stochastic Mutation , 2009, 2009 Second International Conference on Information and Computing Science.

[33]  Ben Niu,et al.  A Novel PSO-DE-Based Hybrid Algorithm for Global Optimization , 2008, ICIC.

[34]  Marco Dorigo Ant colony optimization , 2004, Scholarpedia.

[35]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[36]  Amir Hossein Gandomi,et al.  Chaotic cuckoo search , 2015, Soft Computing.

[37]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[38]  Zhihua Cui,et al.  Swarm Intelligence and Bio-Inspired Computation: Theory and Applications , 2013 .

[39]  Xin-She Yang,et al.  A new hybrid method based on krill herd and cuckoo search for global optimisation tasks , 2016, Int. J. Bio Inspired Comput..

[40]  John H. Holland,et al.  Cognitive systems based on adaptive algorithms , 1977, SGAR.

[41]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[42]  Wei Zhao,et al.  Test-Sheet Composition Using Analytic Hierarchy Process and Hybrid Metaheuristic Algorithm TS/BBO , 2012 .

[43]  Haibin Duan,et al.  Three-dimension path planning for UCAV using hybrid meta-heuristic ACO-DE algorithm , 2010, Simul. Model. Pract. Theory.

[44]  Rafael S. Parpinelli,et al.  New inspirations in swarm intelligence: a survey , 2011, Int. J. Bio Inspired Comput..

[45]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[46]  Chun Lu,et al.  An improved GA and a novel PSO-GA-based hybrid algorithm , 2005, Inf. Process. Lett..

[47]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[48]  Long Li,et al.  Differential evolution based on covariance matrix learning and bimodal distribution parameter setting , 2014, Appl. Soft Comput..

[49]  Luo Liu,et al.  Hybridizing harmony search with biogeography based optimization for global numerical optimization , 2013 .

[50]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[51]  Angus R. Simpson,et al.  Genetic algorithms compared to other techniques for pipe optimization , 1994 .

[52]  Alex A. Freitas,et al.  A hybrid PSO/ACO algorithm for discovering classification rules in data mining , 2008 .

[53]  Suash Deb,et al.  A Novel Cuckoo Search with Chaos Theory and Elitism Scheme , 2014, 2014 International Conference on Soft Computing and Machine Intelligence.

[54]  Xin-She Yang,et al.  Firefly algorithm, stochastic test functions and design optimisation , 2010, Int. J. Bio Inspired Comput..

[55]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[56]  Amir Hossein Gandomi,et al.  Chaotic Krill Herd algorithm , 2014, Inf. Sci..

[57]  Ali Kaveh,et al.  Colliding Bodies Optimization method for optimum discrete design of truss structures , 2014 .

[58]  Amir Hossein Gandomi,et al.  Hybrid krill herd algorithm with differential evolution for global numerical optimization , 2014, Neural Computing and Applications.

[59]  Christian Blum,et al.  Hybrid Metaheuristics: An Introduction , 2008, Hybrid Metaheuristics.

[60]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[61]  Gaige Wang,et al.  A Novel Hybrid Bat Algorithm with Harmony Search for Global Numerical Optimization , 2013, J. Appl. Math..

[62]  Qingfu Zhang,et al.  Enhancing the search ability of differential evolution through orthogonal crossover , 2012, Inf. Sci..

[63]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[64]  Amir Hossein Alavi,et al.  An effective krill herd algorithm with migration operator in biogeography-based optimization , 2014 .

[65]  Abdolreza Hatamlou,et al.  Black hole: A new heuristic optimization approach for data clustering , 2013, Inf. Sci..

[66]  Samad Ahmadi,et al.  Optimizing a bi-objective reliable facility location problem with adapted stochastic measures using tuned-parameter multi-objective algorithms , 2016, Knowl. Based Syst..

[67]  Frederick Ducatelle,et al.  Ant colony optimization and local search for bin packing and cutting stock problems , 2004, J. Oper. Res. Soc..

[68]  Ali Husseinzadeh Kashan,et al.  League Championship Algorithm (LCA): An algorithm for global optimization inspired by sport championships , 2014, Appl. Soft Comput..

[69]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[70]  Konstantinos G. Margaritis,et al.  On benchmarking functions for genetic algorithms , 2001, Int. J. Comput. Math..

[71]  Berthold Schneider,et al.  Simulationsmethoden in der Medizin und Biologie , 1978 .

[72]  Shailesh Tiwari,et al.  Physics-Inspired Optimization Algorithms: A Survey , 2013 .

[73]  Patrick Siarry,et al.  A survey on optimization metaheuristics , 2013, Inf. Sci..

[74]  Amir Hossein Gandomi,et al.  A new hybrid method based on krill herd and cuckoo search for global optimisation tasks , 2016, Int. J. Bio Inspired Comput..