An Adaptive Multi-Population Optimization Algorithm for Global Continuous Optimization

Nowadays, there are various optimization problems that exact mathematical methods are not applicable. Metaheuristics are considered as efficient approaches for finding the solutions. Yet there are many real-world problems that consist of different properties. For instance, financial portfolio optimization may contain many dimensions for different sets of assets, which suggests the need of a more adaptive metaheuristic method for tackling such problems. However, few existing metaheuristics can achieve robust performance across these variable problems even though they may obtain impressive results in specific benchmark problems. In this paper, a metaheuristic named the Adaptive Multi-Population Optimization (AMPO) is proposed for continuous optimization. The algorithm hybridizes yet modifies several useful operations like mutation and memory retention from evolutionary algorithms and swarm intelligence (SI) techniques in a multi-population manner. Furthermore, the diverse control on multiple populations, solution cloning and reset operation are designed. Compared with other metaheuristics, the AMPO can attain an adaptive balance between the capabilities of exploration and exploitation for various optimization problems. To demonstrate its effectiveness, the AMPO is evaluated on 28 well-known benchmark functions. Also, the parameter sensitivity analysis and search behavior study are conducted. Finally, the AMPO is validated on its applicability through a portfolio optimization problem as a challenging example of real-world applications. The benchmark results show that the AMPO achieves a better performance than those of nine state-of-the-art metaheuristics including the IEEE CEC winning algorithms, recent SI and multi-population/hybrid metaheuristics. Besides, the AMPO can consistently produce a good performance in portfolio optimization.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  John E. Beasley,et al.  OR-Library: Distributing Test Problems by Electronic Mail , 1990 .

[3]  Vincent Tam,et al.  A Novel Meta-Heuristic Optimization Algorithm Inspired by the Spread of Viruses , 2020, ArXiv.

[4]  Joseph R. Kasprzyk,et al.  Introductory overview: Optimization using evolutionary algorithms and other metaheuristics , 2019, Environ. Model. Softw..

[5]  Bart L. MacCarthy,et al.  Mean-VaR portfolio optimization: A nonparametric approach , 2017, Eur. J. Oper. Res..

[6]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[7]  Yi Wang,et al.  Particle Swarm Optimization (PSO) for the constrained portfolio optimization problem , 2011, Expert Syst. Appl..

[8]  A. E. Eiben,et al.  On Evolutionary Exploration and Exploitation , 1998, Fundam. Informaticae.

[9]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[10]  Francesco Cesarone,et al.  Real-world datasets for portfolio selection and solutions of some stochastic dominance portfolio models , 2016, Data in brief.

[11]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[12]  Zhile Yang,et al.  Multi-population techniques in nature inspired optimization algorithms: A comprehensive survey , 2019, Swarm Evol. Comput..

[13]  Dervis Karaboga,et al.  A comprehensive survey: artificial bee colony (ABC) algorithm and applications , 2012, Artificial Intelligence Review.

[14]  Gaige Wang,et al.  Moth search algorithm: a bio-inspired metaheuristic algorithm for global optimization problems , 2016, Memetic Computing.

[15]  Jack L. Treynor,et al.  MUTUAL FUND PERFORMANCE* , 2007 .

[16]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[17]  Rafael S. Parpinelli,et al.  New inspirations in swarm intelligence: a survey , 2011, Int. J. Bio Inspired Comput..

[18]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[19]  Ali Sadollah,et al.  A cooperative particle swarm optimizer with stochastic movements for computationally expensive numerical optimization problems , 2016, J. Comput. Sci..

[20]  Victor O. K. Li,et al.  A social spider algorithm for global optimization , 2015, Appl. Soft Comput..

[21]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[22]  Aboul Ella Hassanien,et al.  A BA-based algorithm for parameter optimization of Support Vector Machine , 2017, Pattern Recognit. Lett..

[23]  Hossam Faris,et al.  Harris hawks optimization: Algorithm and applications , 2019, Future Gener. Comput. Syst..

[24]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[25]  Tolga Ensari,et al.  Decision of Neural Networks Hyperparameters with a Population-Based Algorithm , 2018, LOD.

[26]  Angel A. Juan,et al.  Metaheuristics for rich portfolio optimisation and risk management: Current state and future trends , 2019, Operations Research Perspectives.

[27]  Huiling Chen,et al.  Slime mould algorithm: A new method for stochastic optimization , 2020, Future Gener. Comput. Syst..

[28]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[29]  Dayang N. A. Jawawi,et al.  Electromagnetic field optimization: A physics-inspired metaheuristic optimization algorithm , 2016, Swarm Evol. Comput..

[30]  Kenneth Sörensen,et al.  Metaheuristics - the metaphor exposed , 2015, Int. Trans. Oper. Res..

[31]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[32]  Michel Gendreau,et al.  A review of dynamic vehicle routing problems , 2013, Eur. J. Oper. Res..

[33]  Samia Nefti-Meziani,et al.  A Comprehensive Review of Swarm Optimization Algorithms , 2015, PloS one.

[34]  Xin-She Yang Harmony Search as a Metaheuristic Algorithm , 2009 .

[35]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[36]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[37]  Ali Wagdy Mohamed,et al.  Real parameter optimization by an effective differential evolution algorithm , 2013 .

[38]  Leandro dos Santos Coelho,et al.  Earthworm optimisation algorithm: a bio-inspired metaheuristic algorithm for global optimisation problems , 2018, Int. J. Bio Inspired Comput..

[39]  Omid Bozorg-Haddad,et al.  Meta-Heuristic and Evolutionary Algorithms for Engineering Optimization , 2017 .

[40]  Francisco Herrera,et al.  An Insight into Bio-inspired and Evolutionary Algorithms for Global Optimization: Review, Analysis, and Lessons Learnt over a Decade of Competitions , 2018, Cognitive Computation.

[41]  Zhi-hui Zhan,et al.  A multi-swarm particle swarm optimization algorithm based on dynamical topology and purposeful detecting , 2018, Appl. Soft Comput..

[42]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[43]  Hossein Zare-Behtash,et al.  State-of-the-art in aerodynamic shape optimisation methods , 2018, Appl. Soft Comput..

[44]  Seyed Mostafa Bozorgi,et al.  IWOA: An improved whale optimization algorithm for optimization problems , 2019, J. Comput. Des. Eng..

[45]  Xin-She Yang,et al.  A literature survey of benchmark functions for global optimisation problems , 2013, Int. J. Math. Model. Numer. Optimisation.

[46]  Konstantinos Liagkouras,et al.  Multiobjective Evolutionary Algorithms for Portfolio Management: A comprehensive literature review , 2012, Expert Syst. Appl..

[47]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[48]  Rohit Salgotra,et al.  The naked mole-rat algorithm , 2019, Neural Computing and Applications.

[49]  Václav Snásel,et al.  Metaheuristic design of feedforward neural networks: A review of two decades of research , 2017, Eng. Appl. Artif. Intell..

[50]  Maria José Pereira Dantas,et al.  Analysis of new approaches used in portfolio optimization: a systematic literature review , 2021, Production.

[51]  Pradnya A. Vikhar,et al.  Evolutionary algorithms: A critical review and its future prospects , 2016, 2016 International Conference on Global Trends in Signal Processing, Information Computing and Communication (ICGTSPICC).

[52]  A. Stuart,et al.  Portfolio Selection: Efficient Diversification of Investments , 1959 .

[53]  Albert Y. Zomaya Handbook of Nature-Inspired and Innovative Computing - Integrating Classical Models with Emerging Technologies , 2006 .

[54]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[55]  Francisco Herrera,et al.  SHADE with Iterative Local Search for Large-Scale Global Optimization , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[56]  Liang Gao,et al.  Queuing search algorithm: A novel metaheuristic algorithm for solving engineering optimization problems , 2018, Applied Mathematical Modelling.

[57]  Zhihua Cui,et al.  Monarch butterfly optimization , 2015, Neural Computing and Applications.

[58]  Seyed Jalaleddin Mousavirad,et al.  Human mental search: a new population-based metaheuristic optimization algorithm , 2017, Applied Intelligence.

[59]  Milan Tuba,et al.  Fireworks algorithm applied to constrained portfolio optimization problem , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[60]  Keith L. Downing,et al.  Introduction to Evolutionary Algorithms , 2006 .

[61]  Kwan Lawrence Yeung,et al.  A Study on Parameter Sensitivity Analysis of the Virus Spread Optimization , 2020, 2020 IEEE Symposium Series on Computational Intelligence (SSCI).

[62]  Ibrahim Berkan Aydilek A hybrid firefly and particle swarm optimization algorithm for computationally expensive numerical problems , 2018, Appl. Soft Comput..

[63]  Steven R. Young,et al.  Optimizing deep learning hyper-parameters through an evolutionary algorithm , 2015, MLHPC@SC.

[64]  S. Shadravan,et al.  The Sailfish Optimizer: A novel nature-inspired metaheuristic algorithm for solving constrained engineering optimization problems , 2019, Eng. Appl. Artif. Intell..

[65]  Victor O. K. Li,et al.  Chemical-Reaction-Inspired Metaheuristic for Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[66]  Andrew Lewis,et al.  Grasshopper Optimisation Algorithm: Theory and application , 2017, Adv. Eng. Softw..

[67]  Q. H. Zhai,et al.  Whale Optimization Algorithm for Multiconstraint Second-Order Stochastic Dominance Portfolio Optimization , 2020, Comput. Intell. Neurosci..

[68]  Huilong Duan,et al.  A Task Operation Model for Resource Allocation Optimization in Business Process Management , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[69]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[70]  Kun Gao,et al.  Infrared and visual image registration based on mutual information with a combined particle swarm optimization – Powell search algorithm , 2016 .

[71]  Ponnuthurai N. Suganthan,et al.  Ensemble sinusoidal differential covariance matrix adaptation with Euclidean neighborhood for solving CEC2017 benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[72]  Christian Igel,et al.  Evolutionary tuning of multiple SVM parameters , 2005, ESANN.

[73]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[74]  Pengjun Wang,et al.  Efficient multi-population outpost fruit fly-driven optimizers: Framework and advances in support vector machines , 2020, Expert Syst. Appl..

[75]  Nazmul Siddique,et al.  Nature-Inspired Computing: Physics and Chemistry-Based Algorithms , 2017 .