Tracking the Exploration and Exploitation in Stochastic Population-Based Nature-Inspired Algorithms Using Recurrence Plots

The success of every stochastic population-based nature-inspired algorithms is characterized through the dichotomy of exploration and exploitation. In general, exploration refers to the evaluation of points in previously untested areas of a search space, while exploitation refers to evaluation of points in close vicinity to previously visited points. How to balance both components properly during the evolutionary process is still considered as a topical problem in the evolutionary computation community. In this paper, we propose a recurrence plot visualization method for evaluating this process. Our analysis shows that recurrence plots are highly appropriate for revealing how particular algorithms balance exploration and exploitation.

[1]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[2]  Xin-She Yang,et al.  Firefly algorithm, stochastic test functions and design optimisation , 2010, Int. J. Bio Inspired Comput..

[3]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[4]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[5]  Xin-She Yang,et al.  A literature survey of benchmark functions for global optimisation problems , 2013, Int. J. Math. Model. Numer. Optimisation.

[6]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[7]  Ivan Zelinka,et al.  Phase Transitions in Swarm Optimization Algorithms , 2018, UCNC.

[8]  Tobias Rawald,et al.  PyRQA - Conducting recurrence quantification analysis on very long time series efficiently , 2017, Comput. Geosci..

[9]  J. Kurths,et al.  Recurrence-plot-based measures of complexity and their application to heart-rate-variability data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[11]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[12]  C L Webber,et al.  Dynamical assessment of physiological systems and states using recurrence plot strategies. , 1994, Journal of applied physiology.

[13]  Jürgen Kurths,et al.  Unified functional network and nonlinear time series analysis for complex systems science: The pyunicorn package. , 2015, Chaos.

[14]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[15]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[16]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.