Detecting change and dealing with uncertainty in imperfect evolutionary environments

Imperfection of information is a part of our daily life; however, it is usually ignored in learning based on evolutionary approaches. In this paper we develop an Imperfect Evolutionary System that provides an uncertain and chaotic imperfect environment that presents new challenges to its habitants. We then propose an intelligent methodology which is capable of learning in such environments. Detecting changes and adapting to the new environment is crucial to exploring the search space and exploiting any new opportunities that may arise. To deal with these uncertain and challenging environments, we propose a novel change detection strategy based on a Particle Swarm Optimization system which is hybridized with an Artificial Neural Network. This approach maintains a balance between exploitation and exploration during the search process. A comparison of approaches using different Particle Swarm Optimization algorithms show that the ability of our learning approach to detect changes and adapt as per the new demands of the environment is high.

[1]  M. R. Meybodi,et al.  A multi-role cellular PSO for dynamic environments , 2009, 2009 14th International CSI Computer Conference.

[2]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[3]  Dumitru Dumitrescu,et al.  A collaborative model for tracking optima in dynamic environments , 2007, 2007 IEEE Congress on Evolutionary Computation.

[4]  Georgios N. Yannakakis,et al.  A Generic Approach for Obtaining Higher Entertainment in Predator/Prey Computer Games , 2005 .

[5]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[6]  John Levine,et al.  Emerging Cooperation With Minimal Effort: Rewarding Over Mimicking , 2007, IEEE Transactions on Evolutionary Computation.

[7]  Jürgen Teich,et al.  Pareto-Front Exploration with Uncertain Objectives , 2001, EMO.

[8]  Dirk V. Arnold,et al.  Noisy Optimization With Evolution Strategies , 2002, Genetic Algorithms and Evolutionary Computation.

[9]  Shengxiang Yang,et al.  Particle Swarm Optimization With Composite Particles in Dynamic Environments , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Bin Li,et al.  Multi-strategy ensemble particle swarm optimization for dynamic optimization , 2008, Inf. Sci..

[11]  Peter J. Bentley,et al.  Dynamic Search With Charged Swarms , 2002, GECCO.

[12]  Changhe Li,et al.  Fast Multi-Swarm Optimization for Dynamic Optimization Problems , 2008, 2008 Fourth International Conference on Natural Computation.

[13]  Mohammad Reza Meybodi,et al.  A hibernating multi-swarm optimization algorithm for dynamic environments , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[14]  Jürgen Branke,et al.  Multi-swarm Optimization in Dynamic Environments , 2004, EvoWorkshops.

[15]  Allen Newell,et al.  GPS, a program that simulates human thought , 1995 .

[16]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[17]  Shengxiang Yang,et al.  Compound Particle Swarm Optimization in Dynamic Environments , 2008, EvoWorkshops.

[18]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[19]  M. Minsky The Society of Mind , 1986 .

[20]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.

[21]  Xiaodong Li,et al.  Comparing particle swarms for tracking extrema in dynamic environments , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[22]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[23]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer for noisy and dynamic environments , 2006, Genetic Programming and Evolvable Machines.

[24]  Changhe Li,et al.  A clustering particle swarm optimizer for dynamic optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[25]  H. Beyer,et al.  Noisy Local Optimization with Evolution Strategies , 2002 .

[26]  Mohammad Reza Meybodi,et al.  Cellular PSO: A PSO for Dynamic Environments , 2009, ISICA.

[27]  Russell C. Eberhart,et al.  Adaptive particle swarm optimization: detection and response to dynamic systems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[28]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[29]  L. Zadeh Fuzzy sets as a basis for a theory of possibility , 1999 .

[30]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[31]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[32]  Randy Goebel,et al.  Computational intelligence - a logical approach , 1998 .

[33]  Xiaodong Li,et al.  Particle Swarms for Dynamic Optimization Problems , 2008, Swarm Intelligence.

[34]  Peter J. Angeline,et al.  Tracking Extrema in Dynamic Environments , 1997, Evolutionary Programming.

[35]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[36]  Xin Yao,et al.  Evolutionary computation : theory and applications , 1999 .

[37]  H. Beyer Evolutionary algorithms in noisy environments : theoretical issues and guidelines for practice , 2000 .

[38]  Yan Su,et al.  Imperfect Evolutionary Systems , 2007, IEEE Transactions on Evolutionary Computation.

[39]  Johan de Kleer,et al.  Readings in qualitative reasoning about physical systems , 1990 .

[40]  Oscar Castillo,et al.  Genetic Optimization of Neural Networks for Person Recognition Based on the Iris , 2012 .

[41]  Tim M. Blackwell,et al.  Swarms in Dynamic Environments , 2003, GECCO.

[42]  Evan J. Hughes,et al.  Evolutionary Multi-objective Ranking with Uncertainty and Noise , 2001, EMO.

[43]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[44]  Oscar Castillo,et al.  Interval type-2 fuzzy weight adjustment for backpropagation neural networks with application in time series prediction , 2014, Inf. Sci..

[45]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[46]  Simon M. Lucas,et al.  Cellz: a simple dynamic game for testing evolutionary algorithms , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[47]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[48]  R. Miikkulainen,et al.  Guest Editorial Special Issue: Evolutionary Computation and Games , 2005 .