Evolving neural network as a decision support system — Controller for a game of “2048” case study

The paper proposes an approach to designing the neuro-genetic self-learning decision support system. The system is based on neural networks being adaptively learned by evolutionary mechanism, forming an evolved neural network. Presented learning algorithm enables for a selection of the neural network structure by establishing or removing of connections between the neurons, and then for a finding the beast suited values of the network weights and biases. The algorithm was validated on problem of learning to play the game of “2048”. The game has in fact very simple rules however it is very important to have a proper control strategy in order to gain high score. Moreover, existence of random factors makes it more difficult. The evolved neural controller is trying itself to discover and to learn the best strategy leading to the highest score. In the result, the controller has obtained a game score at a level similar to medium advanced human player. It is interesting that strategies developed by the controller are similar to the strategies that are applied by experienced human players. The paper provides an overview and an analysis of the impact of the main system factors on obtained results. Finally, the most important findings are indicated and future work is specified.

[1]  Matthew L Baer,et al.  Coevolution of Multiagent Systems using NEAT , 2016 .

[2]  Wilfried Elmenreich,et al.  Towards the light — Comparing evolved neural network controllers and Finite State Machine controllers , 2012, Proceedings of the 10th International Workshop on Intelligent Solutions in Embedded Systems.

[3]  Risto Miikkulainen,et al.  Efficient evolution of neural network topologies , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[4]  Risto Miikkulainen,et al.  Real-Time Evolution of Neural Networks in the NERO Video Game , 2006, AAAI.

[5]  Wilfried Elmenreich,et al.  Evolving Neural Network Controllers for a Team of Self-Organizing Robots , 2010, J. Robotics.

[6]  Christian Igel,et al.  Neuroevolution for reinforcement learning using evolution strategies , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[7]  Kenneth O. Stanley,et al.  Interactive genetic engineering of evolved video game content , 2010, PCGames@FDG.

[8]  W. Elmenreich,et al.  Genetic Evolution of a Neural Network for the Autonomous Control of a Four-Wheeled Robot , 2007, 2007 Sixth Mexican International Conference on Artificial Intelligence, Special Session (MICAI).

[9]  Wilfried Elmenreich,et al.  FREVO: A Tool for Evolving and Evaluating Self-Organizing Systems , 2012, 2012 IEEE Sixth International Conference on Self-Adaptive and Self-Organizing Systems Workshops.

[10]  Kenneth O. Stanley,et al.  A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks , 2009, Artificial Life.

[11]  Hani Hagras,et al.  Evolving spiking neural network controllers for autonomous robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  Kenneth O. Stanley,et al.  Automatic Content Generation in the Galactic Arms Race Video Game , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[13]  Andres S Perez-Bergquist Applying ESP and Region Specialists to Neuro-Evolution for Go , 2001 .

[14]  Risto Miikkulainen,et al.  Incremental Evolution of Complex General Behavior , 1997, Adapt. Behav..

[15]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 2004 .

[16]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[17]  S. McKinnon,et al.  Generations , 1933, The Classical Review.

[18]  José Neves,et al.  Evolution of neural networks for classification and regression , 2007, Neurocomputing.

[19]  Risto Miikkulainen,et al.  Solving Non-Markovian Control Tasks with Neuro-Evolution , 1999, IJCAI.