ReAd: reactive-adaptive methodology to enable evolving intelligent agents for virtual environments

This paper describes our novel reactive-adaptive methodology (ReAd) for the creation of Intelligent Agents capable of evolving to self-develop, in virtual environments. We start with AI concepts, which are well established for the implementation of character behaviour in serious games, such as Fuzzy Logic, the Belief-Desire-Intention model (BDI), and Finite State Machines (FSM); and discuss their characteristics. In particular for BDI and FSM, we analyse their limitations for being manipulated at run-time, which in turn limits their use in evolvable systems. We present a novel combination of these techniques, based on a Rational-Reactive structure (RaRe) to optimize their performance and enable the process of online self-adaptation so that they can be used to create evolving intelligent agents. The focus of the work is in enabling a structure to be evolvable; the detail of the adaptation process itself is not in the critical domain of this paper. We present an analysis of our system in a test scenario, where the standard implementation is compared to our novel ReAd methodology.

[1]  Anand S. Rao,et al.  An architecture for real-time reasoning and system control , 1992, IEEE Expert.

[2]  Anand S. Rao,et al.  Modeling Rational Agents within a BDI-Architecture , 1997, KR.

[3]  M. C. Rodas,et al.  Analysis of organized asymmetry development using artificial cellular differentiation models , 2009, 2009 IEEE Workshop on Evolving and Self-Developing Intelligent Systems.

[4]  David A. Elizondo,et al.  Current Trends on Knowledge Extraction and Neural Networks , 2005, ICANN.

[5]  Jonathan H. Connell,et al.  SSS: a hybrid architecture applied to robot navigation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[6]  Michael R. Genesereth,et al.  Logical foundations of artificial intelligence , 1987 .

[7]  Véra Kůrková,et al.  Artificial Neural Networks - ICANN 2008 , 18th International Conference, Prague, Czech Republic, September 3-6, 2008, Proceedings, Part I , 2008, ICANN.

[8]  Lakhmi C. Jain,et al.  Computational Intelligence in Games , 2005, IEEE Transactions on Neural Networks.

[9]  Winfried Lamersdorf,et al.  Jadex: A BDI Reasoning Engine , 2005, Multi-Agent Programming.

[10]  Michael Fisher,et al.  A Survey of Concurrent METATEM - the Language and its Applications , 1994, ICTL.

[11]  Patrick Dickinson,et al.  Improving games AI performance using grouped hierarchical level of detail , 2010 .

[12]  Plamen Angelov,et al.  Evolving Rule-Based Models: A Tool For Design Of Flexible Adaptive Systems , 2002 .

[13]  Yifan Li,et al.  Fuzzy logic in agent-based game design , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[14]  Aude Billard,et al.  From Animals to Animats , 2004 .

[15]  José M. Alonso,et al.  Embedding HILK in a three-objective evolutionary algorithm with the aim of modeling highly interpretable fuzzy rule-based classifiers , 2010, 2010 4th International Workshop on Genetic and Evolutionary Fuzzy Systems (GEFS).

[16]  Abdennour El Rhalibi,et al.  A Hybrid Fuzzy ANN System for Agent Adaptation in a First Person Shooter , 2006, Int. J. Comput. Games Technol..

[17]  Mario A. Góngora,et al.  Storage, degradation and recall of agent memory in Serious Games and Simulations , 2010, 2010 5th IEEE International Conference Intelligent Systems.

[18]  Billy Yue,et al.  The state of the art in game AI standardisation , 2006 .

[19]  Hussein A. Abbass,et al.  A Self-Organized, Distributed, and Adaptive Rule-Based Induction System , 2009, IEEE Transactions on Neural Networks.

[20]  Henry Hexmoor,et al.  Designing BOTs with BDI agents , 2009, 2009 International Symposium on Collaborative Technologies and Systems.

[21]  Richard Bellman,et al.  Decision-making in fuzzy environment , 2012 .

[22]  David A. Elizondo,et al.  A Reward-Value Based Constructive Method for the Autonomous Creation of Machine Controllers , 2008, ICANN.

[23]  Antonio González Muñoz,et al.  An extension of the Genetic Iterative Approach for learning rule subsets , 2010, 2010 4th International Workshop on Genetic and Evolutionary Fuzzy Systems (GEFS).

[24]  Michael Wooldridge,et al.  A Common Semantic Basis for BDI Languages , 2007, PROMAS.

[25]  Hemant K. Bhargava,et al.  Simulating belief systems of autonomous agents , 1995, Decis. Support Syst..

[26]  Lin Padgham,et al.  Hierarchical planning in BDI agent programming languages: a formal approach , 2006, AAMAS '06.

[27]  Charles Thevathayan,et al.  BDI agents for game development , 2002, AAMAS '02.

[28]  Risto Miikkulainen,et al.  Evolving Reusable Neural Modules , 2004, GECCO.

[29]  Alessandro Saffiotti,et al.  The uses of fuzzy logic in autonomous robot navigation , 1997, Soft Comput..

[30]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[31]  Winfried Lamersdorf,et al.  Augmenting BDI Agents with Deliberative Planning Techniques , 2006, PROMAS.

[32]  Álvaro F. Moreira,et al.  Proving the Asymmetry Thesis Principles for a BDI Agent-Oriented Programming Language , 2002, Computational Logic in Multi-Agent Systems.

[33]  Plamen Angelov,et al.  Clustering as a tool for self-generation of intelligent systems : a survey. , 2010 .