GOAL‐DRIVEN AUTONOMY FOR RESPONDING TO UNEXPECTED EVENTS IN STRATEGY SIMULATIONS

To operate autonomously in complex environments, an agent must monitor its environment and determine how to respond to new situations. To be considered intelligent, an agent should select actions in pursuit of its goals, and adapt accordingly when its goals need revision. However, most agents assume that their goals are given to them; they cannot recognize when their goals should change. Thus, they have difficulty coping with the complex environments of strategy simulations that are continuous, partially observable, dynamic, and open with respect to new objects. To increase intelligent agent autonomy, we are investigating a conceptual model for goal reasoning called Goal‐Driven Autonomy (GDA), which allows agents to generate and reason about their goals in response to environment changes. Our hypothesis is that GDA enables an agent to respond more effectively to unexpected events in complex environments. We instantiate the GDA model in ARTUE (Autonomous Response to Unexpected Events), a domain‐independent autonomous agent. We evaluate ARTUE on scenarios from two complex strategy simulations, and report on its comparative benefits and limitations. By employing goal reasoning, ARTUE outperforms an off‐line planner and a discrepancy‐based replanner on scenarios requiring reasoning about unobserved objects and facts and on scenarios presenting opportunities outside the scope of its current mission.

[1]  John Thangarajah,et al.  Operational Behaviour for Executing, Suspending, and Aborting Goals in BDI Agent Systems , 2010, DALT.

[2]  Michael Luck,et al.  Motivations as an Abstraction of Meta-level Reasoning , 2007, CEEMAS.

[3]  John E. Laird,et al.  Extending the Soar Cognitive Architecture , 2008, AGI.

[4]  Marc Hanheide,et al.  A Framework for Goal Generation and Management , 2010, AAAI 2010.

[5]  S. Seshu,et al.  Introduction to the theory of finite-state machines , 1963 .

[6]  Johan de Kleer,et al.  An Assumption-Based TMS , 1987, Artif. Intell..

[7]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[8]  J. Dekleer An assumption-based TMS , 1986 .

[9]  R. Goldman,et al.  HOTRiDE: Hierarchical Ordered Task Replanning in Dynamic Environments , 2007 .

[10]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[11]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[12]  Matthias Scheutz,et al.  Affective Goal and Task Selection for Social Robots , 2009 .

[13]  Dana S. Nau,et al.  Current Trends in Automated Planning , 2007, AI Mag..

[14]  Lin Padgham,et al.  A BDI agent programming language with failure handling, declarative goals, and planning , 2011, Autonomous Agents and Multi-Agent Systems.

[15]  Arnav Jhala,et al.  Applying Goal-Driven Autonomy to StarCraft , 2010, AIIDE.

[16]  David W. Aha,et al.  Planning in Dynamic Environments: Extending HTNs with Nonlinear Continuous Effects , 2010, AAAI.

[17]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[18]  Nick Hawes,et al.  A survey of motivation frameworks for intelligent systems , 2011, Artif. Intell..

[19]  Pat Langley,et al.  A Unified Cognitive Architecture for Physical Agents , 2006, AAAI.

[20]  Maria Fox,et al.  Modelling Mixed Discrete-Continuous Domains for Planning , 2006, J. Artif. Intell. Res..

[21]  D. Aha,et al.  Stratagus : An Open-Source Game Engine for Research in Real-Time Strategy Games , 2005 .

[22]  James A. Hendler,et al.  HTN Planning: Complexity and Expressivity , 1994, AAAI.

[23]  Andrew Coles,et al.  Temporal Planning in Domains with Linear Processes , 2009, IJCAI.

[24]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[25]  Anthony Stentz,et al.  Probabilistic planning with clear preferences on missing information , 2009, Artif. Intell..

[26]  Javier Bajo,et al.  REPLANNING MECHANISM FOR DELIBERATIVE AGENTS IN DYNAMIC CHANGING ENVIRONMENTS , 2008, Comput. Intell..

[27]  David W. Aha,et al.  Goal-Driven Autonomy with Case-Based Reasoning , 2010, ICCBR.

[28]  Michael Luck,et al.  A motivation-based planning and execution framework , 2004, Int. J. Artif. Intell. Tools.

[29]  Allen Munro,et al.  Towards Research on Goal Reasoning with the TAO Sandbox , 2009 .

[30]  Karen L. Myers CPEF: A Continuous Planning and Execution Framework , 1999, AI Mag..

[31]  David B. Leake,et al.  Goal-driven learning , 1995 .

[32]  Michael Brenner,et al.  Planning and Acting with an Integrated Sense of Space , 2009 .

[33]  Paul S. Rosenbloom,et al.  Universal Subgoaling and Chunking , 1986 .

[34]  M. Klenk Goal-Driven Autonomy in Planning and Acting , 2010 .

[35]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[36]  Dana S. Nau,et al.  SHOP2: An HTN Planning System , 2003, J. Artif. Intell. Res..

[37]  Matthew Klenk,et al.  Transfer as a Benchmark for Multi-Representational Architectures , 2009, AAAI Fall Symposium: Multi-Representational Architectures for Human-Level Intelligence.

[38]  Santiago Ontañón,et al.  ON‐LINE CASE‐BASED PLANNING , 2010, Comput. Intell..

[39]  Matthias Scheutz,et al.  Integrating a Closed World Planner with an Open World Robot: A Case Study , 2010, AAAI.

[40]  Michael van Lent,et al.  Applying Appraisal Theories to Goal Directed Autonomy , 2010 .

[41]  Stefan Edelkamp,et al.  Automated Planning: Theory and Practice , 2007, Künstliche Intell..

[42]  Nico Roos,et al.  Models and methods for plan diagnosis , 2009, Autonomous Agents and Multi-Agent Systems.

[43]  David W. Aha,et al.  Goal-Driven Autonomy in a Navy Strategy Simulation , 2010, AAAI.

[44]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[45]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[46]  David E. Smith,et al.  Incremental Contingency Planning , 2003 .

[47]  Michael T. Cox Perpetual Self-Aware Cognitive Agents , 2007, AI Mag..

[48]  Manuela Veloso,et al.  Goal Transformations in Continuous Planning , 1998 .