Goal reasoning as a general form of metacognition in BICA

Abstract A key capability that distinguishes humans from intelligent agents is the ability to generate and select new goals in an unexpected situation, while re-prioritizing existing goals. This level of cognitive autonomy becomes practically vital for actors working as team members with humans or in unpredictable environments. The work is focused on a new perspective on this problem based on biologically inspired cognitive architectures (BICA). Aspects of goal reasoning and goal management capabilities that are currently available in selected BICA are reviewed. A generalizing model of goal reasoning as a form of metacognition is defined, that integrates multiple mechanisms. On top of the traditional cognitive cycle, the model includes a goal-reasoning cycle triggered by notable phenomena. This goal reasoning cycle integrates mechanisms like agitation of desires by drives and their instantiation in goals, or metacognitive reasoning about goals. The model is illustrated by consideration of specific scenarios at micro- and macro-cognitive scales to evaluate the use and potential capabilities of this goal reasoning model for BICA. New capabilities that will be enabled based on this approach are expected to increase the human compatibility and cognitive autonomy of future intelligent agents. The general goal reasoning capability is a key component included in the BICA Challenge and is required for integration of intelligent agents into human teams.

[1]  Derek Long,et al.  Alarms: An Implementation of Motivated Agency , 1995, ATAL.

[2]  David W. Aha,et al.  Learning and Reusing Goal-Specific Policies for Goal-Driven Autonomy , 2012, ICCBR.

[3]  Pat Langley,et al.  A Unified Cognitive Architecture for Physical Agents , 2006, AAAI.

[4]  Paul S. Rosenbloom,et al.  Universal Subgoaling and Chunking: The Automatic Generation and Learning of Goal Hierarchies , 2012 .

[5]  Matthew Klenk,et al.  Breadth of Approaches to Goal Reasoning: A Research Survey , 2013 .

[6]  Chet Richards.  A Swift, Elusive Sword: What if Sun Tzu and John Boyd Did a National Defense Review? , 2003 .

[7]  Nick Hawes,et al.  Evolutionary Learning of Goal Priorities in a Real-Time Strategy Game , 2012, AIIDE.

[8]  P. Langley,et al.  Acquisition of hierarchical reactive skills in a unified cognitive architecture , 2009, Cognitive Systems Research.

[9]  B. Zimmerman.  Self-Regulated Learning and Academic Achievement: An Overview , 1990 .

[10]  John R. Anderson.  Language, Memory, and Thought , 1976 .

[11]  Tony J. Dodd,et al.  Autonomous mission management for UAVs using soar intelligent agents , 2013, Int. J. Syst. Sci..

[12]  Kenneth de Jong,et al.  THE MENTAL STATE FORMALISM OF GMU-BICA , 2009 .

[13]  Laura M. Hiatt,et al.  An explanatory reasoning framework for embodied agents , 2012, BICA 2012.

[14]  J. McCarthy.  SITUATION CALCULUS WITH CONCURRENT EVENTS AND NARRATIVE , 2001 .

[15]  Michael Stollberg,et al.  Survey on Goal-driven Architectures , 2006 .

[16]  Helder Coelho,et al.  BDI models and systems : Reducing the gap , 1999 .

[17]  Stan Franklin,et al.  THE LIDA ARCHITECTURE: ADDING NEW MODES OF LEARNING TO AN INTELLIGENT, AUTONOMOUS, SOFTWARE AGENT , 2006 .

[18]  David W. Aha,et al.  Case-Based Goal-Driven Coordination of Multiple Learning Agents , 2013, ICCBR.

[19]  Barteld Kooi,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI-11) , 2011, AAAI 2011.

[20]  John C. Nesbit,et al.  Supporting Self-Regulated Learning with Cognitive Tools , 2009 .

[21]  Frank E. Ritter,et al.  Techniques for modelling human performance in synthetic environments : A supplementary review , 1999 .

[22]  Pat Langley,et al.  Cognitive architectures: Research issues and challenges , 2009, Cognitive Systems Research.

[23]  David C. Noelle,et al.  On a Roadmap to Biologically Inspired Cognitive Agents , 2011, BICA.

[24]  David W. Aha,et al.  Iterative Goal Refinement for Robotics , 2014 .

[25]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Kamilla Run Johannsdottir,et al.  Biologically Inspired Cognitive Architectures 2011 - Proceedings of the Second Annual Meeting of the BICA Society, Arlington, Virginia, USA, November 4-6, 2011 , 2011, BICA.

[27]  David W. Aha,et al.  Goal-Driven Autonomy in a Navy Strategy Simulation , 2010, AAAI.

[28]  R. Lazarus.  Relational meaning and discrete emotions. , 2001 .

[29]  Tamas Madl,et al.  LIDA: A Systems-level Architecture for Cognition, Emotion, and Learning , 2014, IEEE Transactions on Autonomous Mental Development.

[30]  Nick Hawes,et al.  A survey of motivation frameworks for intelligent systems , 2011, Artif. Intell..

[31]  Alexei V. Samsonovich,et al.  On a roadmap for the BICA Challenge , 2012, BICA 2012.

[32]  Dana S. Nau,et al.  A hierarchical goal-based formalism and algorithm for single-agent planning , 2012, AAMAS.

[33]  Alan J. Parkin.  Memory: Phenomena, Experiment and Theory , 1993 .

[34]  A. Maslow.  A Theory of Human Motivation , 1943 .

[35]  Paolo Traverso,et al.  The actor's view of automated planning and acting: A position paper , 2014, Artif. Intell..

[36]  P. Langley,et al.  An Extended Theory of Human Problem Solving , 2005 .

[37]  Ram Ramamoorthy,et al.  Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2012) , 2012, AAMAS 2012.

[38]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[39]  Martial Hebert,et al.  Using Expectations to Drive Cognitive Behavior , 2012, AAAI.

[40]  Frank E. Ritter,et al.  CoJACK: A high-level cognitive architecture with demonstrations of moderators, variability, and implications for situation awareness , 2012, BICA 2012.

[41]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[42]  Mark M. Payne.  Destruction and Creation , 2010 .

[43]  John R. Anderson,et al.  Tower of Hanoi: evidence for the cost of goal retrieval. , 2001 .

[44]  L. Nadel,et al.  The Hippocampus as a Cognitive Map , 1978 .

[45]  David W. Aha,et al.  Learning Unknown Event Models , 2014, AAAI.

[46]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[47]  Darsana P. Josyula,et al.  Design and validation of a metamodel for metacognition support in artificial intelligent systems , 2014, BICA 2014.

[48]  Alexei V. Samsonovich.  Comparative Analysis of Implemented Cognitive Architectures , 2011, BICA.

[49]  A. Newell.  Unified Theories of Cognition , 1990 .

[50]  Cristiano Castelfranchi,et al.  Proceedings of the 7th International Workshop on Intelligent Agents VII. Agent Theories Architectures and Languages , 2000 .

[51]  John R. Anderson.  How Can the Human Mind Occur in the Physical Universe , 2007 .

[52]  David W. Aha,et al.  Integrated Learning for Goal-Driven Autonomy , 2011, IJCAI.

[53]  B. Baars,et al.  The Timing of the Cognitive Cycle , 2011, PloS one.

[54]  David W. Aha,et al.  Planning in Dynamic Environments: Extending HTNs with Nonlinear Continuous Effects , 2010, AAAI.

[55]  Erik T. Mueller,et al.  Event calculus and temporal action logics compared , 2006, Artif. Intell..

[56]  Ah-Hwee Tan,et al.  Integrated cognitive architectures: a survey , 2007, Artificial Intelligence Review.

[57]  Arnav Jhala,et al.  Learning from Demonstration for Goal-Driven Autonomy , 2012, AAAI.

[58]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[59]  David W. Aha,et al.  GOAL‐DRIVEN AUTONOMY FOR RESPONDING TO UNEXPECTED EVENTS IN STRATEGY SIMULATIONS , 2013, Comput. Intell..

[60]  U. Windhorst.  Muscle proprioceptive feedback and spinal networks , 2007, Brain Research Bulletin.

[61]  Alexei V. Samsonovich,et al.  Toward a Unified Catalog of Implemented Cognitive Architectures , 2010, BICA.

[62]  Michael T. Cox.  Perpetual Self-Aware Cognitive Agents , 2007, AI Mag..

[63]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[64]  Ron Sun,et al.  Motivational Representations within a Computational Cognitive Architecture , 2009, Cognitive Computation.

[65]  Michael Wooldridge,et al.  The Belief-Desire-Intention Model of Agency , 1998, ATAL.

[66]  N. Yeung,et al.  Neural basis of motivational and cognitive control , 2011 .

[67]  Ron Sun,et al.  Cognition and Multi-Agent Interaction: The CLARION Cognitive Architecture: Extending Cognitive Modeling to Social Simulation , 2005 .

[68]  I. Serina,et al.  MADbot: A Motivated and Goal Directed Robot , 2005, AAAI.

[69]  Michael E. Bratman,et al.  Intention, Plans, and Practical Reason , 1991 .

[70]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[71]  David W. Aha,et al.  Domain-Independent Heuristics for Goal Formulation , 2013, FLAIRS.

[72]  G. Ascoli,et al.  An Integrated Self-Aware Cognitive Architecture , 2008 .

[73]  B. Zimmerman.  Becoming a Self-Regulated Learner: An Overview , 2002 .

[74]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[75]  David W. Aha,et al.  Learning Event Models that Explain Anomalies , 2011, ExaCt.

[76]  Matthias Scheutz,et al.  A Framework for Comparing Agent Architectures , 2002 .

[77]  John E. Laird,et al.  Extending the Soar Cognitive Architecture , 2008, AGI.

[78]  Lee McCauley,et al.  LIDA: A Computational Model of Global Workspace Theory and Developmental Learning , 2007, AAAI Fall Symposium: AI and Consciousness.

[79]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[80]  Stan Franklin,et al.  A Foundational Architecture for Artificial General Intelligence , 2007, AGI.

[81]  Pat Langley,et al.  A Believable Agent for First-Person Shooter Games , 2007, AIIDE.

[82]  R Llinás,et al.  Blocking and isolation of a calcium channel from neurons in mammals and cephalopods utilizing a toxin fraction (FTX) from funnel-web spider poison. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[83]  Arnav Jhala,et al.  Applying Goal-Driven Autonomy to StarCraft , 2010, AIIDE.

[84]  John E. Laird,et al.  The Soar Cognitive Architecture , 2012 .

[85]  Frank E. Ritter,et al.  The Rise of Cognitive Architectures , 2007, Integrated Models of Cognitive Systems.

[86]  John McCarthy,et al.  A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955 , 2006, AI Mag..