Toward a situation model in a cognitive architecture

The ability to coherently represent information that is situationally relevant is vitally important to perform any complex task, especially when that task involves coordinating with team members. This paper introduces an approach to dynamically represent situation information within the ACT-R cognitive architecture in the context of a synthetic teammate project. The situation model represents the synthetic teammate’s mental model of the objects, events, actions, and relationships encountered in a complex task simulation. The situation model grounds textual information from the language analysis component into knowledge usable by the agent-environment interaction component. The situation model is a key component of the synthetic teammate as it provides the primary interface between arguably distinct cognitive processes modeled within the synthetic teammate (e.g., language processing and interactions with the task environment). This work has provided some evidence that reasoning about complex situations requires more than simple mental representations and requires mental processes involving multiple steps. Additionally, the work has revealed an initial method for reasoning across the various dimensions of situations. One purpose of the research is to demonstrate that this approach to implementing a situation model provides a robust capability to handle tasks in which an agent must construct a mental model from textual information, reason about complex relationships between objects, events, and actions in its environment, and appropriately communicate with task participants using natural language. In this paper we describe an approach for modeling situationally relevant information, provide a detailed example, discuss challenges faced, and present research plans for the situation model.

[1]  Jerry T. Ball,et al.  A Pseudo-Deterministic Model of Human Language Processing , 2011, CogSci.

[2]  Daniel J. Garland,et al.  Situation Awareness Analysis and Measurement , 2009 .

[3]  G. Altmann Ambiguity in sentence processing , 1998, Trends in Cognitive Sciences.

[4]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[5]  N. Pearlmutter,et al.  Constraints on sentence comprehension , 1998, Trends in Cognitive Sciences.

[6]  J. Gregory Trafton,et al.  “Like-Me” Simulation as an Effective and Cognitively Plausible Basis for Social Robotics , 2009, Int. J. Soc. Robotics.

[7]  B. Chandrasekaran,et al.  An Architecture for Problem Solving with Diagrams , 2004, Diagrams.

[8]  Wayne Zachary,et al.  Using a Community of Intelligent Synthetic Entities to Support Operational Team Training , 2001 .

[9]  J. Gregory Trafton,et al.  ACT-R Workshop , 2014, CogSci.

[10]  Bernhard Nebel,et al.  Spatial Cognition IV, Reasoning, Action, Interaction , 2008 .

[11]  John R. Anderson,et al.  Simulating adaptive communication , 2000 .

[12]  P. Smolensky,et al.  Optimality Theory: Constraint Interaction in Generative Grammar , 2004 .

[13]  J. Gregory Trafton,et al.  Incorporating Mental Simulation for a More Effective Robotic Teammate , 2008, AAAI.

[14]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[15]  A. Miyake,et al.  Models of Working Memory , 1997 .

[16]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[17]  Wayne D. Gray Integrated Models of Cognitive Systems (Advances in Cognitive Models and Architectures) , 2007 .

[18]  L. Barsalou Situated simulation in the human conceptual system , 2003 .

[19]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[20]  Marilyn A. Walker,et al.  Generation and evaluation of user tailored responses in multimodal dialogue , 2004 .

[21]  J. Gregory Trafton,et al.  Spatial Representation and Reasoning for Human-Robot Collaboration , 2007, AAAI.

[22]  van Hedderik Rijn,et al.  Proceedings of the eight International Conference on Cognitive Modeling , 2007 .

[23]  David Klahr,et al.  Structure and process in alphabetic retrieval. , 1983 .

[24]  Pat Langley,et al.  Ability, Breadth, and Parsimony in Computational Models of Higher-Order Cognition , 2008, Cogn. Sci..

[25]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[26]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[27]  Christopher W. Myers,et al.  Toward a Functional Model of Human Language Processing , 2010 .

[28]  Jerry T. Ball,et al.  Explorations in ACT-R Based Cognitive Modeling - Chunks, Inheritance, Production Matching and Memory in Language Analysis , 2011, AAAI Fall Symposium: Advances in Cognitive Systems.

[29]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[30]  Padraic Monaghan,et al.  Proceedings of the 23rd annual conference of the cognitive science society , 2001 .

[31]  Scott D. Lathrop,et al.  Extending Cognitive Architectures with Mental Imagery , 2009 .

[32]  Rolf A. Zwaan,et al.  Grounding Cognition: Introduction to Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thinking , 2005 .

[33]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[34]  John Hoeks,et al.  Proceedings of the 26th annual meeting of the Cognitive Science Society , 2005 .

[35]  Glenn Gunzelmann,et al.  Mechanisms for Human Spatial Competence , 2006, Spatial Cognition.

[36]  Rolf A. Zwaan,et al.  Embodied Sentence Comprehension , 2005 .

[37]  P. Johnson-Laird Mental models , 1989 .

[38]  C. Lebiere,et al.  Models of Working Memory: Modeling Working Memory in a Unified Architecture: An ACT-R Perspective , 1999 .

[39]  Sebastian Varges Overgeneration and Ranking for Spoken Dialogue Systems , 2006, INLG.

[40]  Christian D. Schunn,et al.  ACT-R/S: A Computational and Neurologically Inspired Model of Spatial Reasoning , 2002 .

[41]  Mark Steedman,et al.  Interaction with context during human sentence processing , 1988, Cognition.

[42]  Frank E. Ritter,et al.  The Rise of Cognitive Architectures , 2007, Integrated Models of Cognitive Systems.

[43]  Scott Douglass,et al.  Large Declarative Memories in ACT-R , 2009 .

[44]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[45]  Jerry T. Ball Context Accommodation in Human Language Processing , 2010, NLPCS.

[46]  John E. Laird,et al.  Abstraction, Imagery, and Control in Cognitive Architecture , 2010 .

[47]  Rolf A. Zwaan,et al.  Updating situation models. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[48]  M. Just,et al.  The psychology of reading and language comprehension , 1986 .

[49]  Ben Goertzel,et al.  Proceedings of the Second Conference on Artificial General Intelligence , 2009 .

[50]  Nancy J. Cooke,et al.  The synthetic teammate project , 2009, Comput. Math. Organ. Theory.

[51]  David R. Traum,et al.  Discourse Obligations in Dialogue Processing , 1994, ACL.

[52]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[53]  David R. Traum,et al.  Negotiation over tasks in hybrid human-agent teams for simulation-based training , 2003, AAMAS '03.

[54]  Dietrich Dörner Proceedings of the Fifth International Conference on Cognitive Modeling , 2001 .

[55]  Adam Pease,et al.  Towards a standard upper ontology , 2001, FOIS.

[56]  John R. Anderson,et al.  From recurrent choice to skill learning: a reinforcement-learning model. , 2006, Journal of experimental psychology. General.