An Integrated Architecture for Grounded Intelligence in Its Development, Experimental, Environmental, and Social Context

Abstract : This final report describes a novel biologically-inspired cognitive architecture. The systems level architecture described in this report was inspired by Simmons and Barsalou (2003), with psychologically-inspired additions proposed by Breazeal et al (2005), augmented by key insights from developmental psychology (Smith, 2005). A cognitive agent will have multiple modality-specific systems, including sensory systems (e.g., vision, audition, touch), a motor system, an emotional system, and a cognitive system. As a system perceives its external world and internal mental states, feature systems will represent these experiences in the relevant perceptual modalities, and a hierarchical system of neurally-inspired association areas will capture them, so that they can be reenacted or simulated in the future. These perceptually grounded representations guide the intelligent and social operations of agents.

[1]  A. Meltzoff,et al.  Explaining Facial Imitation: A Theoretical Model. , 1997, Early development & parenting.

[2]  Bruce Blumberg,et al.  Integrated learning for interactive synthetic characters , 2002, SIGGRAPH.

[3]  Andrew B. Lippman,et al.  Goal and action inference for helpful robots using self as simulator , 2004 .

[4]  J. Sommerville,et al.  Action experience alters 3-month-old infants' perception of others' actions , 2005, Cognition.

[5]  Fabrice Heitz,et al.  Gesture localization and recognition using probabilistic visual learning , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[7]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[8]  Candace L. Sidner,et al.  COLLAGEN: Applying Collaborative Discourse Theory to Human-Computer Interaction , 2001, AI Mag..

[9]  Lawrence W. Barsalou,et al.  Perceptual simulation in conceptual tasks , 1999 .

[10]  M. Wilson,et al.  Perceiving imitatible stimuli: consequences of isomorphism between input and output. , 2001, Psychological bulletin.

[11]  Jodie A. Baird,et al.  Discerning intentions in dynamic human action , 2001, Trends in Cognitive Sciences.

[12]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[13]  D W Massaro,et al.  American Psychological Association, Inc. Evaluation and Integration of Visual and Auditory Information in Speech Perception , 2022 .

[14]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[15]  Alex Martin,et al.  Functional Neuroimaging of Semantic Memory , 2001 .

[16]  T. Shallice,et al.  CONTENTION SCHEDULING AND THE CONTROL OF ROUTINE ACTIVITIES , 2000, Cognitive neuropsychology.

[17]  Cynthia Breazeal,et al.  Cost-Based Anticipatory Action Selection for Human–Robot Fluency , 2007, IEEE Transactions on Robotics.

[18]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[19]  Daniel C. Richardson,et al.  Grounding Cognition: On the Perceptual-Motor and Image-Schematic Infrastructure of Language , 2005 .

[20]  Chrystopher L. Nehaniv,et al.  Sensory-Motor Primitives as a Basis for Imitation: Linking Perception to Action and Biology to Robotics , 2002 .

[21]  R. Krauss,et al.  Nonverbal Behavior and Nonverbal Communication: What do Conversational Hand Gestures Tell Us? , 1996 .

[22]  R. Gordon.  Folk Psychology as Simulation , 1986 .

[23]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[24]  G. Knoblich,et al.  Action coordination in groups and individuals: learning anticipatory control. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[25]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  A. Meltzoff.  Chapter 16 - The Human Infant as Imitative Generalist: A 20-Year Progress Report on Infant Imitation with Implications for Comparative Psychology , 1996 .

[27]  J. Locke,et al.  Memory for speech and speech for memory. , 1975, Journal of speech and hearing research.

[28]  Jane Heal,et al.  Understanding Other Minds from the Inside , 1998, Royal Institute of Philosophy Supplement.

[29]  G. Knoblich,et al.  The case for motor involvement in perceiving conspecifics. , 2005, Psychological bulletin.

[30]  M. Shiffrar,et al.  The visual perception of human locomotion. , 1998, Cognitive neuropsychology.

[31]  F. Strack,et al.  Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis. , 1988, Journal of personality and social psychology.

[32]  Evelyn Z. McClave.  Linguistic functions of head movements in the context of speech , 2000 .

[33]  R. Johansson,et al.  Action plans used in action observation , 2003, Nature.

[34]  Rolf A. Zwaan,et al.  PSYCHOLOGICAL SCIENCE Research Article THE EFFECT OF IMPLIED ORIENTATION DERIVED FROM VERBAL CONTEXT ON PICTURE RECOGNITION , 2022 .