Integrating Language and Cognition: A Cognitive Robotics Approach

In this paper, we present some recent cognitive robotics studies on language and cognition integration to demonstrate how the language acquired by robotic agents can be directly grounded in action representations. These studies are characterized by the hypothesis that symbols are directly grounded into the agents' own categorical representations, while at the same time having logical (e.g. syntactic) relationships with other symbols. The two robotics studies are based on the combination of cognitive robotics with neural modeling methodologies, such as connectionist models and modeling field theory. Simulations demonstrate the efficacy of the mechanisms of action grounding of language and the symbol grounding transfer in agents that acquire lexicon via imitation and linguistic instructions. The paper also discusses the scientific and technological implications of such an approach.

[1]  Chris Sinha,et al.  Symbol Grounding or the Emergence of Symbols? Vocabulary Growth in Children and a Connectionist Net , 1992 .

[2]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[3]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[4]  Luc Steels,et al.  Aibo''s first words. the social learning of language and meaning. Evolution of Communication , 2002 .

[5]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[6]  Angelo Cangelosi,et al.  From robotic toil to symbolic theft: Grounding transfer from entry-level to higher-level categories1 , 2000, Connect. Sci..

[7]  Angelo Cangelosi,et al.  The Adaptive Advantage of Symbolic Theft Over Sensorimotor Toil: Grounding Language in Perceptual Categories , 2001 .

[8]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[9]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[10]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[11]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[12]  Friedemann Pulvermüller,et al.  The Neuroscience of Language: On Brain Circuits of Words and Serial Order , 2003 .

[13]  L. Talmy.  Toward a Cognitive Semantics , 2003 .

[14]  J. Feldman,et al.  Embodied meaning in a neural theory of language , 2004, Brain and Language.

[15]  H. Cohen,et al.  Handbook of Categorization , 2005 .

[16]  Henri Cohen,et al.  Handbook of categorization in cognitive science , 2005 .

[17]  Rolf A. Zwaan,et al.  Grounding Cognition: Introduction to Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thinking , 2005 .

[18]  Leonid Perlovsky,et al.  Neural Networks and Intellect: Using Model-Based Concepts , 2000, IEEE Transactions on Neural Networks.

[19]  A. Cangelosi.  APPROACHES TO GROUNDING SYMBOLS IN PERCEPTUAL AND SENSORIMOTOR CATEGORIES , 2005 .

[20]  Angelo Cangelosi,et al.  Language Acquisition and Symbol Grounding Transfer with Neural Networks and Cognitive Robots , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[21]  Angelo Cangelosi,et al.  An Embodied Model for Sensorimotor Grounding and Grounding Transfer: Experiments With Epigenetic Robots , 2006, Cogn. Sci..

[22]  Angelo Cangelosi,et al.  Language and Cognition Integration Through Modeling Field Theory: Category Formation for Symbol Grounding , 2006, ICANN.

[23]  Henrik Schiøler,et al.  Sociable Robots Through Self-Maintained Energy , 2006 .

[24]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[25]  S. Harnad.  Symbol grounding problem , 1991, Scholarpedia.

[26]  J.F. Fontanari,et al.  Scaling Up of Action Repertoire in Linguistic Cognitive Agents , 2007, 2007 International Conference on Integration of Knowledge Intensive Multi-Agent Systems.