Grounding Language in Action

The topic of this Special Issue is that action and lan guage are interwoven. Driven by traditional approaches that prevail in our education, we might be surprised about the connection between language and action, since we are inclined to view language as a symbolic system as it connects entities in the world with the corresponding conceptions that a perceiver has in mind. Action, on the other hand, was considered to be an event in the world that has to be perceived first. Only then, could it also be labeled by a perceiver, so a particular conception of it could be represented in the mind. The research from perspective on how cognition develops, however, contributed to findings suggesting that what we know about action, language and interaction emerge in parallel and have an impact on each other. This parallel development seems to provide a ground for further mental growth. For a system to develop, it requires different processes to interact not only with each other, but also with the physical world. This coupling is also a valuable source of intelligence as it provides knowledge that shapes the system's performance without actually being part of the system.

[1]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[2]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[3]  Eiichi Yoshida,et al.  Real-Time Spoken-Language Programming for Cooperative Interaction with a Humanoid Apprentice , 2009, Int. J. Humanoid Robotics.

[4]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[5]  S. Waxman,et al.  Do words facilitate object categorization in 9-month-old infants? , 1997, Journal of experimental child psychology.

[6]  D. Roy Grounding Words in Perception and Action: Insights from Computational Models , 2005 .

[7]  Angelo Cangelosi,et al.  An Embodied Model for Sensorimotor Grounding and Grounding Transfer: Experiments With Epigenetic Robots , 2006, Cogn. Sci..

[8]  M. Tomasello,et al.  Understanding and sharing intentions , 2005 .

[9]  M. Tomasello,et al.  Understanding and sharing intentions: The origins of cultural cognition , 2005, Behavioral and Brain Sciences.

[10]  L. Taylor,et al.  Action in cognition: The case of language. Language and Cognition, 1, 45-58. Taylor, LJ & Zwaan, RA (2008). Motor resonance and linguistic , 2009 .

[11]  T. Talavage,et al.  Neuroanatomical distribution of five semantic components of verbs: Evidence from fMRI , 2008, Brain and Language.

[12]  S. Gelman Learning from others: children's construction of concepts. , 2009, Annual review of psychology.

[13]  G. Rizzolatti,et al.  A unifying view of the basis of social cognition , 2004, Trends in Cognitive Sciences.

[14]  Linda B. Smith,et al.  Development as a dynamic system , 1992, Trends in Cognitive Sciences.

[15]  Kevin J. Holmes,et al.  Linguistic relativity. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[16]  Linda B. Smith Cognition as a dynamic system: Principles from embodiment , 2005 .

[17]  Giulio Sandini,et al.  In Press, Ieee Transactions on Autonomous Mental Development , 2010 .

[18]  Fei Xu The role of language in acquiring object kind concepts in infancy , 2002, Cognition.

[19]  Rolf A. Zwaan,et al.  Action in cognition: The case of language , 2009, Language and Cognition.

[20]  L. Cohen,et al.  Labels can override perceptual categories in early infancy , 2008, Cognition.

[21]  D. Roy Grounding words in perception and action: computational insights , 2005, Trends in Cognitive Sciences.

[22]  Rebecca J. Brand,et al.  Acoustic Packaging of Action Sequences by Infants. , 2007, Infancy : the official journal of the International Society on Infant Studies.

[23]  S. Waxman,et al.  Early word-learning entails reference, not merely associations , 2009, Trends in Cognitive Sciences.

[24]  Jun Tani,et al.  Learning Semantic Combinatoriality from the Interaction between Linguistic and Behavioral Processes , 2005, Adapt. Behav..

[25]  Juyang Weng,et al.  Developmental Robotics: Theory and Experiments , 2004, Int. J. Humanoid Robotics.

[26]  Soonja Choi,et al.  Early development of verb structures and caregiver input in Korean: Two case studies , 1999 .

[27]  Naoto Iwahashi,et al.  Interactive Learning of Spoken Words and Their Meanings Through an Audio-Visual Interface , 2008, IEICE Trans. Inf. Syst..

[28]  Risto Miikkulainen,et al.  Subsymbolic natural language processing - an integrated model of scripts, lexicon, and memory , 1993, Neural network modeling and connectionism.

[29]  Luc Steels,et al.  Grounding adaptive language games in robotic agents , 1997 .

[30]  Juyang Weng,et al.  Task Transfer by a Developmental Robot , 2007, IEEE Transactions on Evolutionary Computation.

[31]  Deb Roy,et al.  Mental imagery for a conversational robot , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[33]  Deb Roy dkroy Grounding Words in Perception and Action : Insights from Computational Models , 2005 .