A Mechanistic Model of Three Facets of Meaning

This chapter presents a physical-computational model of sensory-motor grounded language interpretation for simple speech acts. The model is based on an implemented conversational robot. It combines a cybernetic closed-loop control architecture with structured conceptual schemas. The interpretation of directive and descriptive speech acts consists of translating utterances into updates of memory systems in the controller. The same memory systems also mediate sensory-motor interactions and thus serve as a cross-modal bridge between language, perception, and action. The referential, functional, and connotative meanings of speech acts emerge from the effects of memory updates on the future dynamics of the controller as it physically interacts with its environment.

[1]  Deb Roy,et al.  Mental imagery for a conversational robot , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Jeffrey Mark Siskind,et al.  Grounding the Lexical Semantics of Verbs in Visual Perception using Force Dynamics and Event Logic , 1999, J. Artif. Intell. Res..

[3]  Douglas B. Lenat,et al.  CYC: a large-scale investment in knowledge infrastructure , 1995, CACM.

[4]  Deb Roy,et al.  Semiotic schemas: A framework for grounding language in action and perception , 2005, Artif. Intell..

[5]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[6]  Frank R. Abate,et al.  The new Oxford American dictionary , 2001 .

[7]  Deb Roy,et al.  Grounded Semantic Composition for Visual Scenes , 2011, J. Artif. Intell. Res..

[8]  Deb Roy,et al.  Grounded Situation Models for Robots: Where words and percepts meet , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[10]  N. Wiener,et al.  Behavior, Purpose and Teleology , 1943, Philosophy of Science.

[11]  C. K. Ogden,et al.  The Meaning of Meaning , 1923 .

[12]  Mark H. Bickhard,et al.  Representational content in humans and machines , 1993, J. Exp. Theor. Artif. Intell..

[13]  Deb Roy,et al.  Grounded spoken language acquisition: experiments in word learning , 2003, IEEE Trans. Multim..

[14]  Cristiano Castelfranchi,et al.  From reactive to anticipatory cognitive embodied systems : papers from the AAAI Fall Symposium , 2005 .

[15]  L. Wittgenstein.  The Blue and Brown Books , 1958 .

[16]  Noam Chomsky,et al.  New Horizons in the Study of Language and Mind: Naturalism and dualism in the study of language and mind , 2008 .

[17]  Srinivas Narayanan,et al.  Moving Right Along: A Computational Model of Metaphoric Reasoning about Events , 1999, AAAI/IAAI.

[18]  S. Dreyfus,et al.  Making a mind versus modeling the brain: aritifical intelligence back at a branchpoint , 1989 .

[19]  E. Bates.  The Emergence Of Symbols , 1979 .

[20]  Hubert L. Dreyfus,et al.  Making a Mind Versus Modelling the Brain , 1990, The Philosophy of Artificial Intelligence.

[21]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[22]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[23]  D. Roy,et al.  A Habit System for an Interactive Robot , 2005 .