Construals of meaning: The role of attention in robotic language production

In robotics research with language-based interaction, simplifications are made, such that a given event can be described in a unique manner, where there is a direct mapping between event representations and sentences that can describe these events. However, common experience tells us that the same physical event can be described in multiple ways, depending on the perspective of the speaker. The current research develops methods for representing events from multiple perspectives, and for choosing the perspective that will be used for generating a linguistic construal, based on attentional processes in the system. The multiple perspectives are based on the principle that events can be considered in terms of the force driving the event, and the result obtained from the event, based on the theory of Godenfors. In addition, within these perspectives a further refinement can be made with respect to the agent, object, and recipient perspectives. We develop a system for generating appropriate construals of meaning, and demonstrate how this can be used in a realistic dialogic interaction between a behaving robot and a human interlocutor. (Less)

[1]  David R. Dowty Thematic proto-roles and argument selection , 1991 .

[2]  Mutsumi Imai,et al.  A developmental shift from similar to language-specific strategies in verb acquisition: A comparison of English, Spanish, and Japanese , 2010, Cognition.

[3]  Guido Bugmann,et al.  Mobile robot programming using natural language , 2002, Robotics Auton. Syst..

[4]  Beth Levin,et al.  Argument Realization , 2005 .

[5]  Z. Harris,et al.  Foundations of language , 1941 .

[6]  T. Givón Syntax : an introduction , 2001 .

[7]  Jon Oberlander,et al.  Proceedings of the 25th Annual Meeting of the Cognitive Science Society, 2003 , 2003 .

[8]  K. Fiedler,et al.  The cognitive functions of linguistic categories in describing persons: Social cognition and language. , 1988 .

[9]  Peter Gärdenfors,et al.  Event structure, conceptual spaces and the semantics of verbs , 2012 .

[10]  R. Jackendoff Foundations of Language: Brain, Meaning, Grammar, Evolution , 2002 .

[11]  S. T. Rosen The syntactic representation of linguistic events , 1999 .

[12]  Todd R. Ferretti,et al.  Grammatical aspect, lexical aspect, and event duration constrain the availability of events in narratives , 2013, Cognition.

[13]  Peter Ford Dominey,et al.  Neural network processing of natural language: II. Towards a unified model of corticostriatal function in learning sentence comprehension and non-linguistic sequencing , 2009, Brain and Language.

[14]  Peter Ford Dominey,et al.  Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks , 2014, Front. Neurorobot..

[15]  Allen R. Braun,et al.  Neural correlates and network connectivity underlying narrative production and comprehension: A combined fMRI and PET study , 2014, Cortex.

[16]  Peter Ford Dominey,et al.  Developmental stages of perception and language acquisition in a perceptually grounded robot , 2005, Cognitive Systems Research.

[17]  Peter Ford Dominey,et al.  Recurrent temporal networks and language acquisition—from corticostriatal neurophysiology to reservoir computing , 2013, Front. Psychol..

[18]  Peter Ford Dominey,et al.  A Neurolinguistic Model of Grammatical Construction Processing , 2006, Journal of Cognitive Neuroscience.

[19]  Peter Gärdenfors,et al.  Using Conceptual Spaces to Model Actions and Events , 2012, J. Semant..

[20]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[21]  Peter Ford Dominey,et al.  Cooperative human robot interaction systems: IV. Communication of shared plans with Naïve humans using gaze and speech , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Jeffrey M. Zacks,et al.  Event structure in perception and conception. , 2001, Psychological bulletin.

[23]  J. Bruner The Narrative Construction of Reality , 1991, Critical Inquiry.

[24]  Terry Regier,et al.  Attention to Endpoints: A Cross-Linguistic Constraint on Spatial Meaning , 2007, Cogn. Sci..

[25]  Ronald W. Langacker,et al.  Cognitive Grammar: A Basic Introduction , 2008 .

[26]  Deb K. Roy,et al.  Learning visually grounded words and syntax for a scene description task , 2002, Comput. Speech Lang..

[27]  Ran R. Hassin,et al.  Automatic goal inferences. , 2005 .

[28]  Peter Ford Dominey,et al.  Successive Developmental Levels of Autobiographical Memory for Learning Through Social Interaction , 2014, IEEE Transactions on Autonomous Mental Development.

[29]  W. Bruce Croft Verbs: Aspect and Causal Structure , 2012 .

[30]  Peter Ford Dominey,et al.  Neural network processing of natural language: I. Sensitivity to serial, temporal and abstract structure of language in the infant , 2000 .

[31]  Henrik Schiøler,et al.  Sociable Robots Through Self-Maintained Energy , 2006 .

[32]  Rolf A. Zwaan,et al.  The presence of an event in the narrated situation affects its availability to the comprehender , 2000, Memory & cognition.

[33]  Deb Roy,et al.  Grounded Semantic Composition for Visual Scenes , 2011, J. Artif. Intell. Res..

[34]  Nicholas Roy,et al.  Spoken language interaction with model uncertainty: an adaptive human–robot interaction system , 2008, Connect. Sci..

[35]  Leonard Talmy,et al.  Force Dynamics in Language and Cognition , 1987, Cogn. Sci..

[36]  Peter Ford Dominey,et al.  Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing , 2013, PloS one.

[37]  Alfonso Caramazza,et al.  Independent Representations of Verbs and Actions in Left Lateral Temporal Cortex , 2012, Journal of Cognitive Neuroscience.

[38]  Peter Ford Dominey,et al.  Neurological basis of language and sequential cognition: Evidence from simulation, aphasia, and ERP studies , 2003, Brain and Language.

[39]  Peter Ford Dominey,et al.  Linking Language with Embodied and Teleological Representations of Action for Humanoid Cognition , 2010, Front. Neurorobot..

[40]  Peter Ford Dominey,et al.  Cortico-striatal function in sentence comprehension: Insights from neurophysiology and modeling , 2009, Cortex.

[41]  Nicholas A. Palomares Toward a Theory of Goal Detection in Social Interaction , 2008, Commun. Res..

[42]  Peter Ford Dominey Aspects of descriptive, referential, and information structure in phrasal semantics , 2005 .

[43]  M. Tomasello,et al.  Understanding and sharing intentions: The origins of cultural cognition , 2005, Behavioral and Brain Sciences.

[44]  P. Gärdenfors The Geometry of Meaning: Semantics Based on Conceptual Spaces , 2014 .

[45]  Peter Ford Dominey,et al.  Learning to talk about events from narrated video in a construction grammar framework , 2005, Artif. Intell..

[46]  Chen Yu,et al.  Embodied attention and word learning by toddlers , 2012, Cognition.