Ambiguities in Spatial Language Understanding in Situated Human Robot Dialogue

In human robot dialogue, identifying intended referents from human partners’ spatial language is challenging. This is partly due to automated inference of potentially ambiguous underlying reference system (i.e., frame of reference ). To improve spatial language understanding, we conducted an empirical study to investigate the prevalence of ambiguities of frame of reference. Our findings indicate that ambiguities do arise frequently during human robot dialogues. Although situational factors from the spatial arrangement are less indicative for the underlying reference system, linguistic cues and individual preferences may allow reliable disambiguation.

[1]  Reinhard Moratz,et al.  Spatial Reference in Linguistic Human-Robot Interaction: Iterative, Empirically Supported Development of a Model of Projective Relations , 2006, Spatial Cogn. Comput..

[2]  Kenny R. Coventry,et al.  Spatial Prepositions and Vague Quantifiers: Implementing the Functional Geometric Framework , 2004, Spatial Cognition.

[3]  S. Levinson.  Frames of reference and Molyneux's question: Cross-linguistic evidence , 1996 .

[4]  Thora Tenbrink,et al.  Identifying Objects on the Basis of Spatial Contrast: An Empirical Study , 2004, Spatial Cognition.

[5]  Laura A. Carlson-Radvansky,et al.  The Influence of Functional Relations on Spatial Term Selection , 1996 .

[6]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[7]  J. Rieser.  Access to knowledge of spatial structure at novel points of observation. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Carola Eschenbach.  Contextual, Functional, and Geometric Components in the Semantics of Projective Terms , 2005, Functional Features in Language and Space.

[9]  J. Gregory Trafton,et al.  Choosing Frames of Referenece: Perspective-Taking in a 2D and 3D Navigational Task , 2004 .

[10]  C C Presson,et al.  Updating after Rotational and Translational Body Movements: Coordinate Structure of Perspective Space , 1994, Perception.

[11]  S. Levinson.  Space in language and cognition: Explorations in cognitive diversity , 2003 .

[12]  Michael F. Schober,et al.  Addressee- and Object-centered Frames of Reference in Spatial Descriptions , 1996 .

[13]  M. Pickering,et al.  Alignment of reference frames in dialogue , 2004 .

[14]  M. F. Schober.  Spatial perspective-taking in conversation , 1993, Cognition.

[15]  T. Tenbrink,et al.  Spatial reference in simulated human-robot interaction involving intrinsically oriented objects , 2007 .

[16]  B. Tversky,et al.  Perspective in Spatial Descriptions , 1996 .

[17]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[18]  Paul U. Lee,et al.  Why do speakers mix perspectives? , 1999, Spatial Cogn. Comput..

[19]  Andrew U. Frank.  Formal Models for Cognition - Taxonomy of Spatial Location Description and Frames of Reference , 1998, Spatial Cognition.

[20]  Joachim Grabowski,et al.  Factors Affecting Spatial Deictic Communication: A Comparison of German and American English , 2007 .

[21]  W. Levelt.  Cognitive styles in the use of spatial direction terms , 1982 .

[22]  Reinhard Moratz.  Intuitive linguistic Joint Object Reference in Human-Robot Interaction: Human Spatial Reference Systems and Function-Based Categorization for Symbol Grounding , 2006, AAAI.