Group-based Spatial Reference in Linguistic Human-Robot Interaction

To enable a robot to interpret natural language instructions with regard to a specific object in a configuration, the robot needs to be equipped with a repertory of representations that human users might employ for reference. In this paper, we focus on the ways in which objects are referred to in relation to other similar objects, by analysing the results of an experiment involving a robot and human users unfamiliar with it. The robot is designed to understand reference via basic intrinsic and relative reference systems. Results showed that our implemented computational model could handle standard instances of spatial reference, but needed refinement to be able to interpret specific variations that were employed by users based on contextual factors analysed in this paper.

[1]  K. Fischer.  Linguistic Methods for Investigating Concepts in Use , 2003 .

[2]  Daniel Hernández,et al.  Qualitative Representation of Spatial Knowledge , 1994, Lecture Notes in Computer Science.

[3]  Jörg Baus,et al.  The Use of Locative Expressions in Dependence of the Spatial Relation Between Target and Reference Object in Two-Dimensional Layouts , 1998, Spatial Cognition.

[4]  Kerstin Fischer,et al.  Cognitive Modeling of Spatial Reference for Human-Robot Interaction , 2001, Int. J. Artif. Intell. Tools.

[5]  Ipke Wachsmuth,et al.  Gesture and Sign Languages in Human-Computer Interaction, International Gesture Workshop, GW 2001, London, UK, April 18-20, 2001, Revised Papers , 2002, Gesture Workshop.

[6]  Wilfried Brauer,et al.  Spatial Cognition III , 2003, Lecture Notes in Computer Science.

[7]  Jianwei Zhang,et al.  Instructing cooperating assembly robots through situated dialogues in natural language , 1997, Proceedings of International Conference on Robotics and Automation.

[8]  Tim Lüth,et al.  Utilizing Spatial Relations for Natural Language Access to an Autonomous Mobile Agent , 1994, KI.

[9]  Gerhard Sagerer,et al.  Projective Relations for 3D Space: Computational Model, Application, and Psychological Evaluation , 1997, AAAI/IAAI.

[10]  S. Levinson.  Frames of reference and Molyneux's question: Cross-linguistic evidence , 1996 .

[11]  N. Franklin,et al.  Parsing surrounding space into regions , 1995, Memory & cognition.

[12]  R. Moratz,et al.  Instruction modes for joint spatial reference between naive users and a mobile robot , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.