Grounding Natural Language References to Unvisited and Hypothetical Locations

While much research exists on resolving spatial natural language. to known locations, little work deals with handling references to unknown locations. In this paper we introduce and evaluate algorithms integrated into a cognitive architecture which allow an agent to learn about its environment while resolving references to both known and unknown locations. We also describe how multiple components in the architecture jointly facilitate these capabilities.

[1]  Tim Lüth,et al.  Utilizing Spatial Relations for Natural Language Access to an Autonomous Mobile Agent , 1994, KI.

[2]  Stefanie Tellex,et al.  Toward understanding natural language directions , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  Reinhard Moratz,et al.  Spatial Reference in Linguistic Human-Robot Interaction: Iterative, Empirically Supported Development of a Model of Projective Relations , 2006, Spatial Cogn. Comput..

[4]  Seth J. Teller,et al.  Following and interpreting narrated guided tours , 2011, 2011 IEEE International Conference on Robotics and Automation.

[5]  Dieter Fox,et al.  Following directions using statistical machine translation , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  Marc Hanheide,et al.  Home alone: Autonomous extension and correction of spatial representations , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Luke S. Zettlemoyer,et al.  Learning to Parse Natural Language Commands to a Robot Control System , 2012, ISER.

[8]  Ivana Kruijff-Korbayová,et al.  Situated resolution and generation of spatial referring expressions for robotic assistants , 2009, IJCAI 2009.

[9]  Benjamin Kuipers,et al.  The Spatial Semantic Hierarchy , 2000, Artif. Intell..

[10]  Raymond J. Mooney,et al.  Learning to Interpret Natural Language Navigation Instructions from Observations , 2011, Proceedings of the AAAI Conference on Artificial Intelligence.

[11]  Henrik I. Christensen,et al.  Situated Dialogue and Spatial Organization: What, Where… and Why? , 2007 .

[12]  Matthew R. Walter,et al.  Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation , 2011, AAAI.

[13]  Kerstin Fischer,et al.  Spatial Knowledge Representation for Human-Robot Interaction , 2003, Spatial Cognition.

[14]  Matthias Scheutz,et al.  Robust spoken instruction understanding for HRI , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Matthias Scheutz,et al.  First steps toward natural human-like HRI , 2007, Auton. Robots.