Reasoning about natural language phrases for semantic goal driven exploration

This paper presents a symbolic navigation system that uses spatial language descriptions to inform goal-directed exploration in unfamiliar office environments. An abstract map is created from a collection of natural language phrases describing the spatial layout of the environment. The spatial representation in the abstract map is controlled by a constraint based interpretation of each natural language phrase. In goal-directed exploration of an unseen office environment, the robot links the information in the abstract map to observed symbolic information and its grounded world representation. This paper demonstrates the ability of the system, in both simulated and real-world trials, to efficiently find target rooms in environments that it has never been to previously. In three unexplored environments, it is shown that on average the system travels only 8.42% further than the optimal path when using only natural language phrases to complete navigation tasks.

[1]  Paul Bremner,et al.  ACM/IEEE International Conference on Human-Robot Interaction, HRI 2013, Tokyo, Japan, March 3-6, 2013 , 2013, HRI.

[2]  Mary Hegarty,et al.  What determines our navigational abilities? , 2010, Trends in Cognitive Sciences.

[3]  B. Landau,et al.  “What” and “where” in spatial language and spatial cognition , 1993 .

[4]  Christoph Hölscher,et al.  Taxonomy of Human Wayfinding Tasks: A Knowledge-Based Approach , 2009, Spatial Cogn. Comput..

[5]  Maja J. Mataric,et al.  Using semantic fields to model dynamic spatial relations in a robot architecture for natural language instruction of service robots , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Gordon Wyeth,et al.  Robot navigation using human cues: A robot navigation system for symbolic goal-directed exploration , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Tingting Xu,et al.  The Autonomous City Explorer: Towards Natural Human-Robot Interaction in Urban Environments , 2009, Int. J. Soc. Robotics.

[8]  Gordon Wyeth,et al.  Constructing abstract maps from spatial descriptions for goal-directed exploration , 2015, RSS 2015.

[9]  Matthew R. Walter,et al.  Learning models for following natural language directions in unknown environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Stefanie Tellex,et al.  Toward understanding natural language directions , 2010, HRI 2010.

[11]  B. Tversky,et al.  Spatial mental models derived from survey and route descriptions , 1992 .

[12]  S. Levinson.  Frames of reference and Molyneux's question: Cross-linguistic evidence , 1996 .

[13]  杨晓敏.  2009年《Journal of Memory and Language》与《Brain and Language》期刊关于园径句研究综述 , 2010 .