Route description interpretation on automatically labeled robot maps

This paper presents an approach to combine automatic semantic place labeling of robot-generated maps with reasoning on human route descriptions. Enabling robots to understand human route descriptions can simplify HRI situations in household or industrial settings. However, solving this problem requires handling the ambiguity present in route descriptions and the possible unreliability of the semantic perception capabilities of the robot. We address this problem by absorbing these uncertainties in a probability distribution measuring the likelihood of the different interpretations (paths) of a given route description and selecting its MAP solution. The approach is evaluated on a dataset of route descriptions transcribed into a suitable representation using standard information retrieval metrics. These performance measurements indicate that the method can correctly interpret route descriptions even in challenging environments.

[1]  James M. Rehg,et al.  Visual Place Categorization: Problem, dataset, and algorithm , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Danica Kragic,et al.  Enhanced visual scene understanding through human-robot dialog , 2010, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Óscar Martínez Mozos Semantic Labeling of Places with Mobile Robots , 2010, Springer Tracts in Advanced Robotics.

[4]  Dieter Fox,et al.  Following directions using statistical machine translation , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  Gabriel Skantze,et al.  Understanding route directions in human-robot dialogue , 2011 .

[6]  Klaus Stein,et al.  Coarse Qualitative Descriptions in Robot Navigation , 2000, Spatial Cognition.

[7]  Stefanie Tellex,et al.  A Discriminative Model for Understanding Natural Language Route Directions , 2010, AAAI Fall Symposium: Dialog with Robots.

[8]  Jongwoo Lim,et al.  Visual place categorization in maps , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Patric Jensfelt,et al.  Predicting What Lies Ahead in the Topology of Indoor Environments , 2012, Spatial Cognition.

[10]  Wolfram Burgard,et al.  Conceptual spatial representations for indoor mobile robots , 2008, Robotics Auton. Syst..

[11]  Frank Dellaert,et al.  Online probabilistic topological mapping , 2011, Int. J. Robotics Res..

[12]  Ryo Kurazume,et al.  Categorization of Indoor Places Using the Kinect Sensor , 2012, Sensors.

[13]  Benjamin Kuipers,et al.  Towards a general theory of topological maps , 2004, Artif. Intell..

[14]  Dieter Fox,et al.  Voronoi Random Fields: Extracting Topological Structure of Indoor Environments via Place Labeling , 2007, IJCAI.

[15]  Andrea Maria Bauer,et al.  Extraction of probabilistic route information representations from human-robot dialogs , 2010 .

[16]  Franz Aurenhammer,et al.  Voronoi diagrams—a survey of a fundamental geometric data structure , 1991, CSUR.

[17]  Bernd Krieg-Brückner,et al.  Modelling Navigational Knowledge by Route Graphs , 2000, Spatial Cognition.

[18]  Christian Mandel,et al.  Robot Navigation based on the Mapping of Coarse Qualitative Route Descriptions to Route Graphs , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Sebastian Thrun,et al.  Learning Metric-Topological Maps for Indoor Mobile Robot Navigation , 1998, Artif. Intell..