Real-Time Ground-Plane Based Mobile Localization Using Depth Camera in Real Scenarios

Existing robot localization methods often rely on particular characteristics of the environment, such as vertical walls. However, these approaches loose generality once the environment does not show that structure, e.g., in domestic environments, making the deployment of autonomous self-locating robots difficult. This paper addresses the problem of absolute online self-localization in a known map, where the only required structure in the environment is a planar ground. In particular, we rely on the transitions between the ground and any other non-planar structure. The approach is based on the ground point-cloud and plane model perceived by a depth-camera. The ground detection algorithm is robust to small shifts on camera orientation during the robot motion, by determining the calibration parameters on-the-fly. Then the edges of the ground point-cloud are estimated, which can be originated by obstacles in the environment. The localization is obtained using a particle filter fusing the odometry with a novel observation model reflecting the quality of the match between the ground edges and the nearest obstacles. For this purpose, a cost function was implemented based on a distance-to-obstacles grid map. Experimental results using the ISR-CoBot robot are presented, run in different scenarios, including a bookshop during working hours.

[1]  Manuela M. Veloso,et al.  Depth camera based indoor mobile robot localization and navigation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Joachim Hertzberg,et al.  Globally consistent 3D mapping with scan matching , 2008, Robotics Auton. Syst..

[3]  David G. Kirkpatrick,et al.  Linear Time Euclidean Distance Algorithms , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Wolfram Burgard,et al.  Particle Filters for Mobile Robot Localization , 2001, Sequential Monte Carlo Methods in Practice.

[5]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[6]  Garry A. Einicke,et al.  Robust extended Kalman filtering , 1999, IEEE Trans. Signal Process..

[7]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[8]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Rodrigo Ventura,et al.  Two Faces of Human–Robot Interaction: Field and Service Robots , 2014 .

[10]  Dieter Fox,et al.  Adapting the Sample Size in Particle Filters Through KLD-Sampling , 2003, Int. J. Robotics Res..

[11]  José A. Castellanos,et al.  Robocentric map joining: Improving the consistency of EKF-SLAM , 2007, Robotics Auton. Syst..

[12]  Sebastian Thrun,et al.  Integrating Grid-Based and Topological Maps for Mobile Robot Navigation , 1996, AAAI/IAAI, Vol. 2.

[13]  Dieter Fox,et al.  An experimental comparison of localization methods continued , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[15]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[16]  Joseph Gil,et al.  Linear Time Euclidean Distance , 1995 .

[17]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[18]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[19]  Nuno Lau,et al.  Using a Depth Camera for Indoor Robot Localization and Navigation , 2011 .