Satellite image based precise robot localization on sidewalks

In this paper, we present a novel computer vision framework for precise localization of a mobile robot on sidewalks. In our framework, we combine stereo camera images, visual odometry, satellite map matching, and a sidewalk probability transfer function obtained from street maps in order to attain globally corrected localization results. The framework is capable of precisely localizing a mobile robot platform that navigates on sidewalks, without the use of traditional wheel odometry, GPS or INS inputs. On a complex 570-meter sidewalk route, we show that we obtain superior localization results compared to visual odometry and GPS.

[1]  K. Watanabe,et al.  Development of intelligent wheelchair employing omni-directional camera and slightly tilted laser rangefinder , 2004, SICE 2004 Annual Conference.

[2]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[3]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[4]  Ahmed M. Elgammal,et al.  A framework for global vehicle localization using stereo images and satellite and road maps , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[5]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Oliver Pink,et al.  Visual map matching and localization using a global feature map , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Hiroshi Murase,et al.  Vehicle Ego-Localization by Matching In-Vehicle Camera Images to an Aerial Image , 2010, ACCV Workshops.

[8]  Gerd Wanielik,et al.  High-accurate vehicle localization using digital maps and coherency images , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[9]  R.M. Parkin,et al.  The Use of Aerial Images and GPS for Mobile Robot Waypoint Navigation , 2008, IEEE/ASME Transactions on Mechatronics.

[10]  Hugh F. Durrant-Whyte,et al.  A high integrity IMU/GPS navigation loop for autonomous land vehicle applications , 1999, IEEE Trans. Robotics Autom..

[11]  Eduardo Bayro-Corrochano,et al.  EKF-SLAM and Machine Learning Techniques for Visual Robot Navigation , 2010, 2010 20th International Conference on Pattern Recognition.

[12]  Tingting Xu,et al.  The autonomous city explorer project: aims and system overview , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Sebastian Thrun,et al.  Simultaneous localization and mapping with unknown data association using FastSLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[15]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[16]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[17]  Shinji Kotani,et al.  Human interface of a robotic travel aid , 1994, Proceedings of 1994 3rd IEEE International Workshop on Robot and Human Communication.

[18]  Hideki Hashimoto,et al.  An open experiment of mobile robot autonomous navigation at the pedestrian streets in the city — Tsukuba Challenge , 2011, 2011 IEEE International Conference on Mechatronics and Automation.