Vision-based localization using an edge map extracted from 3D laser range data

Reliable real-time localization is a key component of autonomous industrial vehicle systems. We consider the problem of using on-board vision to determine a vehicle's pose in a known, but non-static, environment. While feasible technologies exist for vehicle localization, many are not suited for industrial settings where the vehicle must operate dependably both indoors and outdoors and in a range of lighting conditions. We extend the capabilities of an existing vision-based localization system, in a continued effort to improve the robustness, reliability and utility of an automated industrial vehicle system. The vehicle pose is estimated by comparing an edge-filtered version of a video stream to an available 3D edge map of the site. We enhance the previous system by additionally filtering the camera input for straight lines using a Hough transform, observing that the 3D environment map contains only linear features. In addition, we present an automated approach for generating 3D edge maps from laser point clouds, removing the need for manual map surveying and also reducing the time for map generation down from days to minutes. We present extensive localization results in multiple lighting conditions comparing the system with and without the proposed enhancements.

[1]  Stefano Soatto,et al.  Features for recognition: viewpoint invariance for non-planar scenes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[3]  Guannan Gao,et al.  Probabilistic Hough Transform , 2011 .

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Min-Yong Park,et al.  Outdoor Navigation of a Mobile Robot Using Differential GPS and Curb Detection , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6]  Ioannis Stamos,et al.  Geometry and Texture Recovery of Scenes of Large Scale , 2002, Comput. Vis. Image Underst..

[7]  Ioannis Stamos,et al.  Automated feature-based range registration of urban scenes of large scale , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  Gordon Wyeth,et al.  Robust outdoor visual localization using a three‐dimensional‐edge map , 2009, J. Field Robotics.

[9]  Y. Charlie Hu,et al.  Simultaneous localization and mapping with environmental structure prediction , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[10]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Yong-Il Kim,et al.  Segmentation and extraction of linear features for detecting discrepancies between LIDAR data strips , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[12]  John R. Spletzer,et al.  Towards Autonomous Wheelchair Systems in Urban Environments , 2009, FSR.

[13]  Jonathan M. Roberts,et al.  Autonomous Hot Metal Carrier - Navigation and Manipulation with a 20 tonne industrial vehicle , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[14]  Felix Duvallet,et al.  WiFi position estimation in industrial environments using Gaussian processes , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Michael Bosse,et al.  Map Matching and Data Association for Large-Scale Two-dimensional Laser Scan-based SLAM , 2008, Int. J. Robotics Res..

[16]  Andreas Zell,et al.  A hybrid approach for vision-based outdoor robot localization using global and local image features , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  David W. Murray,et al.  Full-3D Edge Tracking with a Particle Filter , 2006, BMVC.

[18]  Hung-Khoon Tan,et al.  Gestalt-based feature similarity measure in trademark database , 2006, Pattern Recognit..