Real-time global localization of intelligent road vehicles in lane-level via lane marking detection and shape registration

In this paper, we propose an accurate and real-time positioning method for intelligent road vehicles in urban environments. The proposed method uses a robust lane marking detection algorithm, as well as an efficient shape registration algorithm between the detected lane markings and a GPS based road shape prior, to improve the robustness and accuracy of global localization of a road vehicle. We exploit both the state-of-the-art technologies of visual localization based on lane marking detection and the wide availability of Global Positioning System (GPS) based localization. We show that by formulating the positioning problem in a relative sense, we can estimate the vehicle localization in real-time and bound its absolute error in centimeter-level by a cross validation scheme. The validation scheme integrates the vision based lane marking detection with the shape registration, and improves the performance of the overall localization system. The GPS localization can be refined by using lane marking detection when the GPS suffers from frequent satellite signal masking or blockage, while lane marking detection is validated and completing by the GPS based road shape prior when it does not work well in adverse weather conditions or with poor lane signature. We extensively evaluate the proposed method with a single forward-looking camera mounted on an autonomous vehicle which travels at 60km/h through several urban street scenes.

[1]  Paul Newman,et al.  Real-time bounded-error pose estimation for road vehicles using vision , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[2]  Vincent Frémont,et al.  Lane marking aided vehicle localization , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[3]  D. Powell,et al.  Land-vehicle navigation using GPS , 1999, Proc. IEEE.

[4]  Robert B. Noland,et al.  Current map-matching algorithms for transport applications: State-of-the art and future research directions , 2007 .

[5]  Markus Schreiber,et al.  LaneLoc: Lane marking based localization using highly accurate maps , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[6]  Rafael Toledo-Moreo,et al.  Creating Enhanced Maps for Lane-Level Vehicle Navigation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[7]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[8]  Kostas Daniilidis,et al.  Monocular visual odometry in urban environments using an omnidirectional camera , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Ignacio Parra,et al.  Accurate Global Localization Using Visual Odometry and Digital Maps on Urban Environments , 2012, IEEE Transactions on Intelligent Transportation Systems.

[10]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Paolo Pirjanian,et al.  The vSLAM Algorithm for Robust Localization and Mapping , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.