Accurate Ego-Vehicle Global Localization at Intersections Through Alignment of Visual Data With Digital Map

This paper proposes a method for achieving improved ego-vehicle global localization with respect to an approaching intersection, which is based on the alignment of visual landmarks perceived by the on-board visual system, with the information from a proposed extended digital map (EDM). The visual system relies on a stereovision system that provides a detailed 3-D description of the environment, including road landmark information (lateral lane delimiters, painted traffic signs, curbs, and stop lines) and dynamic environment information (other vehicles). An EDM is proposed, which enriches the standard map information with a detailed description of the intersection required for current lane identification, landmark alignment, and ego-vehicle accurate global localization. A novel approach for lane-delimiter classification, which is necessary for the lane identification, is also presented. An original solution for identifying the current lane, combining visual and map information with the help of a Bayesian network (BN), is proposed. Extensive experiments have been performed, and the results are evaluated with a Global Navigation Satellite System of high accuracy (2 cm). The achieved global localization accuracy is of submeter level, depending on the performance of the stereovision system.

[1]  Rafael Toledo-Moreo,et al.  Fusing GNSS, Dead-Reckoning, and Enhanced Maps for Road Vehicle Lane-Level Navigation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[2]  Sergiu Nedevschi,et al.  Stop-line detection and localization method for intersection scenarios , 2011, 2011 IEEE 7th International Conference on Intelligent Computer Communication and Processing.

[3]  Jayanta K. Ghosh,et al.  Bayesian Networks and Decision Graphs, 2nd Edition by Finn V. Jensen, Thomas D. Nielsen , 2008 .

[4]  Otman A. Basir,et al.  Improving Vehicle Positioning and Visual Feature Estimates through Mutual Constraint , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[5]  Rüdiger Dillmann,et al.  Road-marking Analysis for Autonomous Vehicle Guidance , 2007, EMCR.

[6]  G. Thomas,et al.  FREQUENCY FILTERING AND CONNECTED COMPONENTS CHARACTERIZATION FOR ZEBRA-CROSSING AND HATCHED MARKINGS DETECTION , 2010 .

[7]  R. Haralick,et al.  A robust linear least-squares estimation of camera exterior orientation using multiple geometric features , 2000 .

[8]  Jay A. Farrell,et al.  Real-Time Computer Vision/DGPS-Aided Inertial Navigation System for Lane-Level Vehicle Navigation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[9]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[10]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[11]  Sergiu Nedevschi,et al.  Lane identification and ego-vehicle accurate global positioning in intersections , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[12]  M. Barth,et al.  Bayesian Probabilistic Vehicle Lane Matching for Link-Level In-Vehicle Navigation , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[13]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[14]  Sebastian Thrun,et al.  Map-Based Precision Vehicle Localization in Urban Environments , 2007, Robotics: Science and Systems.

[15]  Guna Seetharaman,et al.  Video-Assisted Global Positioning in Terrain Navigation with Known Landmarks , 2006, Int. J. Distributed Sens. Networks.

[16]  Isaac Skog,et al.  In-Car Positioning and Navigation Technologies—A Survey , 2009, IEEE Transactions on Intelligent Transportation Systems.

[17]  Raja Sengupta,et al.  Kalman Filter-Based Integration of DGPS and Vehicle Sensors for Localization , 2005, IEEE Transactions on Control Systems Technology.

[18]  Sergiu Nedevschi,et al.  Detection and classification of painted road objects for intersection assistance applications , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[19]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[20]  Cindy Cappelle,et al.  Multi-sensors data fusion using Dynamic Bayesian Network for robotised vehicle geo-localisation , 2008, 2008 11th International Conference on Information Fusion.

[21]  Sergiu Nedevschi,et al.  Stereovision-Based Sensor for Intersection Assistance , 2009 .

[22]  Gerd Wanielik,et al.  Situation Assessment for Automatic Lane-Change Maneuvers , 2010, IEEE Transactions on Intelligent Transportation Systems.

[23]  Rafael Toledo-Moreo,et al.  Lane-Level Integrity Provision for Navigation and Map Matching With GNSS, Dead Reckoning, and Enhanced Maps , 2010, IEEE Transactions on Intelligent Transportation Systems.

[24]  Jian Li,et al.  Decision making under uncertainty , 2011 .

[25]  Sung-Kwan Joo,et al.  Locating Intersections for Autonomous Vehicles: A Bayesian Network Approach , 2007 .

[26]  Kyoung-Ho Choi,et al.  Methods to Detect Road Features for Video-Based In-Vehicle Navigation Systems , 2010, J. Intell. Transp. Syst..

[27]  Kai Homeier,et al.  RoadGraph - Graph based environmental modelling and function independent situation analysis for driver assistance systems , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[28]  Gerd Wanielik,et al.  High-accurate vehicle localization using digital maps and coherency images , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[29]  Stuart J. Russell,et al.  The BATmobile: Towards a Bayesian Automated Taxi , 1995, IJCAI.

[30]  J.A. Lopez-Orozco,et al.  Unified fusion system based on Bayesian networks for autonomous mobile robots , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[31]  Sergiu Nedevschi,et al.  Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[32]  Z. Papp,et al.  World modeling for cooperative intelligent vehicles , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[33]  Sergiu Nedevschi,et al.  A framework for object detection, tracking and classification in urban traffic scenarios using stereovision , 2009, 2009 IEEE 5th International Conference on Intelligent Computer Communication and Processing.

[34]  Thanh-Son Dao,et al.  Markov-Based Lane Positioning Using Intervehicle Communication , 2007, IEEE Transactions on Intelligent Transportation Systems.

[35]  Sergiu Nedevschi,et al.  Polynomial curb detection based on dense stereovision for driving assistance , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[36]  C. Hilario,et al.  Detection and classification of road lanes with a frequency analysis , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[37]  F. Chausse,et al.  Vehicle localization on a digital map using particles filtering , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[38]  Jin Wang,et al.  Lane keeping based on location technology , 2005, IEEE Transactions on Intelligent Transportation Systems.

[39]  Myoungho Sunwoo,et al.  Interacting Multiple Model Filter-Based Sensor Fusion of GPS With In-Vehicle Sensors for Real-Time Vehicle Positioning , 2012, IEEE Transactions on Intelligent Transportation Systems.

[40]  Uffe Kjærulff,et al.  Bayesian Networks and Influence Diagrams: A Guide to Construction and Analysis , 2007, Information Science and Statistics.