Precise Localization of an Autonomous Car Based on Probabilistic Noise Models of Road Surface Marker Features Using Multiple Cameras

This paper presents a Monte Carlo localization algorithm for an autonomous car based on an integration of multiple sensors data. The sensor system is composed of onboard motion sensors, a low-cost GPS receiver, a precise digital map, and multiple cameras. Data from the onboard motion sensors, such as yaw rate and wheel speeds, are used to predict the vehicle motion, and the GPS receiver is applied to establish the validation boundary of the ego-vehicle position. The digital map contains location information at the centimeter level about road surface markers (RSMs), such as lane markers, stop lines, and traffic sign markers. The multiple images from the front and rear mono-cameras and the around-view monitoring system are used to detect the RSM features. The localization algorithm updates the measurements by matching the RSM features from the cameras to the digital map based on a particle filter. Because the particle filter updates the measurements based on a probabilistic sensor model, the exact probabilistic modeling of sensor noise is a key factor to enhance the localization performance. To design the probabilistic noise model of the RSM features more explicitly, we analyze the results of the RSM feature detection for various real driving conditions. The proposed localization algorithm is verified and evaluated through experiments under various test scenarios and configurations. From the experimental results, we conclude that the presented localization algorithm based on the probabilistic noise model of RSM features provides sufficient accuracy and reliability for autonomous driving system applications.

[1]  Tao Wu,et al.  Light-weight localization for vehicles using road markings , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Julius Ziegler,et al.  Video based localization for Bertha , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[3]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[4]  F Gustafsson,et al.  Particle filter theory and practice with positioning applications , 2010, IEEE Aerospace and Electronic Systems Magazine.

[5]  Gerd Wanielik,et al.  Camera-based vehicle localization at intersections using detailed digital maps , 2010, IEEE/ION Position, Location and Navigation Symposium.

[6]  Raja Sengupta,et al.  Kalman Filter-Based Integration of DGPS and Vehicle Sensors for Localization , 2005, IEEE Transactions on Control Systems Technology.

[7]  Henning Lategahn,et al.  Vision-Only Localization , 2014, IEEE Transactions on Intelligent Transportation Systems.

[8]  Shuzhi Sam Ge,et al.  Autonomous vehicle positioning with GPS in urban canyon environments , 2001, IEEE Trans. Robotics Autom..

[9]  Vincent Frémont,et al.  Mapping and localization using GPS, lane markings and proprioceptive sensors , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Gerd Wanielik,et al.  High-accurate vehicle localization using digital maps and coherency images , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[11]  Takashi Uozumi,et al.  Precise position estimation of autonomous vehicle based on map-matching , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[12]  Klaus C. J. Dietmayer,et al.  Localization based on region descriptors in grid maps , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[13]  Oliver Pink,et al.  Visual map matching and localization using a global feature map , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Myoungho Sunwoo,et al.  GPS-bias correction for precise localization of autonomous vehicles , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[15]  Bart De Schutter,et al.  IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS Editor-In-Chief , 2005 .

[16]  Lennart Svensson,et al.  Vehicle self-localization using off-the-shelf sensors and a detailed map , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[17]  Markus Schreiber,et al.  LaneLoc: Lane marking based localization using highly accurate maps , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[18]  Fernando Santos Osório,et al.  Robust curb detection and vehicle localization in urban environments , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[19]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[20]  Andreas Schindler Vehicle Self-localization Using High-precision Digital Maps , 2013 .

[21]  Rachid Belaroussi,et al.  Map-aided localization with lateral perception , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[22]  Vincent Frémont,et al.  Lane marking aided vehicle localization , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[23]  Pierre Charbonnier,et al.  Evaluation of Road Marking Feature Extraction , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[24]  Bernardo Wagner,et al.  Autonomous robot navigation based on OpenStreetMap geodata , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[25]  Jihua Huang,et al.  A Low-Order DGPS-Based Vehicle Positioning System Under Urban Environment , 2006, IEEE/ASME Transactions on Mechatronics.

[26]  Hongbin Zha,et al.  Monocular visual localization using road structural features , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[27]  Andreas Schindler,et al.  Vehicle Self-Localization Using High-Precision Digital Maps , 2013 .

[28]  Sebastian Thrun,et al.  Robust vehicle localization in urban environments using probabilistic maps , 2010, 2010 IEEE International Conference on Robotics and Automation.

[29]  Klaus C. J. Dietmayer,et al.  Multi-sensor self-localization based on Maximally Stable Extremal Regions , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[30]  William Whittaker,et al.  A robust approach to high‐speed navigation for unrehearsed desert terrain , 2006, J. Field Robotics.

[31]  Antonio F. Gómez-Skarmeta,et al.  High-Integrity IMM-EKF-Based Road Vehicle Navigation With Low-Cost GPS/SBAS/INS , 2007, IEEE Transactions on Intelligent Transportation Systems.

[32]  Julius Ziegler,et al.  Lanelets: Efficient map representation for autonomous driving , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[33]  Tao Wu,et al.  Vehicle localization using road markings , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[34]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[35]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[36]  Markus Maurer,et al.  Map-relative localization in lane-level maps for ADAS and autonomous driving , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[37]  N. Kaempchen,et al.  Precise ego-localization in urban areas using Laserscanner and high accuracy feature maps , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[38]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Myoungho Sunwoo,et al.  Integration of multiple vehicle models with an IMM filter for vehicle localization , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[40]  Myoungho Sunwoo,et al.  Interacting Multiple Model Filter-Based Sensor Fusion of GPS With In-Vehicle Sensors for Real-Time Vehicle Positioning , 2012, IEEE Transactions on Intelligent Transportation Systems.