A Low-Cost Solution for Automatic Lane-Level Map Generation Using Conventional In-Car Sensors

Lane-level digital maps are crucial to advanced driver assistance systems (ADAS) and autonomous driving, since they can simplify driving tasks and enhance system performance by providing strong priors about the driving environment. However, the high cost of current map generation systems prevents their benefits to normal commercial cars as they usually depend on specialized sensors and need great manual postprocessing. In this paper, a low-cost solution is proposed for automatic generation of a precise lane-level map by using conventional sensors that have been already installed in contemporary cars. It mainly consists of two modules, i.e., road orthographic image generation and lane graph construction. First, the global map is divided into fixed local segments based on the road network topology. With the reference of the local map segments, the bird's eye view images of the road surface are accumulated by fusing GPS, INS, and visual odometry and subsequently integrated into synthetic orthographic images. Next, the driving lane information is extracted from the road orthographic images and a large amount of vehicle trajectories. Such information is then used to construct a lane graph of the map based on the sophisticated lane models we proposed without manual processing. Experiments show promising results of the automatic map generation of the real-world roads, which substantiated the effectiveness of the proposed approach. Such a system can offer increased value and promote the automation level for today's commercial cars without being supplemented additional sensors.

[1]  Javier Ibanez Guzman,et al.  Accurate visual odometry from a rear parking camera , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[2]  Jana Kosecka,et al.  Acquiring semantics induced topology in urban environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  M. E. Cannon,et al.  GPS/MEMS INS integrated system for navigation in urban areas , 2007 .

[4]  Michael R. James,et al.  Generation of Accurate Lane-Level Maps from Coarse Prior Maps and Lidar , 2015, IEEE Intelligent Transportation Systems Magazine.

[5]  Wolfram Burgard,et al.  Large scale graph-based SLAM using aerial images as prior information , 2009, Auton. Robots.

[6]  Christoph Stiller,et al.  Automated map generation from aerial images for precise vehicle localization , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[7]  Sebastian Thrun,et al.  Towards fully autonomous driving: Systems and algorithms , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[8]  Seiichi Mita,et al.  Robust Road Detection and Tracking in Challenging Scenarios Based on Markov Random Fields With Unsupervised Learning , 2012, IEEE Transactions on Intelligent Transportation Systems.

[9]  Emil Angelov Google Self-driving car , 2016 .

[10]  K G Baass,et al.  THE USE OF CLOTHOID TEMPLATES IN HIGHWAY DESIGN , 1984 .

[11]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[12]  B. D. Netten,et al.  Safespot local dynamic maps : context-dependent view generation of a platform's state & environment , 2008 .

[13]  Andreas Geiger,et al.  Monocular road mosaicing for urban environments , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[14]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[15]  Kees Wevers,et al.  Digital Maps for Lane Level Positioning , 2008 .

[16]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[17]  Sebastian Ramos,et al.  Vision-Based Offline-Online Perception Paradigm for Autonomous Driving , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[18]  Robert B. Noland,et al.  Current map-matching algorithms for transport applications: State-of-the art and future research directions , 2007 .

[19]  Georg Maier,et al.  Generation of high precision digital maps using circular arc splines , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[20]  Myoungho Sunwoo,et al.  Generation of a Precise Roadway Map for Autonomous Cars , 2014, IEEE Transactions on Intelligent Transportation Systems.

[21]  Rafael Toledo-Moreo,et al.  Creating Enhanced Maps for Lane-Level Vehicle Navigation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[22]  Alan L. Yuille,et al.  FORMS: A flexible object recognition and modelling system , 1996, International Journal of Computer Vision.

[23]  Gerd Wanielik,et al.  High-accurate vehicle localization using digital maps and coherency images , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[24]  Andreas Geiger,et al.  Joint 3D Estimation of Objects and Scene Layout , 2011, NIPS.

[25]  Paul Newman,et al.  Generation and exploitation of local orthographic imagery for road vehicle localisation , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[26]  Yoshiko Kojima,et al.  Road ortho-image generation based on accurate vehicle trajectory estimation by GPS Doppler , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[27]  Luc Van Gool,et al.  Segmentation-Based Urban Traffic Scene Understanding , 2009, BMVC.

[28]  Seiichi Mita,et al.  Lane detection and tracking in challenging environments based on a weighted graph and integrated cues , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.