Lidar-based urban road detection by histograms of normalized inverse depths and line scanning

In this paper, we propose to fuse the geometric information of a 3D Lidar and a monocular camera to detect the urban road region ahead of an autonomous vehicle. Our method takes advantage of both the high definition of 3D Lidar data and the continuity of road in image representation. First, we obtain an efficient representation of Lidar data, an organized 2D inverse depth map, by projecting the spatially unorganized 3D Lidar points onto the camera's image plane. The approximate road regions can be quickly estimated by extracting vertical and horizontal histograms of the normalized inverse depths. To accurately find the road area, a row and column scanning strategy is applied in the approximate road region. We have carried out experiments on the public KITTI-Road benchmark, and achieve one of the best performance among the Lidar-based road detection methods without learning procedure.

[1]  Fernando Santos Osório,et al.  Robust curb detection and vehicle localization in urban environments , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[2]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[3]  Yann LeCun,et al.  Road Scene Segmentation from a Single Image , 2012, ECCV.

[4]  Vincent Frémont,et al.  Color-based road detection and its evaluation on the KITTI road benchmark , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[5]  Liang Xiao,et al.  CRF based road detection with multi-sensor fusion , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[6]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[7]  Wende Zhang,et al.  LIDAR-based road and road-edge detection , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[8]  Jian Yang,et al.  Lidar-histogram for fast road and obstacle detection , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[11]  W. Sardha Wijesoma,et al.  Road-boundary detection and tracking using ladar sensing , 2004, IEEE Transactions on Robotics and Automation.

[12]  Ulrich Hofmann,et al.  Road curb detection based on different elevation mapping techniques , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[13]  Tommy Chang,et al.  Color model-based real-time learning for road following , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[14]  P. Peixoto,et al.  Road Detection Using High Resolution LIDAR , 2014, 2014 IEEE Vehicle Power and Propulsion Conference (VPPC).

[15]  Jean Ponce,et al.  Vanishing point detection for road detection , 2009, CVPR.

[16]  Kangru Wang,et al.  Non-flat Road Detection Based on A Local Descriptor , 2016, ArXiv.

[17]  Z. Hu,et al.  U-V-disparity: an efficient algorithm for stereovision based scene analysis , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[18]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[19]  Christoph Stiller,et al.  Joint self-localization and tracking of generic objects in 3D range data , 2013, 2013 IEEE International Conference on Robotics and Automation.

[20]  Bo Zhang,et al.  Color-based road detection in urban traffic scenes , 2004, IEEE Transactions on Intelligent Transportation Systems.

[21]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[22]  Patrick Y. Shinzato,et al.  Fast visual road recognition and horizon detection using multiple artificial neural networks , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[23]  Denis Fernando Wolf,et al.  Road terrain detection: Avoiding common obstacle detection assumptions using sensor fusion , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[24]  F. SergioA.Rodriguez,et al.  A multi-modal system for road detection and segmentation , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[25]  Liang Xiao,et al.  Hybrid conditional random field based camera-LIDAR fusion for road detection , 2017, Inf. Sci..