A 3D LiDAR Data-Based Dedicated Road Boundary Detection Algorithm for Autonomous Vehicles

Effectively detecting road boundaries in real time is critical to the applications of autonomous vehicles, such as vehicle localization, path planning, and environmental understanding. To precisely extract the irregular road boundaries or those blocked by obstructions on the road from the 3D LiDAR data, a dedicated algorithm consisting of four steps is proposed in this paper. The steps are as follows. First, the 3D LiDAR data is pre-processed, employing the vehicle position and attitude information, and many noise points are deleted. Second, the ground points are quickly separated from the pre-processed point cloud data to reduce the disturbance from the obstacles on the road; this greatly decreases the size of the points cloud to be processed. Third, the candidate points of the road boundaries are searched along the predicted trajectory of the autonomous vehicle and filtered using the unique features of the boundary points. Last, a spline fit model is applied to smoothen the road boundaries. An experiment to test the performance of the proposed algorithm was conducted on the “Xinda” autonomous vehicle under various road scenarios. The experimental results show that the average accuracy of the proposed algorithm exceeds 93%, and its average processing time is approximately 36.5 ms/frame, which outperforms most of the state-of-the-art methods. This indicates that the proposed algorithm can robustly extract the road boundary in real time even if there are many obstacles on the road. This algorithm has been tested on “Xinda” autonomous vehicle for over 1000 kilometers, and its performance was always stable.

[1]  Jian Liu,et al.  A Practical Point Cloud Based Road Curb Detection Method for Autonomous Vehicle , 2017, Inf..

[2]  Ho Gi Jung,et al.  Sensor Fusion-Based Low-Cost Vehicle Localization System for Complex Urban Environments , 2017, IEEE Transactions on Intelligent Transportation Systems.

[3]  Myoungho Sunwoo,et al.  Enhanced Road Boundary and Obstacle Detection Using a Downward-Looking LIDAR Sensor , 2012, IEEE Transactions on Vehicular Technology.

[4]  Peng Li,et al.  Road Boundaries Detection Based on Local Normal Saliency From Mobile Laser Scanning Data , 2015, IEEE Geoscience and Remote Sensing Letters.

[5]  Daxue Liu,et al.  A New Curb Detection Method for Unmanned Ground Vehicles Using 2D Sequential Laser Data , 2013, Sensors.

[6]  Fernando Santos Osório,et al.  Robust curb detection and vehicle localization in urban environments , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[7]  Raúl Rojas,et al.  Camera based detection and classification of soft shoulders, curbs and guardrails , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[8]  Bin Dai,et al.  Gaussian-Process-Based Real-Time Ground Segmentation for Autonomous Land Vehicles , 2013, Journal of Intelligent & Robotic Systems.

[9]  Minkwang Lee,et al.  Road boundary detection and tracking for structured and unstructured roads using a 2D lidar sensor , 2014 .

[10]  Tobias Gindele,et al.  Team AnnieWAY's autonomous system for the 2007 DARPA Urban Challenge , 2008 .

[11]  Ulrich Hofmann,et al.  Road curb detection based on different elevation mapping techniques , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[12]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[13]  Jian Chen,et al.  Drivable Road Reconstruction for Intelligent Vehicles Based on Two-View Geometry , 2017, IEEE Transactions on Industrial Electronics.

[14]  Jun Wang,et al.  3D-LIDAR based branch estimation and intersection location for autonomous vehicles , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[15]  Michael Himmelsbach,et al.  Autonomous Ground Vehicles—Concepts and a Path to the Future , 2012, Proceedings of the IEEE.

[16]  Bongsob Song,et al.  A Lidar-Based Decision-Making Method for Road Boundary Detection Using Multiple Kalman Filters , 2012, IEEE Transactions on Industrial Electronics.

[17]  Qingquan Li,et al.  A Sensor-Fusion Drivable-Region and Lane-Detection System for Autonomous Vehicle Navigation in Challenging Road Scenarios , 2014, IEEE Transactions on Vehicular Technology.

[18]  Bisheng Yang,et al.  Semi-automated extraction and delineation of 3D roads of street scene from mobile laser scanning point clouds , 2013 .

[19]  Denis F. Wolf,et al.  Monte Carlo Localization on Gaussian Process Occupancy Maps for Urban Environments , 2018, IEEE Transactions on Intelligent Transportation Systems.

[20]  K. Madhava Krishna,et al.  CRF based method for curb detection using semantic cues and stereo depth , 2016, ICVGIP '16.

[21]  Hideaki Kido,et al.  Road Surface Segmentation based on Vertically Local Disparity Histogram for Stereo Camera , 2018, Int. J. Intell. Transp. Syst. Res..

[22]  Derek D. Lichti,et al.  DETECTION OF ROAD CURB FROM MOBILE TERRESTRIAL LASER SCANNER POINT CLOUD , 2012 .

[23]  Jun Tan,et al.  Robust Curb Detection with Fusion of 3D-Lidar and Camera Data , 2014, Sensors.

[24]  Cheng Wang,et al.  Automated Road Information Extraction From Mobile Laser Scanning Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[25]  Shiming Xiang,et al.  Automatic Road Detection and Centerline Extraction via Cascaded End-to-End Convolutional Neural Network , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Xiaonian Wang,et al.  Road-Segmentation-Based Curb Detection Method for Self-Driving via a 3D-LiDAR Sensor , 2018, IEEE Transactions on Intelligent Transportation Systems.

[27]  W. Sardha Wijesoma,et al.  Road-boundary detection and tracking using ladar sensing , 2004, IEEE Transactions on Robotics and Automation.

[28]  Guo Cheng,et al.  All weather road edge identification based on driving video mining , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[29]  Denis Fernando Wolf,et al.  Feature Detection for Vehicle Localization in Urban Environments Using a Multilayer LIDAR , 2016, IEEE Transactions on Intelligent Transportation Systems.

[30]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[31]  Jun Wang,et al.  Development of ‘Intelligent Pioneer’ unmanned vehicle , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[32]  Tayfun Efe Ertop,et al.  An adaptive approach for road boundary detection using 2D LIDAR sensor , 2017, 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[33]  Ming Cheng,et al.  3-D Road Boundary Extraction From Mobile Laser Scanning Data via Supervoxels and Graph Cuts , 2018, IEEE Transactions on Intelligent Transportation Systems.

[34]  Michael Fleming,et al.  Team Cornell's Skynet: Robust perception and planning in an urban environment , 2008 .