Multi-Lane Detection Based on Deep Convolutional Neural Network

In order to solve the problem of the poor robustness for extracting the multi-lane marking, a multi-lane detection algorithm based on deep convolutional neural network is proposed. Since the results of the feature extraction of lane boundary were affected by various factors, a deep convolutional neural network based on FCN network is used for lane boundary feature extraction, and the neural network can be used to classify the lane images at the pixel level. Then the network parameters are trained on the public Tusimple data set and evaluated at Caltech Lanes data set. The last part combines a linear model with a curved model to realize the establishment of the lane marking equation, Hough transform is used to determine the fit interval and the least square method is used to fit lane marking. The experimental results show that the average accuracy of the algorithm for identifying lane on the Tusimple data set is 98.74%, and the accuracy rate on the Caltech Lanes data set is 96.29%.

[1]  Wang Xingang,et al.  Real-time lane-vehicle detection and tracking system , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[2]  Sergio Okida,et al.  A Novel Strategy for Road Lane Detection and Tracking Based on a Vehicle’s Forward Monocular Camera , 2019, IEEE Transactions on Intelligent Transportation Systems.

[3]  Dacheng Tao,et al.  Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[5]  Dhiraj Manohar Dhane,et al.  A review of recent advances in lane detection and departure warning system , 2018, Pattern Recognit..

[6]  Xizheng Zhang,et al.  Autonomous path tracking control of intelligent electric vehicles based on lane detection and optimal preview method , 2019, Expert Syst. Appl..

[7]  Naim Dahnoun,et al.  Real-time stereo vision-based lane detection system , 2018, ArXiv.

[8]  Chunyang Mu,et al.  Lane Detection Based on Object Segmentation and Piecewise Fitting , 2014 .

[9]  Xiangjing An,et al.  Real-time lane departure warning system based on a single FPGA , 2013, EURASIP J. Image Video Process..

[10]  Kang Ryoung Park,et al.  Road Lane Detection by Discriminating Dashed and Solid Road Lanes Using a Visible Light Camera Sensor , 2016, Sensors.

[11]  Chanho Lee,et al.  Robust Lane Detection and Tracking for Real-Time Applications , 2018, IEEE Transactions on Intelligent Transportation Systems.

[12]  Jian Yang,et al.  Vanishing Point Constrained Lane Detection With a Stereo Camera , 2018, IEEE Transactions on Intelligent Transportation Systems.

[13]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[14]  Cheng-Jian Lin,et al.  Applying fuzzy method to vision-based lane detection and departure warning system , 2010, Expert Syst. Appl..

[15]  Chung-Bin Wu,et al.  Ultra-Low Complexity Block-Based Lane Detection and Departure Warning System , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Zhidong Deng,et al.  Drivable Road Detection Based on Dilated FPN with Feature Aggregation , 2017, 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI).

[17]  Huifang Li,et al.  Study on a robust approach of lane departure warning algrithm , 2010, 2010 2nd International Conference on Signal Processing Systems.

[18]  Changzheng Hou,et al.  An efficient lane markings detection and tracking method based on vanishing point constraints , 2016, CCC 2016.

[19]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[20]  Faisal Shafait,et al.  Real-Time Lane Departure Warning System on a Lower Resource Platform , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[21]  Yi Yang,et al.  Lane Detection and Classification for Forward Collision Warning System Based on Stereo Vision , 2018, IEEE Sensors Journal.

[22]  Li-Chen Fu,et al.  A Portable Vision-Based Real-Time Lane Departure Warning System: Day and Night , 2009, IEEE Transactions on Vehicular Technology.

[23]  Cheng-Jian Lin,et al.  Design of a lane detection and departure warning system using functional-link-based neuro-fuzzy networks , 2010, International Conference on Fuzzy Systems.

[24]  Minho Lee,et al.  Fast learning method for convolutional neural networks using extreme learning machine and its application to lane detection , 2017, Neural Networks.

[25]  Jian Yang,et al.  3-D LiDAR + Monocular Camera: An Inverse-Depth-Induced Fusion Framework for Urban Road Detection , 2018, IEEE Transactions on Intelligent Vehicles.

[26]  Hsu-Yung Cheng,et al.  Ego-Lane Position Identification With Event Warning Applications , 2019, IEEE Access.

[27]  J. Pauli,et al.  A novel multi-lane detection and tracking system , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[28]  Wolfram Burgard,et al.  Efficient and robust deep networks for semantic segmentation , 2018, Int. J. Robotics Res..

[29]  Vijay Gaikwad,et al.  Lane Departure Identification for Advanced Driver Assistance , 2015, IEEE Transactions on Intelligent Transportation Systems.

[30]  Chang-Hong Lin,et al.  Lane-mark extraction for automobiles under complex conditions , 2014, Pattern Recognit..

[31]  Hui Chen,et al.  Robust Lane Detection for Complicated Road Environment Based on Normal Map , 2018, IEEE Access.

[32]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.