Deep Learning in Lane Marking Detection: A Survey

Lane marking detection is a fundamental but crucial step in intelligent driving systems. It can not only provide relevant road condition information to prevent lane departure but also assist vehicle positioning and forehead car detection. However, lane marking detection faces many challenges, including extreme lighting, missing lane markings, and obstacle obstructions. Recently, deep learning-based algorithms draw much attention in intelligent driving society because of their excellent performance. In this paper, we review deep learning methods for lane marking detection, focusing on their network structures and optimization objectives, the two key determinants of their success. Besides, we summarize existing lane-related datasets, evaluation criteria, and common data processing techniques. We also compare the detection performance and running time of various methods, and conclude with some current challenges and future trends for deep learning-based lane marking detection algorithm.

[1]  Hao Luo,et al.  Structure-Aware Network for Lane Marker Extraction with Dynamic Vision Sensor , 2020, ArXiv.

[2]  Xingzheng Wang,et al.  A Lane Detection Method Based on a Ridge Detector and Regional G-RANSAC , 2019, Sensors.

[3]  Yi Yang,et al.  Lane Detection and Classification for Forward Collision Warning System Based on Stereo Vision , 2018, IEEE Sensors Journal.

[4]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[5]  Javier Del Ser,et al.  Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions , 2020, IEEE Transactions on Intelligent Transportation Systems.

[6]  Irfan Mehmood,et al.  Edge Intelligence-Assisted Smoke Detection in Foggy Surveillance Environments , 2020, IEEE Transactions on Industrial Informatics.

[7]  Eduardo Romera,et al.  ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[8]  Ivan Kobyzev,et al.  Normalizing Flows: An Introduction and Review of Current Methods , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[10]  Degui Xiao,et al.  Attention deep neural network for lane marking detection , 2020, Knowl. Based Syst..

[11]  Marc Peter Deisenroth,et al.  Deep Reinforcement Learning: A Brief Survey , 2017, IEEE Signal Processing Magazine.

[12]  Li Li,et al.  Generative Adversarial Networks for Parallel Transportation Systems , 2018, IEEE Intelligent Transportation Systems Magazine.

[13]  Roberto Cipolla,et al.  Semantic object classes in video: A high-definition ground truth database , 2009, Pattern Recognit. Lett..

[14]  MengChu Zhou,et al.  Self-Paced Dynamic Infinite Mixture Model for Fatigue Evaluation of Pilots’ Brains , 2020, IEEE Transactions on Cybernetics.

[15]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[16]  Long Chen,et al.  Advances in Vision-Based Lane Detection: Algorithms, Integration, Assessment, and Perspectives on ACP-Based Parallel Vision , 2018, IEEE/CAA Journal of Automatica Sinica.

[17]  Dongpu Cao,et al.  Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach , 2019, IEEE Transactions on Vehicular Technology.

[18]  Feng Xiao,et al.  Lane Detection Algorithm for Intelligent Vehicles in Complex Road Conditions and Dynamic Environments , 2019, Sensors.

[19]  Qibin Hou,et al.  SpinNet: Spinning convolutional network for lane boundary detection , 2019, Computational Visual Media.

[20]  Dongpu Cao,et al.  Parallel driving in CPSS: a unified approach for transport automation and vehicle intelligence , 2017, IEEE/CAA Journal of Automatica Sinica.

[21]  Wen-Ming Zhang,et al.  Nonparametric Bayesian Prior Inducing Deep Network for Automatic Detection of Cognitive Status , 2020, IEEE Transactions on Cybernetics.

[22]  Zhu Xiao,et al.  Vision-Based Lane Detection and Lane-Marking Model Inference: A Three-Step Deep Learning Approach , 2018, 2018 9th International Symposium on Parallel Architectures, Algorithms and Programming (PAAP).

[23]  MengChu Zhou,et al.  TL-GDBN: Growing Deep Belief Network With Transfer Learning , 2019, IEEE Transactions on Automation Science and Engineering.

[24]  Feng Gao,et al.  A Fast and Robust Lane Detection Method Based on Semantic Segmentation and Optical Flow Estimation , 2021, Sensors.

[25]  Zhengcai Cao,et al.  Rapid Detection of Blind Roads and Crosswalks by Using a Lightweight Semantic Segmentation Network , 2021, IEEE Transactions on Intelligent Transportation Systems.

[26]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[27]  Eros Comunello,et al.  Passive Vision Region-Based Road Detection , 2019, ACM Comput. Surv..

[28]  Dongpu Cao,et al.  Dynamic integration and online evaluation of vision‐based lane detection algorithms , 2018, IET Intelligent Transport Systems.

[29]  Naim Dahnoun,et al.  Real-time stereo vision-based lane detection system , 2018, ArXiv.

[30]  Khan Muhammad,et al.  DeepReS: A Deep Learning-Based Video Summarization Strategy for Resource-Constrained Industrial Surveillance Scenarios , 2020, IEEE Transactions on Industrial Informatics.

[31]  Emanuele Frontoni,et al.  Mechatronic System to Help Visually Impaired Users During Walking and Running , 2018, IEEE Transactions on Intelligent Transportation Systems.

[32]  Sibel Yenikaya,et al.  Keeping the vehicle on the road: A survey on on-road lane detection systems , 2013, CSUR.

[33]  Karsten Behrendt,et al.  Unsupervised Labeled Lane Markers Using Maps , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[34]  Fang Zheng,et al.  Improved Lane Line Detection Algorithm Based on Hough Transform , 2018, Pattern Recognition and Image Analysis.

[35]  Xiao Wang,et al.  Detecting Traffic Information From Social Media Texts With Deep Learning Approaches , 2018, IEEE Transactions on Intelligent Transportation Systems.

[36]  Xun Wang,et al.  Lane marking detection via deep convolutional neural network , 2017, Neurocomputing.

[37]  Long Chen,et al.  Robust Lane Detection From Continuous Driving Scenes Using Deep Neural Networks , 2019, IEEE Transactions on Vehicular Technology.

[38]  Li-Min Zhu,et al.  Rotated Sphere Haar Wavelet and Deep Contractive Auto-Encoder Network With Fuzzy Gaussian SVM for Pilot’s Pupil Center Detection , 2019, IEEE Transactions on Cybernetics.

[39]  Li-Hong Juang,et al.  Robust visual line-following navigation system for humanoid robots , 2018, Artificial Intelligence Review.