A review of recent advances in lane detection and departure warning system

Abstract Statistics show that worldwide motor vehicle collisions lead to significant deaths and disabilities as well as substantial financial costs to both society and the individuals involved. Unintended lane departure is a leading cause of road fatalities by the collision. To reduce the number of traffic accidents and to improve driver’s safety lane departure warning (LDW), the system has emerged as a promising tool. Vision-based lane detection and departure warning system has been investigated over two decades. During this period, many different problems related to lane detection and departure warning have been addressed. This paper provides an overview of current LDW system, describing in particular pre-processing, lane models, lane de Ntection techniques and departure warning system.

[1]  Gudrun Klinker,et al.  Stable Road Lane Model Based on Clothoids , 2010 .

[2]  W. Sardha Wijesoma,et al.  Fast Vanishing-Point Detection in Unstructured Environments , 2012, IEEE Transactions on Image Processing.

[3]  Azzedine Boukerche,et al.  A real-time lane marking localization, tracking and communication system , 2016, Comput. Commun..

[4]  Henry Leung,et al.  Overview of Environment Perception for Intelligent Vehicles , 2017, IEEE Transactions on Intelligent Transportation Systems.

[5]  Cheng-Jian Lin,et al.  Design of a lane detection and departure warning system using functional-link-based neuro-fuzzy networks , 2010, International Conference on Fuzzy Systems.

[6]  Fawzi Nashashibi,et al.  Robust real-time lane detection based on lane mark segment features and general a priori knowledge , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[7]  S. Nedevschi,et al.  3D lane detection system based on stereovision , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[8]  Alexandre Bernardino,et al.  Detection and classification of highway lanes using vehicle motion trajectories , 2006, IEEE Transactions on Intelligent Transportation Systems.

[9]  Yoshiki Kobayashi,et al.  Multitype lane markers recognition using local edge direction , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[10]  Bing-Fei Wu,et al.  A DSP-based lane departure warning system , 2006 .

[11]  Wang Xingang,et al.  Real-time lane-vehicle detection and tracking system , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[12]  Xiaodong Wang,et al.  Camera Calibration Based on Perspective Geometry and Its Application in LDWS , 2012 .

[13]  Petr Hurtík,et al.  Lane departure warning for mobile devices based on a fuzzy representation of images , 2016, Fuzzy Sets Syst..

[14]  Chunyang Mu,et al.  Lane Detection Based on Object Segmentation and Piecewise Fitting , 2014 .

[15]  Huaizhong Chen,et al.  Research on Real-Time Lane Line Detection Techonogy Based on Machine Vision , 2010, 2010 International Symposium on Intelligence Information Processing and Trusted Computing.

[16]  Mohammed M. Farag,et al.  Lane departure warning tracking system based on score mechanism , 2016, 2016 IEEE 59th International Midwest Symposium on Circuits and Systems (MWSCAS).

[17]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[18]  Li-Chen Fu,et al.  On-board vision system for lane recognition and front-vehicle detection to enhance driver's awareness , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[19]  C. Kreucher,et al.  A DRIVER WARNING SYSTEM BASED ON THE LOIS LANE DETECTION ALGORITHM , 1998 .

[20]  Cheng-Jian Lin,et al.  Applying fuzzy method to vision-based lane detection and departure warning system , 2010, Expert Syst. Appl..

[21]  J Navarro,et al.  Influence of lane departure warnings onset and reliability on car drivers' behaviors. , 2017, Applied ergonomics.

[22]  Monson H. Hayes,et al.  Robust lane detection and tracking with ransac and Kalman filter , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[23]  Yi-Han Chen,et al.  Mobile lane departure warning systems , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[24]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[25]  Gerd Wanielik,et al.  A new approach for lane departure identification , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[26]  Dominique Gruyer,et al.  A new multi-agent approach for lane detection and tracking , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[27]  A Casavola,et al.  Data fusion algorithms for lane departure warning systems , 2010, Proceedings of the 2010 American Control Conference.

[28]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[29]  Sharath Pankanti,et al.  A layered approach to robust lane detection at night , 2009, 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems.

[30]  Mohan M. Trivedi,et al.  Efficient Lane and Vehicle Detection with Integrated Synergies (ELVIS) , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[31]  S. P. Narote,et al.  Lane departure warning system based on Hough transform and Euclidean distance , 2015, 2015 Third International Conference on Image Information Processing (ICIIP).

[32]  Dong Hwan Kim,et al.  A Robust Lane Detection Method Based on Vanishing Point Estimation Using the Relevance of Line Segments , 2017, IEEE Transactions on Intelligent Transportation Systems.

[33]  Majid Sarrafzadeh,et al.  SmartLDWS: A robust and scalable lane departure warning system for the smartphones , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[34]  Cláudio Rosito Jung,et al.  An Improved Linear-Parabolic Model for Lane Following and Curve Detection , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).

[35]  Mehmet Celenk,et al.  Robust Lane Detection in Shadows and Low Illumination Conditions using Local Gradient Features , 2013 .

[36]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[37]  Li-Chen Fu,et al.  A Portable Vision-Based Real-Time Lane Departure Warning System: Day and Night , 2009, IEEE Transactions on Vehicular Technology.

[38]  Lie Guo,et al.  Trajectory planning and tracking control for autonomous lane change maneuver based on the cooperative vehicle infrastructure system , 2015, Expert Syst. Appl..

[39]  Dinggang Shen,et al.  Lane detection using spline model , 2000, Pattern Recognit. Lett..

[40]  Mohan M. Trivedi,et al.  Selective salient feature based lane analysis , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[41]  Saïd Mammar,et al.  Integrated Driver–Vehicle–Infrastructure Road Departure Warning Unit , 2010, IEEE Transactions on Vehicular Technology.

[42]  Chenglin Wen,et al.  Robust lane detection based on gradient-pairs constraint , 2011, Proceedings of the 30th Chinese Control Conference.

[43]  Kwanghoon Sohn,et al.  Real-time illumination invariant lane detection for lane departure warning system , 2015, Expert Syst. Appl..

[44]  Hendrik Van Brussel,et al.  Kalman Filter Approach for Lane Extraction and Following , 2002, J. Intell. Robotic Syst..

[45]  C. D'Cruz,et al.  Lane detection for driver assistance and intelligent vehicle applications , 2007, 2007 International Symposium on Communications and Information Technologies.

[46]  Toshihiro Wakita,et al.  On the Use of Stochastic Driver Behavior Model in Lane Departure Warning , 2011, IEEE Transactions on Intelligent Transportation Systems.

[47]  Mei Chen,et al.  AURORA: a vision-based roadway departure warning system , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[48]  Cláudio Rosito Jung,et al.  Lane following and lane departure using a linear-parabolic model , 2005, Image Vis. Comput..

[49]  Christopher Bayer,et al.  Multi-lane perception using feature fusion based on GraphSLAM , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[50]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[51]  Ramji Makwana,et al.  Survey : Vision based Road Detection Techniques , 2014 .

[52]  Zora Konjovic,et al.  Linear fuzzy space based road lane model and detection , 2013, Knowl. Based Syst..

[53]  Xiangjing An,et al.  Real-time lane departure warning system based on a single FPGA , 2013, EURASIP J. Image Video Process..

[54]  Huifang Li,et al.  Study on a robust approach of lane departure warning algrithm , 2010, 2010 2nd International Conference on Signal Processing Systems.

[55]  Changzheng Hou,et al.  An efficient lane markings detection and tracking method based on vanishing point constraints , 2016, CCC 2016.

[56]  Bok-Suk Shin,et al.  A superparticle filter for lane detection , 2015, Pattern Recognit..

[57]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[58]  B. V. Wyk,et al.  Vehicle Position Monitoring Using Hough Transform , 2013 .

[59]  Jianwei Niu,et al.  Robust Lane Detection using Two-stage Feature Extraction with Curve Fitting , 2016, Pattern Recognit..

[60]  Youngjoon Han,et al.  Real-time Lane Detection Based on Extended Edge-linking Algorithm , 2010 .

[61]  Minglu Li,et al.  L3: Sensing driving conditions for vehicle lane-level localization on highways , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[62]  Sanghoon Sull,et al.  Efficient Lane Detection Based on Spatiotemporal Images , 2016, IEEE Transactions on Intelligent Transportation Systems.

[63]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[64]  Hakil Kim,et al.  Real-time lane detection and departure warning system on embedded platform , 2016, 2016 IEEE 6th International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[65]  M. Zaw,et al.  Video Based Lane Departure Warning System using Hough Transform , 2014 .

[66]  E. Salari,et al.  Camera-based Forward Collision and lane departure warning systems using SVM , 2013, 2013 IEEE 56th International Midwest Symposium on Circuits and Systems (MWSCAS).

[67]  Dariu Gavrila,et al.  The Issues , 2011 .

[68]  Vijay Gaikwad,et al.  Lane Departure Identification for Advanced Driver Assistance , 2015, IEEE Transactions on Intelligent Transportation Systems.

[69]  Joon Woong Lee,et al.  A lane-departure identification based on LBPE, Hough transform, and linear regression , 2005, Comput. Vis. Image Underst..

[70]  Hong-Hyun Kim,et al.  Annealed Particle Filter Algorithm Used for Lane Detection and Tracking , 2013 .

[71]  M.M. Trivedi,et al.  Performance evaluation of a vision based lane tracker designed for driver assistance systems , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[72]  Cheng-Jian Lin,et al.  Applying a Functional Neurofuzzy Network to Real-Time Lane Detection and Front-Vehicle Distance Measurement , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[73]  Dario D. Salvucci.  Inferring Driver Intent: A Case Study in Lane-Change Detection , 2004 .

[74]  Chang-Hong Lin,et al.  Lane-mark extraction for automobiles under complex conditions , 2014, Pattern Recognit..

[75]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[76]  J. Pauli,et al.  A novel multi-lane detection and tracking system , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[77]  Gruyer Dominique,et al.  A lane marker estimation method for improving lane detection , 2016 .

[78]  Naim Dahnoun,et al.  A novel system for robust lane detection and tracking , 2012, Signal Process..

[79]  S. K. Gehrig,et al.  Lane recognition on poorly structured roads-the bots dot problem in California , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[80]  Praveen Edara,et al.  Situation assessment and decision making for lane change assistance using ensemble learning methods , 2015, Expert Syst. Appl..

[81]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[82]  Sheng-Fuu Lin,et al.  Lane detection using color-based segmentation , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[83]  Rohit Sharma,et al.  An experimental study of a lane departure warning system based on the optical flow and Hough transform methods , 2014 .

[84]  Ching-Haur Chang,et al.  A lane detection approach based on intelligent vision , 2015, Comput. Electr. Eng..

[85]  Frank Lindner,et al.  Autonomous Driving approaches Downtown , 1999 .

[86]  Joon Woong Lee,et al.  A Machine Vision System for Lane-Departure Detection , 2002, Comput. Vis. Image Underst..

[87]  Cihat Bora Yigit,et al.  A MonoSLAM approach to lane departure warning system , 2014, 2014 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.