Road Lane Detection Robust to Shadows Based on a Fuzzy System Using a Visible Light Camera Sensor

Recently, autonomous vehicles, particularly self-driving cars, have received significant attention owing to rapid advancements in sensor and computation technologies. In addition to traffic sign recognition, road lane detection is one of the most important factors used in lane departure warning systems and autonomous vehicles for maintaining the safety of semi-autonomous and fully autonomous systems. Unlike traffic signs, road lanes are easily damaged by both internal and external factors such as road quality, occlusion (traffic on the road), weather conditions, and illumination (shadows from objects such as cars, trees, and buildings). Obtaining clear road lane markings for recognition processing is a difficult challenge. Therefore, we propose a method to overcome various illumination problems, particularly severe shadows, by using fuzzy system and line segment detector algorithms to obtain better results for detecting road lanes by a visible light camera sensor. Experimental results from three open databases, Caltech dataset, Santiago Lanes dataset (SLD), and Road Marking dataset, showed that our method outperformed conventional lane detection methods.

[1]  Kang-Hyun Jo,et al.  Real-Time Lane Region Detection Using a Combination of Geometrical and Image Features , 2016, Sensors.

[2]  In-Soo Lee,et al.  Real-time lane detection and tracking system using simple filter and Kalman filter , 2017, 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN).

[3]  Yoo-Sung Kim,et al.  Automatic Shadow Removal by Illuminance in HSV Color Space , 2015 .

[4]  Monson H. Hayes,et al.  A Novel Lane Detection System With Efficient Ground Truth Generation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[5]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Kwanghoon Sohn,et al.  Gradient-Enhancing Conversion for Illumination-Robust Lane Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[7]  Gyu-In Jee,et al.  GPS/DR Error Estimation for Autonomous Vehicle Localization , 2015, Sensors.

[8]  Ying Wang,et al.  A lane marking detection and tracking algorithm based on sub-regions , 2014, Proceedings 2014 International Conference on Informative and Cybernetics for Computational Social Systems (ICCSS).

[9]  Na Li,et al.  Lane Detection Based on the Random Sample Consensus , 2011, 2011 International Conference of Information Technology, Computer Engineering and Management Sciences.

[10]  Dajun Ding,et al.  An adaptive road ROI determination algorithm for lane detection , 2013, 2013 IEEE International Conference of IEEE Region 10 (TENCON 2013).

[11]  Kwanghoon Sohn,et al.  Real-time illumination invariant lane detection for lane departure warning system , 2015, Expert Syst. Appl..

[12]  Wen Wang,et al.  A Novel Line Space Voting Method for Vanishing-Point Detection of General Road Images , 2016, Sensors.

[13]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[14]  Sheng-Fuu Lin,et al.  Lane detection using color-based segmentation , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[15]  Li Li,et al.  CannyLines: A parameter-free line segment detector , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[16]  Hua Li,et al.  Inverse perspective mapping based Urban road markings detection , 2012, 2012 IEEE 2nd International Conference on Cloud Computing and Intelligence Systems.

[17]  Bernard De Baets,et al.  Fast and accurate center of gravity defuzzification of fuzzy system outputs defined on trapezoidal fuzzy partitions , 2006, Fuzzy Sets Syst..

[18]  Zhao Li,et al.  Road markings extraction based on threshold segmentation , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[19]  Apurba Das,et al.  A novel algorithm of lane detection addressing varied scenarios of curved and dashed lanemarks , 2015, 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA).

[20]  Jun Miura,et al.  Fuzzy-based illumination normalization for face recognition , 2013, 2013 IEEE Workshop on Advanced Robotics and its Social Impacts.

[21]  B. Bose,et al.  Evaluation of membership functions for fuzzy logic controlled induction motor drive , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[22]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[23]  Tao Wu,et al.  A practical system for road marking detection and recognition , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[24]  Cheng-Jian Lin,et al.  Applying fuzzy method to vision-based lane detection and departure warning system , 2010, Expert Syst. Appl..

[25]  Etienne E. Kerre,et al.  Defuzzification: criteria and classification , 1999, Fuzzy Sets Syst..

[26]  Nanning Zheng,et al.  Efficient Lane Boundary Detection with Spatial-Temporal Knowledge Filtering , 2016, Sensors.

[27]  Byung-Ryong Lee,et al.  New lane detection algorithm for autonomous vehicles using computer vision , 2008, 2008 International Conference on Control, Automation and Systems.

[28]  Cuneyt Akinlar,et al.  Video-Based Lane Detection Using a Fast Vanishing Point Estimation Method , 2012, 2012 IEEE International Symposium on Multimedia.

[29]  Toby P. Breckon,et al.  Automatic real-time road marking recognition using a feature driven approach , 2010, Machine Vision and Applications.

[30]  Vidya N. Murali,et al.  DeepLanes: End-To-End Lane Position Estimation Using Deep Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[31]  Kang Ryoung Park,et al.  Road Lane Detection by Discriminating Dashed and Solid Road Lanes Using a Visible Light Camera Sensor , 2016, Sensors.

[32]  Cláudio Rosito Jung,et al.  A robust linear-parabolic model for lane following , 2004, Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing.

[33]  Chang-Hong Lin,et al.  An Efficient Method for Lane-Mark Extraction in Complex Conditions , 2012, 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing.

[34]  Keshou Wu,et al.  A fast and stable lane detection method based on B-spline curve , 2009, 2009 IEEE 10th International Conference on Computer-Aided Industrial Design & Conceptual Design.

[35]  Rita Cucchiara,et al.  Improving shadow suppression in moving object detection with HSV color information , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[36]  O. Kosheleva,et al.  Why Trapezoidal and Triangular Membership Functions Work So Well: Towards a Theoretical Explanation , 2014 .

[37]  Michel Bilodeau,et al.  Road tracking, lane segmentation and obstacle recognition by mathematical morphology , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[38]  Maria Del Mar Pujol López,et al.  Face Detection Based on Skin Color Segmentation Using Fuzzy Entropy , 2017, Entropy.

[39]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[40]  – Gauss conv wstep,et al.  Feature Detection , 2017, Encyclopedia of GIS.

[41]  J. Deng,et al.  Fast Lane Detection Based on the B-Spline Fitting , 2013 .

[42]  Junqiang Xi,et al.  A novel lane detection based on geometrical model and Gabor filter , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[43]  Jingyu Wang,et al.  Lane detection algorithm using vanishing point , 2013, ICMLC.

[44]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Shang-Jeng Tsai,et al.  HSI color model based lane-marking detection , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[46]  H. D. Cheng,et al.  Threshold selection based on fuzzy c-partition entropy approach , 1998, Pattern Recognit..