Time to Lane Crossing Estimation Using Deep Learning-Based Instance Segmentation Scheme

The main goal of this paper is to develop a deep-learning-based instance segmentation of lane detection for time to lane crossing (TLC) estimation. As is well known, the TLC strategy can build lane departure warning systems (LDWs) with enhanced predictive capabilities which play the role of security early warning in order to prevent dangerous driving situations. LDWs quite relies on the accurate detection of the road markings. Instance segmentation is a task to detect specific objects in an image and create a mask around the object. We use an evolved fully convolutional networks (FCNs) based instance segmentation to yield the high-quality segmentation maps with finer details. It is an effective approach to providing us the high accurate lane detection for LDWs. Time to lane crossing (TLC) is a kind of lane departure indicator in LDWs. For TLC computation, both straight and curved vehicle paths are considered. Thus, the road curvature is an important variable in computations. In this paper, a lane mark fitting algorithm based on inverse perspective mapping (IPM) and sliding window technologies are proposed to compute the road curvature. TLC is duration available for the driver before any lane boundary crossing. The experimental results demonstrate that the proposed deep learning-based instance segmentation can significantly detect the lane. The experiment results illustrate that the proposed TLC estimation strategy can significantly enhance the lane marks recognition accuracy and then provide drivers with timely warnings to avoid unintentional lane departure.

[1]  Roberto Cipolla,et al.  Semantic object classes in video: A high-definition ground truth database , 2009, Pattern Recognit. Lett..

[2]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[3]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Wolfram Burgard,et al.  Efficient deep models for monocular road segmentation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Monson H. Hayes,et al.  Polar randomized hough transform for lane detection using loose constraints of parallel lines , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Saïd Mammar,et al.  Time to line crossing for lane departure avoidance: a theoretical study and an experimental setting , 2006, IEEE Transactions on Intelligent Transportation Systems.

[12]  S. Glaser,et al.  Experimental time to line crossing validation , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[13]  A. Galip Ulsoy,et al.  Time to Lane Crossing calculation and Characterization of its associated Uncertainty , 1996, J. Intell. Transp. Syst..

[14]  Hsueh-Ming Hang,et al.  Efficient Road Lane Marking Detection with Deep Learning , 2018, 2018 IEEE 23rd International Conference on Digital Signal Processing (DSP).

[15]  Yu-Chen Lin,et al.  Lane Mark and Drivable Area Detection Using a Novel Instance Segmentation Scheme , 2019, 2019 IEEE/SICE International Symposium on System Integration (SII).