Keep your Eyes on the Lane: Attention-guided Lane Detection

Modern lane detection methods have achieved remarkable performances in complex real-world scenarios, but many have issues maintaining real-time efficiency, which is important for autonomous vehicles. In this work, we propose LaneATT: an anchor-based deep lane detection model, which, akin to other generic deep object detectors, uses the anchors for the feature pooling step. Since lanes follow a regular pattern and are highly correlated, we hypothesize that in some cases global information may be crucial to infer their positions, especially in conditions such as occlusion, missing lane markers, and others. Thus, we propose a novel anchor-based attention mechanism that aggregates global information. The model was evaluated extensively on two of the most widely used datasets in the literature. The results show that our method outperforms the current state-of-the-art methods showing both a higher efficacy and efficiency. Moreover, we perform an ablation study and discuss efficiency trade-off options that are useful in practice. To reproduce our findings, source code and pretrained models are available at this https URL

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Xiaogang Wang,et al.  Spatial As Deep: Spatial CNN for Traffic Scene Understanding , 2017, AAAI.

[3]  Bingbing Ni,et al.  Geometric Constrained Joint Lane Segmentation and Lane Boundary Detection , 2018, ECCV.

[4]  Seungwoo Yoo,et al.  End-to-End Lane Marker Detection via Row-wise Classification , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  S. Khan,et al.  Real time lane detection for autonomous vehicles , 2008, 2008 International Conference on Computer and Communication Engineering.

[6]  Alberto Ferreira de Souza,et al.  PolyLaneNet: Lane Estimation via Deep Polynomial Regression , 2020, ArXiv.

[7]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[8]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Edilson de Aguiar,et al.  Ego-Lane Analysis System (ELAS): Dataset and algorithms , 2017, Image Vis. Comput..

[10]  Mohsen Ghafoorian,et al.  EL-GAN: Embedding Loss Driven Generative Adversarial Networks for Lane Detection , 2018, ECCV Workshops.

[11]  Wei Zhang,et al.  CurveLane-NAS: Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending , 2020, ECCV.

[12]  Long Chen,et al.  Robust Lane Detection From Continuous Driving Scenes Using Deep Neural Networks , 2019, IEEE Transactions on Vehicular Technology.

[13]  Luc Van Gool,et al.  End-to-end Lane Detection through Differentiable Least-Squares Fitting , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[14]  Jian Yang,et al.  Line-CNN: End-to-End Traffic Line Detection With Line Proposal Unit , 2020, IEEE Transactions on Intelligent Transportation Systems.

[15]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[16]  Qibin Hou,et al.  SpinNet: Spinning convolutional network for lane boundary detection , 2019, Computational Visual Media.

[17]  Huanyu Wang,et al.  Ultra Fast Structure-aware Deep Lane Detection , 2020, ECCV.

[18]  Jonah Philion,et al.  FastDraw: Addressing the Long Tail of Lane Detection by Adapting a Sequential Prediction Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Chen Change Loy,et al.  Learning Lightweight Lane Detection CNNs by Self Attention Distillation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[21]  Chunxiao Liu,et al.  Inter-Region Affinity Distillation for Road Marking Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Zhenpeng Chen,et al.  PointLaneNet: Efficient end-to-end CNNs for Accurate Real-Time Lane Detection , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[23]  Fabio Pizzati,et al.  Lane Detection and Classification using Cascaded CNNs , 2019, EUROCAST.

[24]  Alberto Ferreira de Souza,et al.  Self-Driving Cars: A Survey , 2019, Expert Syst. Appl..

[25]  Yi Yang,et al.  Lane Detection in Low-light Conditions Using an Efficient Data Enhancement: Light Conditions Style Transfer , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[26]  Ali Hassan,et al.  Lane detection using lane boundary marker network with road geometry constraints , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[27]  Eduardo Romera,et al.  ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[28]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).