Dense Hybrid Proposal Modulation for Lane Detection

In this paper, we present a dense hybrid proposal modulation (DHPM) method for lane detection. Most existing methods perform sparse supervision on a subset of high-scoring proposals, while other proposals fail to obtain effective shape and location guidance, resulting in poor overall quality. To address this, we densely modulate all proposals to generate topologically and spatially high-quality lane predictions with discriminative representations. Specifically, we first ensure that lane proposals are physically meaningful by applying single-lane shape and location constraints. Benefitting from the proposed proposal-to-label matching algorithm, we assign each proposal a target ground truth lane to efficiently learn from spatial layout priors. To enhance the generalization and model the inter-proposal relations, we diversify the shape difference of proposals matching the same ground-truth lane. In addition to the shape and location constraints, we design a quality-aware classification loss to adaptively supervise each positive proposal so that the discriminative power can be further boosted. Our DHPM achieves very competitive performances on four popular benchmark datasets. Moreover, we consistently outperform the baseline model on most metrics without introducing new parameters and reducing inference speed.

[1]  Huchuan Lu,et al.  Lane Detection with Versatile AtrousFormer and Local Semantic Guidance , 2022, Pattern Recognit..

[2]  Xi Li,et al.  Ultra Fast Deep Lane Detection With Hybrid Anchor Driven Ordinal Classification , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yanwei Fu,et al.  ONCE-3DLanes: Building Monocular 3D Lane Detection , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Heeyeon Kwon,et al.  Eigenlanes: Data-Driven Lane Descriptors for Structurally Diverse Lanes , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Junchi Yan,et al.  PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark , 2022, ECCV.

[6]  Xiaofei He,et al.  CLRNet: Cross Layer Refinement Network for Lane Detection , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Xin Tan,et al.  Rethinking Efficient Lane Detection via Curve Modeling , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Zhe Ming Chng,et al.  RONELDv2: A faster, improved lane tracking method , 2022, ArXiv.

[9]  Xinggang Wang,et al.  YOLOP: You Only Look Once for Panoptic Driving Perception , 2021, Machine Intelligence Research.

[10]  Sangyoun Lee,et al.  Robust Lane Detection via Expanded Self Attention , 2021, 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV).

[11]  Moongu Jeon,et al.  Key Points Estimation and Point Instance Segmentation Approach for Lane Detection , 2020, ArXiv.

[12]  Yi Fang,et al.  ContinuityLearner: Geometric Continuity Feature Learning for Lane Segmentation , 2021, ArXiv.

[13]  Qi Alfred Chen,et al.  On Robustness of Lane Detection Models to Physical-World Adversarial Attacks in Autonomous Driving , 2021, ArXiv.

[14]  Xiaoming Wei,et al.  Structure Guided Lane Detection , 2021, IJCAI.

[15]  Siyu Zhu,et al.  CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolution , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[16]  Bingbing Ni,et al.  Adaptive Region Proposal With Channel Regularization for Robust Object Tracking , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Mohan M. Trivedi,et al.  LaneAF: Robust Multi-Lane Detection With Affinity Fields , 2021, IEEE Robotics and Automation Letters.

[18]  Zejian Yuan,et al.  End-to-end Lane Shape Prediction with Transformers , 2020, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[19]  Thiago Oliveira-Santos,et al.  Keep your Eyes on the Lane: Real-time Attention-guided Lane Detection , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Deng Cai,et al.  RESA: Recurrent Feature-Shift Aggregator for Lane Detection , 2020, AAAI.

[21]  Chen Cui,et al.  SUPER: A Novel Lane Detection System , 2020, IEEE Transactions on Intelligent Vehicles.

[22]  Alberto Ferreira de Souza,et al.  PolyLaneNet: Lane Estimation via Deep Polynomial Regression , 2020, 2020 25th International Conference on Pattern Recognition (ICPR).

[23]  King Ngi Ngan,et al.  High-Quality R-CNN Object Detection Using Multi-Path Detection Calibration Network , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Liang Zhang,et al.  Relation Graph Network for 3D Object Detection in Point Clouds , 2019, IEEE Transactions on Image Processing.

[25]  Nuno Vasconcelos,et al.  Cascade R-CNN: High Quality Object Detection and Instance Segmentation , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Jaegul Choo,et al.  Towards Lightweight Lane Detection by Optimizing Spatial Embedding , 2020, ArXiv.

[27]  Hao Luo,et al.  Structure-Aware Network for Lane Marker Extraction with Dynamic Vision Sensor , 2020, ArXiv.

[28]  Wei Zhang,et al.  CurveLane-NAS: Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending , 2020, ECCV.

[29]  Jing Zhang,et al.  Small Object Detection in Unmanned Aerial Vehicle Images Using Feature Fusion and Scaling-Based Single Shot Detector With Spatial Context Analysis , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Nicolas Usunier,et al.  End-to-End Object Detection with Transformers , 2020, ECCV.

[31]  Seungwoo Yoo,et al.  End-to-End Lane Marker Detection via Row-wise Classification , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  Huanyu Wang,et al.  Ultra Fast Structure-aware Deep Lane Detection , 2020, ECCV.

[33]  Gong Cheng,et al.  High-Quality Proposals for Weakly Supervised Object Detection , 2020, IEEE Transactions on Image Processing.

[34]  Chunxiao Liu,et al.  Inter-Region Affinity Distillation for Road Marking Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Yong Man Ro,et al.  BBC Net: Bounding-Box Critic Network for Occlusion-Robust Object Detection , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Yi Yang,et al.  Lane Detection in Low-light Conditions Using an Efficient Data Enhancement: Light Conditions Style Transfer , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[37]  Karsten Behrendt,et al.  Unsupervised Labeled Lane Markers Using Maps , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[38]  Runhao Zeng,et al.  Graph Convolutional Networks for Temporal Action Localization , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[39]  Tao Mei,et al.  Relation Distillation Networks for Video Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[40]  Chen Change Loy,et al.  Learning Lightweight Lane Detection CNNs by Self Attention Distillation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[41]  Zhenpeng Chen,et al.  PointLaneNet: Efficient end-to-end CNNs for Accurate Real-Time Lane Detection , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[42]  Jonah Philion,et al.  FastDraw: Addressing the Long Tail of Lane Detection by Adapting a Sequential Prediction Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Fabio Pizzati,et al.  Lane Detection and Classification using Cascaded CNNs , 2019, EUROCAST.

[44]  Chung-Bin Wu,et al.  Ultra-Low Complexity Block-Based Lane Detection and Departure Warning System , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[45]  Luc Van Gool,et al.  End-to-end Lane Detection through Differentiable Least-Squares Fitting , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[46]  Mohsen Ghafoorian,et al.  EL-GAN: Embedding Loss Driven Generative Adversarial Networks for Lane Detection , 2018, ECCV Workshops.

[47]  Luc Van Gool,et al.  Towards End-to-End Lane Detection: an Instance Segmentation Approach , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[48]  Xiaogang Wang,et al.  Spatial As Deep: Spatial CNN for Traffic Scene Understanding , 2017, AAAI.

[49]  Yichen Wei,et al.  Relation Networks for Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[50]  Xiang Zhang,et al.  A Bayesian Approach to Camouflaged Moving Object Detection , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[51]  Luc Van Gool,et al.  Semantic Instance Segmentation with a Discriminative Loss Function , 2017, ArXiv.

[52]  Song Wang,et al.  Visual-Attention-Based Background Modeling for Detecting Infrequently Moving Objects , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[53]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[55]  Nikos Komodakis,et al.  LocNet: Improving Localization Accuracy for Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).