SCINet: Semantic Cue Infusion Network for Lane Detection

Nowadays, lane detection plays an important role in autonomous driving. However, the task of lane detection still faces many challenges, such as external no-visual-clue and internal sparse supervisory signals. In this work, we propose a novel Semantic Cue Infusion Network (SCINet) that uses semantic cues to aid lane detection. Specifically, in order to overcome the external no-visual-clue condition, we introduce a strategy that utilizes semantic cues as additional supervisory signals, which facilitate SCINet to collect region-aware features in the shared layer. We also design a hypernetwork with the additional signals used as a critical part to generate dynamic weights for downstream output heads. Furthermore, we design two Slice Attention Modules (SAMs) based on the interdependencies between slices to improve the robustness of SCINet in distinguishing features between lanes and background. Experiments on two popular lane detection benchmarks (i.e., TuSimple and CULane) show that SCINet significantly outperforms several state-of-the-art methods.

[1]  Moongu Jeon,et al.  Key Points Estimation and Point Instance Segmentation Approach for Lane Detection , 2020, ArXiv.

[2]  Linlin Gao,et al.  Reweighted Dynamic Group Convolution , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Xiaoming Wei,et al.  Structure Guided Lane Detection , 2021, IJCAI.

[4]  Siyu Zhu,et al.  CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolution , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[5]  Mohan M. Trivedi,et al.  LaneAF: Robust Multi-Lane Detection With Affinity Fields , 2021, IEEE Robotics and Automation Letters.

[6]  Tal Hassner,et al.  HyperSeg: Patch-wise Hypernetwork for Real-time Semantic Segmentation , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Thiago Oliveira-Santos,et al.  Keep your Eyes on the Lane: Real-time Attention-guided Lane Detection , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Deng Cai,et al.  RESA: Recurrent Feature-Shift Aggregator for Lane Detection , 2020, AAAI.

[9]  Amara Tariq,et al.  Domain Adaptation For Lane Marking: An Unsupervised Approach , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[10]  Wei Zhang,et al.  CurveLane-NAS: Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending , 2020, ECCV.

[11]  Huanyu Wang,et al.  Ultra Fast Structure-aware Deep Lane Detection , 2020, ECCV.

[12]  Chen Change Loy,et al.  Learning Lightweight Lane Detection CNNs by Self Attention Distillation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[13]  Xinxin Hu,et al.  ACNET: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[14]  Ying Wang,et al.  A lane detection network based on IBN and attention , 2019, Multimedia Tools and Applications.

[15]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Xiaogang Wang,et al.  Spatial As Deep: Spatial CNN for Traffic Scene Understanding , 2017, AAAI.

[17]  Zhe Chen,et al.  RBNet: A Deep Neural Network for Unified Road and Road Boundary Detection , 2017, ICONIP.

[18]  Xiaoming Liu,et al.  Illuminating Pedestrians via Simultaneous Detection and Segmentation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Jungwon Lee,et al.  Fused DNN: A Deep Neural Network Fusion Approach to Fast and Robust Pedestrian Detection , 2016, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[20]  Quoc V. Le,et al.  HyperNetworks , 2016, ICLR.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Tao Chen,et al.  Context-aware lane marking detection on urban roads , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Minho Lee,et al.  Robust Lane Detection Based On Convolutional Neural Network and Random Sample Consensus , 2014, ICONIP.

[25]  Hanqiang Cao,et al.  Nearest Neighbor Value Interpolation , 2012, ArXiv.

[26]  Monson H. Hayes,et al.  Robust lane detection and tracking with ransac and Kalman filter , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).