Learning to Detect 3D Lanes by Shape Matching and Embedding

3D lane detection based on LiDAR point clouds is a challenging task that requires precise locations, accurate topologies, and distinguishable instances. In this paper, we propose a dual-level shape attention network (DSANet) with two branches for high-precision 3D lane predictions. Specifically, one branch predicts the refined lane segment shapes and the shape embeddings that encode the approximate lane instance shapes, the other branch detects the coarse-grained structures of the lane instances. In the training stage, two-level shape matching loss functions are introduced to jointly optimize the shape parameters of the twobranch outputs, which are simple yet effective for precision enhancement. Furthermore, a shape-guided segments aggregator is proposed to help local lane segments aggregate into complete lane instances, according to the differences of instance shapes predicted at different levels. Experiments conducted on our BEV-3DLanes dataset demonstrate that our method outperforms previous methods.

[1]  Xin Tan,et al.  Rethinking Efficient Lane Detection via Curve Modeling , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Kevin Tirta Wijaya,et al.  K-Lane: Lidar Lane Dataset and Benchmark for Urban Roads and Highways , 2021, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Sangyoun Lee,et al.  Robust Lane Detection via Expanded Self Attention , 2021, 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV).

[4]  Moongu Jeon,et al.  Key Points Estimation and Point Instance Segmentation Approach for Lane Detection , 2020, ArXiv.

[5]  Jie Hu,et al.  Multiple Lane Detection via Combining Complementary Structural Constraints , 2021, IEEE Transactions on Intelligent Transportation Systems.

[6]  Junchi Yan,et al.  Learning High-Precision Bounding Box for Rotated Object Detection via Kullback-Leibler Divergence , 2021, NeurIPS.

[7]  Wei Zhang,et al.  Focus on Local: Detecting Lane Marker from Bottom Up via Key Point , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Siyu Zhu,et al.  CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolution , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[9]  C. Stiller,et al.  YOLinO: Generic Single Shot Polyline Detection in Real Time , 2021, 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW).

[10]  Zejian Yuan,et al.  End-to-end Lane Shape Prediction with Transformers , 2020, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[11]  Thiago Oliveira-Santos,et al.  Keep your Eyes on the Lane: Real-time Attention-guided Lane Detection , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Deng Cai,et al.  RESA: Recurrent Feature-Shift Aggregator for Lane Detection , 2020, AAAI.

[13]  Alberto Ferreira de Souza,et al.  PolyLaneNet: Lane Estimation via Deep Polynomial Regression , 2020, 2020 25th International Conference on Pattern Recognition (ICPR).

[14]  Qing Rao,et al.  Lidar-based Deep Neural Network for Reference Lane Generation , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[15]  Huanyu Wang,et al.  Ultra Fast Structure-aware Deep Lane Detection , 2020, ECCV.

[16]  Jian Yang,et al.  Line-CNN: End-to-End Traffic Line Detection With Line Proposal Unit , 2020, IEEE Transactions on Intelligent Transportation Systems.

[17]  Raquel Urtasun,et al.  DAGMapper: Learning to Map by Discovering Lane Topology , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[18]  Dan Levi,et al.  3D-LaneNet: End-to-End 3D Multiple Lane Detection , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[19]  Min Bai,et al.  Deep Multi-Sensor Lane Detection , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Raquel Urtasun,et al.  Hierarchical Recurrent Attention Networks for Structured Online Maps , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Chanho Lee,et al.  Robust Lane Detection and Tracking for Real-Time Applications , 2018, IEEE Transactions on Intelligent Transportation Systems.

[22]  Luc Van Gool,et al.  Towards End-to-End Lane Detection: an Instance Segmentation Approach , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[23]  Xiaogang Wang,et al.  Spatial As Deep: Spatial CNN for Traffic Scene Understanding , 2017, AAAI.

[24]  Dhiraj Manohar Dhane,et al.  A review of recent advances in lane detection and departure warning system , 2018, Pattern Recognit..

[25]  Lennart Svensson,et al.  Fast LIDAR-based road detection using fully convolutional neural networks , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[26]  Min Bai,et al.  TorontoCity: Seeing the World with a Million Eyes , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Andrew Y. Ng,et al.  End-to-End People Detection in Crowded Scenes , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Van-Dung Hoang,et al.  Lane Surface Identification Based on Reflectance using Laser Range Finder , 2014, 2014 IEEE/SICE International Symposium on System Integration.

[30]  Sheng-Fuu Lin,et al.  Lane detection using color-based segmentation , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..