Semi-Supervised Lane Detection With Deep Hough Transform

Current work on lane detection relies on large manually annotated datasets. We reduce the dependency on annotations by leveraging massive cheaply available unlabelled data. We propose a novel loss function exploiting geometric knowledge of lanes in Hough space, where a lane can be identified as a local maximum. By splitting lanes into separate channels, we can localize each lane via simple global max-pooling. The location of the maximum encodes the layout of a lane, while the intensity indicates the the probability of a lane being present. Maximizing the log-probability of the maximal bins helps neural networks find lanes without labels. On the CULane and TuSimple datasets, we show that the proposed Hough Transform loss improves performance significantly by learning from large amounts of unlabelled images.

[1]  Dacheng Tao,et al.  Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Chunxiao Liu,et al.  Inter-Region Affinity Distillation for Road Marking Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[4]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[5]  Chen Change Loy,et al.  Learning Lightweight Lane Detection CNNs by Self Attention Distillation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[6]  Xiaogang Wang,et al.  Spatial As Deep: Spatial CNN for Traffic Scene Understanding , 2017, AAAI.

[7]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[8]  Klaus C. J. Dietmayer,et al.  A random finite set approach to multiple lane detection , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[9]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[10]  Wolfgang Birk,et al.  A driver-distraction-based lane-keeping assistance system , 2007 .

[11]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[12]  Jan C. van Gemert,et al.  Active Decision Boundary Annotation with Deep Generative Models , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Jie Ma,et al.  Road Lane Detection Using H-Maxima and Improved Hough Transform , 2012, 2012 Fourth International Conference on Computational Intelligence, Modelling and Simulation.

[14]  Tao Wu,et al.  A practical system for road marking detection and recognition , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[15]  Huanyu Wang,et al.  Ultra Fast Structure-aware Deep Lane Detection , 2020, ECCV.

[16]  Deok-Jin Lee,et al.  A Precise Lane Detection Algorithm Based on Top View Image Transformation and Least-Square Approaches , 2016, J. Sensors.

[17]  Luc Van Gool,et al.  Towards End-to-End Lane Detection: an Instance Segmentation Approach , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[18]  In So Kweon,et al.  VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Shih-Fu Chang,et al.  Graph construction and b-matching for semi-supervised learning , 2009, ICML '09.

[20]  Eduardo Romera,et al.  ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[21]  John D. Lafferty,et al.  Semi-supervised learning using randomized mincuts , 2004, ICML.

[22]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[23]  Dinggang Shen,et al.  Lane detection using spline model , 2000, Pattern Recognit. Lett..

[24]  Anil K. Jain,et al.  Lane boundary detection using a multiresolution Hough transform , 1997, Proceedings of International Conference on Image Processing.

[25]  Kwanghoon Sohn,et al.  Gradient-Enhancing Conversion for Illumination-Robust Lane Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[26]  Silvia L. Pintea,et al.  Deep Hough-Transform Line Priors , 2020, ECCV.

[27]  Yang Yan,et al.  Accurate and robust lane detection based on Dual-View Convolutional Neutral Network , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[28]  Peng Liu,et al.  A review of lane detection methods based on deep learning , 2021, Pattern Recognit..

[29]  Thomas Brox,et al.  Semi-Supervised Semantic Segmentation With High- and Low-Level Consistency , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Bingbing Ni,et al.  Geometric Constrained Joint Lane Segmentation and Lane Boundary Detection , 2018, ECCV.