A Multilane Tracking Algorithm Using IPDA with Intensity Feature

Detection of multiple lane markings on road surfaces is an important aspect of autonomous vehicles. Although a number of approaches have been proposed to detect lanes, detecting multiple lane markings, particularly across a large number of frames and under varying lighting conditions, in a consistent manner is still a challenging problem. In this paper, we propose a novel approach for detecting multiple lanes across a large number of frames and under various lighting conditions. Instead of resorting to the conventional approach of processing each frame to detect lanes, we treat the overall problem as a multitarget tracking problem across space and time using the integrated probabilistic data association filter (IPDAF) as our basis filter. We use the intensity of the pixels as an augmented feature to correctly group multiple lane markings using the Hough transform. By representing these extracted lane markings as splines, we then identify a set of control points, which becomes a set of targets to be tracked over a period of time, and thus across a large number of frames. We evaluate our approach on two different fronts, covering both model- and machine-learning-based approaches, using two different datasets, namely the Caltech and TuSimple lane detection datasets, respectively. When tested against model-based approach, the proposed approach can offer as much as 5%, 12%, and 3% improvements on the true positive, false positive, and false positives per frame rates compared to the best alternative approach, respectively. When compared against a state-of-the-art machine learning technique, particularly against a supervised learning method, the proposed approach offers 57%, 31%, 4%, and 9× improvements on the false positive, false negative, accuracy, and frame rates. Furthemore, the proposed approach retains the explainability, or in other words, the cause of actions of the proposed approach can easily be understood or explained.

[1]  Yu Zhang,et al.  Lane Detection Base on Deep Learning , 2018, 2018 11th International Symposium on Computational Intelligence and Design (ISCID).

[2]  Jürgen Adamy,et al.  Task-Based Environment Interpretation and System Architecture for Next Generation ADAS , 2011, IEEE Intelligent Transportation Systems Magazine.

[3]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[4]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Seung-Woo Seo,et al.  Multi-lane detection in urban driving environments using conditional random fields , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[6]  Lars Petersson,et al.  Vision in and out of Vehicles , 2003, IEEE Intell. Syst..

[7]  Sergio Okida,et al.  A Novel Strategy for Road Lane Detection and Tracking Based on a Vehicle’s Forward Monocular Camera , 2019, IEEE Transactions on Intelligent Transportation Systems.

[8]  Weiqiang Ren,et al.  LaneNet: Real-Time Lane Detection Networks for Autonomous Driving , 2018, ArXiv.

[9]  Mahendra Mallick,et al.  Comparison of Single-point and Two-point Difference Track Initiation Algorithms Using Position Measurements , 2008 .

[10]  Zhuoyuan Yang,et al.  Research on Lane Recognition Algorithm Based on Deep Learning , 2019, 2019 International Conference on Artificial Intelligence and Advanced Manufacturing (AIAM).

[11]  Sudhakar M. Reddy,et al.  Deterministic Stellar BIST for Automotive ICs , 2020, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[12]  Jianqiang Wang,et al.  Coordinated Adaptive Cruise Control System With Lane-Change Assistance , 2015, IEEE Transactions on Intelligent Transportation Systems.

[13]  Sahin Albayrak,et al.  Vehicles of the Future: A Survey of Research on Safety Issues , 2017, IEEE Transactions on Intelligent Transportation Systems.

[14]  Li-Chen Fu,et al.  Integrating Appearance and Edge Features for Sedan Vehicle Detection in the Blind-Spot Area , 2012, IEEE Transactions on Intelligent Transportation Systems.

[15]  Anton Kummert,et al.  A warning algorithm for Lane Departure Warning system , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[16]  C. Laurgeau,et al.  Vehicle yaw, pitch, roll and 3D lane shape recovery by vision , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[17]  Zhu Xiao,et al.  Vision-Based Lane Detection and Lane-Marking Model Inference: A Three-Step Deep Learning Approach , 2018, 2018 9th International Symposium on Parallel Architectures, Algorithms and Programming (PAAP).

[18]  Qingquan Li,et al.  A Sensor-Fusion Drivable-Region and Lane-Detection System for Autonomous Vehicle Navigation in Challenging Road Scenarios , 2014, IEEE Transactions on Vehicular Technology.

[19]  Xiuwen Liu,et al.  A patch-based convolutional neural network for remote sensing image classification , 2017, Neural Networks.

[20]  Rama Chellappa,et al.  A Learning Approach Towards Detection and Tracking of Lane Markings , 2012, IEEE Transactions on Intelligent Transportation Systems.

[21]  Yi Yang,et al.  Lane Detection and Classification for Forward Collision Warning System Based on Stereo Vision , 2018, IEEE Sensors Journal.

[22]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[23]  Guannan Gao,et al.  Probabilistic Hough Transform , 2011 .

[24]  Mikhail Gordon,et al.  Lane Change and Merge Maneuvers for Connected and Automated Vehicles: A Survey , 2016, IEEE Transactions on Intelligent Vehicles.

[25]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[26]  Robin J. Evans,et al.  Integrated probabilistic data association , 1994, IEEE Trans. Autom. Control..

[27]  Marc Reichenbach,et al.  Comparison of Lane Detection Algorithms for ADAS Using Embedded Hardware Architectures , 2018, 2018 Conference on Design and Architectures for Signal and Image Processing (DASIP).

[28]  Vijay Gaikwad,et al.  Lane Departure Identification for Advanced Driver Assistance , 2015, IEEE Transactions on Intelligent Transportation Systems.

[29]  Monson H. Hayes,et al.  A Novel Lane Detection System With Efficient Ground Truth Generation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[30]  Joachim Denzler,et al.  Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding , 2015, VISAPP.

[31]  Ming Yue,et al.  Robust Tube-Based Model Predictive Control for Lane Change Maneuver of Tractor-Trailer Vehicles Based on a Polynomial Trajectory , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  Y. Bar-Shalom,et al.  The probabilistic data association filter , 2009, IEEE Control Systems.

[33]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[34]  Dong Hwan Kim,et al.  A Robust Lane Detection Method Based on Vanishing Point Estimation Using the Relevance of Line Segments , 2017, IEEE Transactions on Intelligent Transportation Systems.

[35]  Hakil Kim,et al.  Real-time lane detection and departure warning system on embedded platform , 2016, 2016 IEEE 6th International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[36]  Hui Chen,et al.  Robust Lane Detection for Complicated Road Environment Based on Normal Map , 2018, IEEE Access.

[37]  Peng Chang,et al.  Collision sensing by stereo vision and radar sensor fusion , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[38]  Taek Lyul Song,et al.  Multi-path Data Association for Over-the-Horizon Radar Using Linear Multitarget Integrated Probabilistic Data Association , 2018, 2018 International Conference on Control, Automation and Information Sciences (ICCAIS).

[39]  Hauke Stahle,et al.  A lane marking extraction approach based on Random Finite Set Statistics , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[40]  Yuan Yan Tang,et al.  Fast and Accurate Vanishing Point Detection and Its Application in Inverse Perspective Mapping of Structured Road , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[41]  Jiri Matas,et al.  Progressive probabilistic Hough transform for line detection , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[42]  Jianwei Niu,et al.  Robust Lane Detection using Two-stage Feature Extraction with Curve Fitting , 2016, Pattern Recognit..

[43]  Nam Ik Cho,et al.  Fast lane detection & tracking based on Hough transform with reduced memory requirement , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[44]  Yaakov Bar-Shalom,et al.  Automated Tracking with Target Amplitude Information , 1990, 1990 American Control Conference.

[45]  José Manuel Menéndez,et al.  ITS-based cooperative services development framework for improving safety of vulnerable road users , 2013 .

[46]  Chanho Lee,et al.  Robust Lane Detection and Tracking for Real-Time Applications , 2018, IEEE Transactions on Intelligent Transportation Systems.

[47]  Sergiu Nedevschi,et al.  Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[48]  Xiaogang Wang,et al.  Spatial As Deep: Spatial CNN for Traffic Scene Understanding , 2017, AAAI.

[49]  Hongyu Su Vanishing Points in Road Recognition: A Review , 2018, 2018 11th International Symposium on Computational Intelligence and Design (ISCID).

[50]  Weiwen Deng,et al.  Personalized Lane-Change Assistance System With Driver Behavior Identification , 2018, IEEE Transactions on Vehicular Technology.

[51]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[52]  F. Jaureguizar,et al.  Stabilization of Inverse Perspective Mapping Images based on Robust Vanishing Point Estimation , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[53]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..