Lane Detection and Tracking Using a Parallel-snake Approach

In this paper, we discuss the design of a parallel-snake model for lane detection and the use of a Kalman filter for tracking. The parallel-snake model is an extension of the open active contour model through the application of a parallel constraint to two open snakes. Compared with other models, this model can handle lanes with broken boundaries and reduce the convergence time with the aid of the parallel constraint and a double external energy force from two parallel snakes. To solve the problem in previous snake models, whereby the external force is lost on images with a low gradient, a balloon force is utilized to expand the double snakes from the center of the road to the lane boundaries. Because lane boundaries do not retain the parallel property, the captured images are transformed into a bird’s-eye view to retrieve the parallel property of lane boundaries by planar homography. At least four corresponding points are determined and the EM-based vanishing point estimation algorithm is applied to these points to estimate the planar homography. Finally, we use a Kalman filter for parameter optimization in lane tracking considering the continuity of lane parameters between consecutive frames; i.e., to predict the parameters of subsequent frames from the previous frame and refine the estimated results to improve robustness. Experimental results show that the proposed method achieves good performance on lane datasets with shadows, variations in illumination, and broken boundaries. Furthermore, it can handle both structured and unstructured (country) roads well.

[1]  Cuneyt Akinlar,et al.  Video-Based Lane Detection Using a Fast Vanishing Point Estimation Method , 2012, 2012 IEEE International Symposium on Multimedia.

[2]  Christopher M. Kreucher,et al.  LANA: a lane extraction algorithm that uses frequency domain features , 1999, IEEE Trans. Robotics Autom..

[3]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[4]  Nikolas Petteri Tiilikainen,et al.  A Comparative Study of Active Contour Snakes , 2007 .

[5]  Fuqiang Liu,et al.  Vision Based Lane detection for Active Security in Intelligent Vehicle , 2006, 2006 IEEE International Conference on Vehicular Electronics and Safety.

[6]  Stephen T. Barnard,et al.  Interpreting Perspective Image , 1983, Artif. Intell..

[7]  Gerd Wanielik,et al.  A new approach for lane departure identification , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[8]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[9]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[11]  Luis Salgado,et al.  Robust multiple lane road modeling based on perspective analysis , 2008, 2008 15th IEEE International Conference on Image Processing.

[12]  Michalis E. Zervakis,et al.  A survey of video processing techniques for traffic applications , 2003, Image Vis. Comput..

[13]  Qiang He,et al.  Lane Detection and Tracking through Affine Rectification , 2007, MVA.

[14]  Junqiang Xi,et al.  A novel lane detection based on geometrical model and Gabor filter , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[15]  Dong Joong Kang,et al.  Road lane segmentation using dynamic programming for active safety vehicles , 2003, Pattern Recognit. Lett..

[16]  Akihiro Minagawa,et al.  Vanishing point and vanishing line estimation with line clustering , 2000 .

[17]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[18]  Dinggang Shen,et al.  Lane detection using B-snake , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[19]  Mohan M. Trivedi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 1 Integrated Lane and Vehicle Detection, Localization, , 2022 .

[20]  Luis Salgado,et al.  Road environment modeling using robust perspective analysis and recursive Bayesian segmentation , 2011, Machine Vision and Applications.

[21]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[22]  Hongsheng Li,et al.  Automated actin filament segmentation, tracking and tip elongation measurements based on open active contour models , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[23]  Jana Kosecka,et al.  Efficient computation of vanishing points , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[24]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[25]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[26]  Sukhan Lee,et al.  Robust lane keeping from novel sensor fusion , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).