Fast and Accurate Vanishing Point Detection and Its Application in Inverse Perspective Mapping of Structured Road

Fast and accurate visual scene understanding in autonomous vehicles is necessary but still very challenging. An autonomous vehicle must be taught to read the road like a human driver for better controlling the vehicle, so it is important to efficiently detect the road area and road markings. In this paper, we mainly focus on the vanishing point detection and its application in inverse perspective mapping (IPM) for road marking understanding. We first propose a fast and accurate vanishing point detection method for various types of roads, by adopting and improving Weber local descriptor to obtain salient representative texture and orientation information of the road area, and then voting for the dominant vanishing point with a simple line-voting scheme. Experimental results demonstrate that the proposed vanishing point detection approach gains a better performance than some state-of-the-art methods in terms of accuracy and computation time. Furthermore, we introduce the detected vanishing point into the IPM algorithm in the structured road environment, since some important calibration parameters can be automatically calculated by the vanishing point, especially on the rough road. Experiments also show that our proposed vanishing point-based IPM method is adaptive and accurate, which is conducive to the subsequent road marking detection and recognition.

[1]  Young-Jun Son,et al.  Vision-Based Target Detection and Localization via a Team of Cooperative UAV and UGVs , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[2]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[3]  Dario D. Salvucci,et al.  The time course of a lane change: Driver control and eye-movement behavior , 2002 .

[4]  Peyman Moghadam,et al.  Road direction detection based on vanishing-point tracking , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Majid Mirmehdi,et al.  Real-Time Detection and Recognition of Road Traffic Signs , 2012, IEEE Transactions on Intelligent Transportation Systems.

[6]  Cheng Wang,et al.  Using Mobile LiDAR Data for Rapidly Updating Road Markings , 2015, IEEE Transactions on Intelligent Transportation Systems.

[7]  Jing Huang,et al.  Rotation invariant iris feature extraction using Gaussian Markov random fields with non-separable wavelet , 2010, Neurocomputing.

[8]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Nan Wang,et al.  The detection and recognition of arrow markings recognition based on monocular vision , 2009, 2009 Chinese Control and Decision Conference.

[10]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[11]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[12]  Massimo Bertozzi,et al.  Stereo inverse perspective mapping: theory and applications , 1998, Image Vis. Comput..

[13]  Christopher Rasmussen,et al.  Grouping dominant orientations for ill-structured road following , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[14]  Attention-Based Vanishing Point Detection , 2006, 2006 International Conference on Image Processing.

[15]  Xiaoli Hao,et al.  Traffic Sign Detection via Graph-Based Ranking and Segmentation Algorithms , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[16]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[17]  Luc Van Gool,et al.  The cascaded Hough transform as an aid in aerial image interpretation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[18]  Carsten Rother,et al.  A New Approach for Vanishing Point Detection in Architectural Environments , 2000, BMVC.

[19]  Saeid Nahavandi,et al.  Intelligent Line Segment Perception With Cortex-Like Mechanisms , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[20]  Pierre Charbonnier,et al.  Detection and recognition of urban road markings using images , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[21]  Manoranjan Paul,et al.  Just Noticeable Difference for Images With Decomposition Model for Separating Edge and Textured Regions , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Yuan Yan Tang,et al.  Thinning Character Using Modulus Minima of Wavelet Transform , 2006, Int. J. Pattern Recognit. Artif. Intell..

[23]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[24]  Shang-Jeng Tsai,et al.  HSI color model based lane-marking detection , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[25]  Xinming Huang,et al.  Road marking detection and classification using machine learning algorithms , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[26]  Renato Keshet,et al.  Vanishing points estimation by self-similarity , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Uwe Franke,et al.  Road recognition in urban environment , 2000, Image Vis. Comput..

[28]  Vittoria Bruni,et al.  A generalized model for scratch detection , 2004, IEEE Transactions on Image Processing.

[29]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[30]  Sergiu Nedevschi,et al.  Detection and classification of painted road objects for intersection assistance applications , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[31]  Yuan Yan Tang,et al.  Visual saliency detection with center shift , 2013, Neurocomputing.

[32]  W. Sardha Wijesoma,et al.  Fast Vanishing-Point Detection in Unstructured Environments , 2012, IEEE Transactions on Image Processing.

[33]  Denis Wolf,et al.  Road marking detection using LIDAR reflective intensity data and its application to vehicle localization , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[34]  Georg Maier,et al.  Real-time detection and classification of arrow markings using curve-based prototype fitting , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[35]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[36]  Luis Salgado,et al.  Real-Time Vanishing Point Estimation in Road Sequences Using Adaptive Steerable Filter Banks , 2007, ACIVS.

[37]  Ming-Shi Wang,et al.  Topview Transform Model for the vehicle parking assistance system , 2010, 2010 International Computer Symposium (ICS2010).

[38]  J. Deng,et al.  Fast Lane Detection Based on the B-Spline Fitting , 2013 .

[39]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[40]  Pierre Charbonnier,et al.  Evaluation of Road Marking Feature Extraction , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[41]  Paul Newman,et al.  Reading the Road: Road Marking Classification and Interpretation , 2015, IEEE Transactions on Intelligent Transportation Systems.

[42]  Hui Kong,et al.  Generalizing Laplacian of Gaussian Filters for Vanishing-Point Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[43]  Baojun Zhao,et al.  A new feature descriptor and selection method to space image registration , 2010, 2010 International Conference on Image Analysis and Signal Processing.

[44]  Emilio Frazzoli,et al.  A general framework for road marking detection and analysis , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[45]  Xinge You,et al.  Robust face recognition via occlusion dictionary learning , 2014, Pattern Recognit..

[46]  Jean-Philippe Tardif,et al.  Non-iterative approach for fast and accurate vanishing point detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[47]  Sharath Pankanti,et al.  A layered approach to robust lane detection at night , 2009, 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems.

[48]  Simone Frintrop,et al.  Center-surround divergence of feature statistics for salient object detection , 2011, 2011 International Conference on Computer Vision.

[49]  Yuan Yan Tang,et al.  Fast and accurate vanishing point detection in complex scenes , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[50]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.