Road direction detection based on vanishing-point tracking

We present a novel approach for vision-based road direction detection for autonomous Unmanned Ground Vehicles (UGVs). The proposed method utilizes only monocular vision information similar to human perception to detect road directions with respect to the vehicle. The algorithm searches for a global feature of the roads due to perspective projection (so-called vanishing point) to distinguish road directions. The proposed approach consists of two stages. The first stage estimates the vanishing-point locations from single frames. The second stage uses a Rao-Blackwellised particle filter to track initial vanishing-point estimations over a sequence of images in order to provide more robust estimation. Simultaneously, the direction of the road ahead of the vehicle is predicted, which is prerequisite information for vehicle steering and path planning. The proposed approach assumes minimum prior knowledge about the environment and can cope with complex situations such as ground cover variations, different illuminations, and cast shadows. Its performance is evaluated on video sequences taken during test run of the DARPA Grand Challenge.

[1]  Luc Van Gool,et al.  The cascaded Hough transform as an aid in aerial image interpretation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[3]  Thorsten Suttorp,et al.  Robust vanishing point estimation for driver assistance , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[4]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[5]  Grouping dominant orientations for ill-structured road following , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Stephen T. Barnard,et al.  Interpreting Perspective Image , 1983, Artif. Intell..

[7]  Takeo Kanade,et al.  Vision and Navigation for the Carnegie-Mellon Navlab , 1987 .

[8]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[9]  W. Sardha Wijesoma,et al.  Fast Vanishing-Point Detection in Unstructured Environments , 2012, IEEE Transactions on Image Processing.

[10]  Nirwan Ansari,et al.  Steering a robot with vanishing points , 1993, IEEE Trans. Robotics Autom..

[11]  A. Costall,et al.  Gaze Patterns in the Visual Control of Straight-Road Driving and Braking as a Function of Speed and Expertise , 2005 .

[12]  Charles E. Thorpe,et al.  SCARF: a color vision system that tracks roads and intersections , 1993, IEEE Trans. Robotics Autom..

[13]  W. Sardha Wijesoma,et al.  An Efficient Rao-Blackwellized Genetic Algorithmic Filter for SLAM , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[14]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[15]  Charles E. Thorpe,et al.  UNSCARF-a color vision system for the detection of unstructured roads , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[16]  Luis Salgado,et al.  Real-Time Vanishing Point Estimation in Road Sequences Using Adaptive Steerable Filter Banks , 2007, ACIVS.

[17]  Sebastian Thrun,et al.  A Personal Account of the Development of Stanley, the Robot That Won the DARPA Grand Challenge , 2006, AI Mag..

[18]  C. Serafin,et al.  Preliminary examination of driver eye fixations on rural roads: insight into safe driving behavior , 1993 .

[19]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[20]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[21]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Ludek Zalud,et al.  Robust detection of shady and highlighted roads for monocular camera based navigation of UGV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[23]  W. Sardha Wijesoma,et al.  Online, self-supervised vision-based terrain classification in unstructured environments , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[24]  Peter G. Ifju,et al.  Sky/ground modeling for autonomous MAV flight , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  Christopher Rasmussen,et al.  RoadCompass: following rural roads with vision + ladar using vanishing point tracking , 2008, Auton. Robots.