Parametric Model of the Perspective Projection of a Road with Applications to Lane Keeping and 3D Road Reconstruction

This paper describes an algorithm for the computation of the 3D structure of a road and of the motion state of an in-vehicle CCD camera from the lane borders on the image plane. A parametric model of the projective projection of the lane borders on the image plane is introduced and a fast and reliable algorithm to compute its parameters is described. The physical significance of the model is demonstrated by showing that the model parameters completely determine the position of the vehicle inside the lane, its heading direction, and the local structure of the road. The conditions of applicability of the model are also given and the results of its application to a sequence of images taken during a test run discussed. The algorithm is suited to real time applications and indeed an implementation on the dedicated hardware of the mobile laboratory MOBLAB runs at a frame rate of 12 images per second.

[1]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Matthew Turk,et al.  VITS-A Vision System for Autonomous Land Vehicle Navigation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Daniel DeMenthon,et al.  Range-video fusion and comparison of inverse perspective algorithms in static images , 1990, IEEE Trans. Syst. Man Cybern..

[4]  Larry S. Davis,et al.  Reconstruction of a road by local image matches and global 3D optimization , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[5]  Karl C. Kluge,et al.  Extracting road curvature and orientation from image edge points without perceptual grouping into features , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[6]  Aldo Cumani,et al.  MOBLAB: a mobile laboratory for testing real-time vision-based systems in path monitoring , 1995, Other Conferences.

[7]  Daniel DeMenthon,et al.  A zero-bank algorithm for inverse perspective of a road from a single image , 1986, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[8]  Kenichi Kanatani,et al.  Geometric computation for machine vision , 1993 .

[9]  Edge C. Yeh,et al.  Image-based dynamic measurement for vehicle steering control , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[10]  H. Inoue,et al.  Automated Vehicle System Using Both A Computer Vision And Magnetic Field Sensors , 1993, Proceedings of the Intelligent Vehicles '93 Symposium.

[11]  Antonio Guiducci,et al.  Attitude of a vehicle moving on a structured road , 1997 .

[12]  Wen-Liang Chen,et al.  Estimations of previewed road curvatures and vehicular motion by a vision-based data fusion scheme , 1997, Machine Vision and Applications.

[13]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[14]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[15]  Todd Jochem,et al.  Rapidly Adapting Machine Vision for Automated Vehicle Steering , 1996, IEEE Expert.

[16]  Andrew P. Sage,et al.  Estimation theory with applications to communications and control , 1979 .

[17]  K. Kanatani,et al.  Reconstruction of 3-D road geometry from images for autonomous land vehicles , 1990, IEEE Trans. Robotics Autom..

[18]  Antonio Guiducci 3D Road Reconstruction from a Single View , 1998, Comput. Vis. Image Underst..

[19]  Kenichi Kanatani,et al.  Road shape reconstruction by local flatness approximation , 1991, Adv. Robotics.