Binocular Stereopsis and Lane Marker Flow for Vehicle Navigation: Lateral and Longitudinal Control

We propose a new approach for vision based longitudinal and lateral vehicle control which makes extensive use of binocular stereopsis. Longitudinal control | i.e. maintaining a safe, constant distance from the vehicle in front | is supported by detecting and measuring the distances to leading vehicles using binocular stereo. A known camera geometry with respect to the locally planar road is used to map the images of the road plane in the two camera views into alignment. Any signi cant residual image disparity then indicates an object not lying in the road plane and hence a potential obstacle. This approach allows us to separate image features into those lying in the road plane, e.g. lane markers, and those due to other objects. The features which lie on the road are stationary in the scene and appear to move only because of the egomotion of the vehicle. Measurements on these features are used for dynamic update of (a) the camera parameters in the presence of camera vibration and changes in road slope (b) the lateral position of the vehicle with respect to the lane markers. In the absence of this separation, image features due to vehicles which happen to lie in the search zone for lane markers would corrupt the estimation of the road boundary contours. This problem has not yet been addressed by any lane marker based vehicle guidance approach, but has to be taken very seriously, since usually one has to cope with crowded trafc scenes where lane markers are often obstructed by vehicles. Lane markers are detected and used for lateral control, i.e. following the road while maintaining a constant lateral distance to the road boundary. For that purpose we model the road and hence the shape of the lane markers as clothoidal curves, the curvatures of which we estimate recursively along the image sequence. These curvature estimates also provides desirable look-ahead information for a smooth ride in the car. Research funded by PATH grant no. MOU 94

[1]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[2]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  L. E. Scales,et al.  Introduction to Non-Linear Optimization , 1985 .

[4]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[5]  Takeo Kanade,et al.  Vision and Navigation for the Carnegie-Mellon Navlab , 1987 .

[6]  Matthew Turk,et al.  VITS-A Vision System for Autonomous Land Vehicle Navigation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Martial Hebert,et al.  Vision and navigation for the Carnegie-Mellon Navlab , 1988 .

[8]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[9]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Tohru Ozaki,et al.  Video-Rate Image Processing System for an Autonomous Personal Vehicle System , 1990, MVA.

[11]  A. Meygret,et al.  Segmentation of optical flow and 3D data for the interpretation of mobile objects , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[12]  J. Crisman.  Color vision for the detection of unstructured road and intersections , 1990 .

[13]  Monique Thonnat,et al.  A Pyramidal Stereovision Algorithm Based On Contour Chain Points , 1990, ECCV.

[14]  Rachid Deriche,et al.  Recovering 3D motion and structure from stereo and 2D token tracking cooperation , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[15]  Surender K Kenue,et al.  Lanelok: Detection Of Lane Boundaries And Vehicle Tracking Using Image-Processing Techniques - Part I: Hough-Transform, Region-Tracing And Correlation Algorithms , 1989, Other Conferences.

[16]  Stephen A. Billings,et al.  SWITCHER: a stereo algorithm for ground plane obstacle detection , 1990, Image Vis. Comput..

[17]  Jan-Olof Eklundh,et al.  Object detection using model based prediction and motion parallax , 1990, ECCV.

[18]  Rachid Deriche,et al.  Information contained in the motion field of lines and the cooperation between motion and stereo , 1990, Int. J. Imaging Syst. Technol..

[19]  Larry S. Davis,et al.  Reconstruction of a road by local image matches and global 3D optimization , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[20]  S. Chandrashekhar,et al.  Temporal analysis of stereo image sequences of traffic scenes , 1991, Vehicle Navigation and Information Systems Conference, 1991.

[21]  Daniel Raviv,et al.  A new approach to vision and control for road following , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[22]  Wilfried Enkelmann,et al.  Obstacle detection by evaluation of optical flow fields from image sequences , 1990, Image Vis. Comput..

[23]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Dean A. Pomerleau,et al.  Progress in neural network-based vision for autonomous robot driving , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[25]  Jitendra Malik,et al.  A Computational Framework for Determining Stereo Correspondence from a Set of Linear Spatial Filters , 1991, ECCV.

[26]  Charles E. Thorpe,et al.  Representation and recovery of road geometry in YARF , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[27]  B. Ulmer.  VITA-an autonomous road vehicle (ARV) for collision avoidance in traffic , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[28]  O. D. Altan,et al.  Computer architecture and implementation of vision-based real-time lane sensing , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[29]  Andrew Blake,et al.  Affine-invariant contour tracking with automatic control of spatiotemporal scale , 1993, 1993 (4th) International Conference on Computer Vision.

[30]  D. Pomerleau,et al.  MANIAC : A Next Generation Neurally Based Autonomous Road Follower , 1993 .

[31]  Oliver. Faugeras,et al.  Real time correlation based stereo algorithm and application , 1993 .

[32]  Olivier D. Faugeras,et al.  Relative 3D positioning and 3D convex hull computation from a weakly calibrated stereo pair , 1993, 1993 (4th) International Conference on Computer Vision.

[33]  Bill Ross,et al.  A practical stereo vision system , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Olivier D. Faugeras,et al.  Determining the fundamental matrix with planes: instability and new algorithms , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Larry H. Matthies,et al.  Stochastic performance modeling and evaluation of obstacle detectability with imaging range sensors , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.