Development of Binocular Stereopsis for Vehicle Lateral Control, Longitudinal Control and Obstacle Detection

This report describes progress in the application of computer vision techniques to the lateral and longitudinal control of an autonomous highway vehicle. A vehicle's lateral dynamics and the design of an appropriate controller for lateral control are investigated. Stereo vision, in conjunction with a scanning laser radar sensor, are studied for providing range information applicable to the longitudinal control problem. The results from the experimental demonstration of this system are reported as part of the National Automated Highway Systems Consortium (NAHSC) Demonstration that took place in San Diego in August 1997.

[1]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[2]  S. Shankar Sastry,et al.  Vision guided navigation for a nonholonomic mobile robot , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[3]  Jason L. Speyer,et al.  Robust fault detection filter design , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[4]  Jason L. Speyer,et al.  Fault Detection And Identification With Application To Advanced Vehicle Control Systems , 1995 .

[5]  Jitendra Malik,et al.  A Combined Approach to Stereopsis and Lane-Finding , 1997 .

[6]  Masayoshi Tomizuka,et al.  Vehicle Lateral Control for Highway Automation , 1990, 1990 American Control Conference.

[7]  Jitendra Malik,et al.  A real-time approach to stereopsis and lane-finding , 1996, Proceedings of Conference on Intelligent Vehicles.

[8]  Andrew Zisserman,et al.  Robust detection of degenerate configurations for the fundamental matrix , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  H Kikuchi,et al.  Development of Laser Radar for Radar Brake System , 1995 .

[10]  Jitendra Malik,et al.  Vision for longitudinal vehicle control , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[11]  Takeo Kanade,et al.  Vision and Navigation for the Carnegie-Mellon Navlab , 1987 .

[12]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[13]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Jana Ko Seckk Vision-based Lateral Control of Vehicles: Look-ahead and Delay Issues , 1996 .

[15]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[16]  Umit Ozguner,et al.  An analytical study of vehicle steering control , 1995, Proceedings of International Conference on Control Applications.

[17]  Jason L. Speyer,et al.  Fault Detection and Identification with Application to Advanced Vehicle Control Systems: Final Report , 1996 .

[18]  David W. Murray,et al.  A unifying framework for structure and motion recovery from image sequences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[19]  KanadeTakeo,et al.  Shape and motion from image streams under orthography , 1992 .

[20]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[21]  Chris Harris,et al.  Tracking with rigid models , 1993 .

[22]  Stephen M. Smith,et al.  ASSET-2: Real-Time Motion Segmentation and Shape Tracking , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[25]  M. Massoumnia A geometric approach to the synthesis of failure detection filters , 1986 .

[26]  S. Shankar Sastry,et al.  Vision guided navigation for a nonholonomic mobile robot , 1997, Block Island Workshop on Vision and Control.

[27]  Peter J. Burt,et al.  Object tracking with a moving camera , 1989, [1989] Proceedings. Workshop on Visual Motion.

[28]  Olivier Faugeras,et al.  3D Dynamic Scene Analysis , 1992 .

[29]  Daniel Raviv,et al.  Nonreconstruction approach for road following , 1992, Other Conferences.

[30]  Jana Kosecka,et al.  Vision-based lateral control of vehicles , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[31]  Jürgen Guldner,et al.  ANALYSIS OF AUTOMATIC STEERING CONTROL FOR HIGHWAY VEHICLES WITH LOOK-DOWN LATERAL REFERENCE SYSTEMS , 1996 .

[32]  John E. White,et al.  Detection Filter Design: Spectral Theory and Algorithms , 1986, 1986 American Control Conference.

[33]  Paul A. Beardsley,et al.  Robust Vision , 1994, BMVC.