Vision-based robotic convoy driving

This article describes a method for vision-based autonomous convoy driving in which a robotic vehicle autonomously pursues another vehicle. Pursuit is achieved by visually tracking a target mounted on the back of the pursued vehicle. Visual tracking must be robust, since a failure leads to catastrophic results. To make our system as reliable as possible, uncertainty is accounted for in each measurement and propagated through all computations. We use a best linear unbiased estimate (BLUE) of the target's position in each separate image, and a polynomial least-mean-square fit (LMSF) to estimate the target's motion. Robust autonomous convoy driving has been demonstrated in the presence of various lighting conditions, shadowing, other vehicles, turns at intersections, curves, and hills. A continuous, autonomous, convoy drive of over 33 km (20 miles) was successful, at speeds averaging between 50 and 75km/h (30–45 miles/h).

[1]  Dimitris P. Tsakiris,et al.  On the visual mathematics of tracking , 1991, Image Vis. Comput..

[2]  Ronald Lumia,et al.  Predictive visual tracking , 1993, Other Conferences.

[3]  Robert A LaTourette Equivalent Bandwidth of a General Class of Polynomial Smoothers: With Application to Bearing Tracker Random Error Evaluation. , 1982 .

[4]  Ralf Kories,et al.  Towards autonomous convoy driving: recognizing the starting vehicle in front , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[5]  K. Murphy ANALYSIS OF ROBOTIC VEHICLE STEERING AND CONTROLLER DELAY , 1994 .

[6]  W. von Seelen,et al.  Vision-based car-following: detection, tracking, and identification , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[7]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[8]  Volker Graefe,et al.  Applications of dynamic monocular machine vision , 1988, Machine Vision and Applications.

[9]  K. N. Murphy Navigation and Retro-Traverse on a Remotely Operated Vehicle , 1992, Singapore International Conference on Intelligent Control and Instrumentation [Proceedings 1992].

[10]  Dean A. Pomerleau,et al.  Progress in neural network-based vision for autonomous robot driving , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[11]  Nasser Kehtarnavaz,et al.  Visual control of an autonomous vehicle (BART)-the vehicle-following problem , 1991 .

[12]  Volker Graefe,et al.  Dynamic monocular machine vision , 1988, Machine Vision and Applications.

[13]  E. D. Dickmanns,et al.  4-D dynamic vision for intelligent motion control , 1991 .

[14]  David Paul Casasent Intelligent Robots and Computer Vision XII: Active Vision and 3D Methods , 1993 .

[15]  Roger Bostelman,et al.  High-level mobility controller for a remotely operated unmanned land vehicle , 1992, J. Intell. Robotic Syst..

[16]  G. Bierman Factorization methods for discrete sequential estimation , 1977 .

[17]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[18]  Dean A. Pomerleau,et al.  Neural Network Based Autonomous Navigation , 1990 .

[19]  David G. Lowe,et al.  Robust model-based motion tracking through the integration of search and estimation , 1992, International Journal of Computer Vision.

[20]  Henry Schneiderman,et al.  Ground vehicle control at NIST: From teleoperation to autonomy , 1994 .

[21]  Donald B. Gennery,et al.  Visual tracking of known three-dimensional objects , 1992, International Journal of Computer Vision.