Recent advances in manufacturing automation have motivated vision-based control of autonomous vehicles operated in unattended factories, material handling processes, warehouse operations, and hazardous environment explorations. Existing vision-based tracking control systems of autonomous vehicles, however, have been limited in real-time applications due to slow and/or expensive visual feedback and complicated dynamics and control with nonholonomic constraints. This paper presents a practical real-time vision-based tracking control system of an unmanned vehicle, ViTra. Unlike the conventional RS170 video-based machine vision systems, ViTra uses a DSP-based flexible integrated vision system (FIVS) which is characterized by low cost, computational efficiency, control flexibility, and a friendly user interface. In particular, this paper focuses on developing a framework for vision tracking systems, designing generic fiducial patterns, and applying real-time vision systems to tracking control of autonomous vehicles. A laboratory prototype vision-based tracking system developed at Georgia Institute of Technology permits the uniquely designed fiducial landmarks to be evaluated experimentally, the control strategy and the path planning algorithm derived in the paper to be validated in real-time, and the issues of simplifying nonlinear dynamics and dealing with nonholonomic constraints to be addressed in practice. Experimental results reveal interesting insights into the design, manufacture, modeling, and control of vision-based tracking control systems of autonomous vehicles.
[1]
Kyong Sei Lee.
Flexible part-feeding system for machine loading and assembly. Part II. A cost-effective solution
,
1991
.
[2]
Azriel Rosenfeld,et al.
Pattern Recognition and Computer Vision
,
1984,
Computer.
[3]
Masayoshi Tomizuka,et al.
Zero Phase Error Tracking Algorithm for Digital Control
,
1987
.
[4]
Virginia Ann Johnson,et al.
State-of-the-art Survey
,
2022
.
[5]
Linda G. Shapiro,et al.
Image Segmentation Techniques
,
1984,
Other Conferences.
[6]
Kyong Sei Lee,et al.
Design concept and prototype development of a flexible integrated vision system
,
1994,
J. Field Robotics.
[7]
Charles E. Thorpe,et al.
An architecture for autonomous vehicle navigation
,
1985,
Proceedings of the 1985 4th International Symposium on Unmanned Untethered Submersible Technology.
[8]
Israel Amir,et al.
Design of Fiducials for Accurate Registration Using Machine Vision
,
1990,
IEEE Trans. Pattern Anal. Mach. Intell..
[9]
Kyong Sei Lee.
Flexible part-feeding system for machine loading and assembly. Part I. A state-of-the-art survey
,
1991
.
[10]
C. J. Harris,et al.
Intelligent autonomous vehicles: recent progress and central research issues
,
1992
.
[11]
Kok-Meng Lee,et al.
Principle and applications of retroreflective vision sensing for discrete part-presentation
,
1991,
J. Field Robotics.
[12]
Kannan,et al.
ON IMAGE SEGMENTATION TECHNIQUES
,
2022
.