A vision system for landing an unmanned aerial vehicle

We present the design and implementation of a real-time computer vision system for a rotorcraft unmanned aerial vehicle to land onto a known landing target. This vision system consists of customized software and off-the-shelf hardware which perform image processing, segmentation, feature point extraction, camera pan/tilt control, and motion estimation. We introduce the design of a landing target which significantly simplifies the computer vision tasks such as corner detection and correspondence matching. Customized algorithms are developed to allow for realtime computation at a frame rate of 30 Hz. Such algorithms include certain linear and nonlinear optimization schemes for model-based camera pose estimation. We present results from an actual flight test which show the vision-based state estimates are accurate to within 5 cm in each axis of translation, and 5 degrees in each axis of rotation, making vision a viable sensor to be placed in the control loop of a hierarchical flight management system.

[1]  S. Shankar Sastry,et al.  HIERARCHICAL CONTROL SYSTEM SYNTHESIS FOR ROTORCRAFT-BASED UNMANNED AERIAL VEHICLES , 2000 .

[2]  Yi Ma,et al.  Vision guided landing of an unmanned air vehicle , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[3]  Wen-Hsiang Tsai,et al.  Using parallel line information for vision-based landmark location estimation and an application to automatic helicopter landing , 1998 .

[4]  Wei Kang,et al.  Integrated vision/inertial navigation system design using nonlinear filtering , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[5]  Stefan Werner,et al.  Vision-based multisensor machine perception system for autonomous aircraft landing approach , 1996, Defense, Security, and Sensing.

[6]  W.C. Karl,et al.  A vision augmented navigation system , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[7]  Thomas S. Huang,et al.  Motion and Structure from Image Sequences , 1992 .

[8]  Larry S. Davis,et al.  Iterative Pose Estimation Using Coplanar Feature Points , 1996, Comput. Vis. Image Underst..