Vision-Only Aircraft Flight Control Methods and Test Results

An unmanned aerial vehicle usually carries an array of sensors whose output is used to estimate the vehicle’s attitude, velocity and position. This paper details the development of control strategies for a glider, which is capable of flying from a starting point to a ending location using only a single vision sensor. Using vision to control an aircraft presents a few unique challenges. Firstly, absolute state measurements are not available from an image. Secondly, in order to maintain adequate control of the aircraft, the images must be processed at a fast rate. The image processor utilizes an integral image representation and a rejective cascade filter to find and classify simple features in the images, reducing the image to the most probable pixel location of the objective. The navigation algorithms use an extended Kalman filter to generate state estimates based on measurements obtained from the imagery. The algorithms are tested through the flight testing of a glider instrumented only with a single camera.

[1]  Peter I. Corke,et al.  Dynamic effects in visual closed-loop systems , 1996, IEEE Trans. Robotics Autom..

[2]  B. Korn,et al.  Robust position estimation using images from an uncalibrated camera , 2003, Digital Avionics Systems Conference, 2003. DASC '03. The 22nd.

[3]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  James P. Ostrowski,et al.  Visual servoing with dynamics: control of an unmanned blimp , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[5]  Yoshiaki Shirai,et al.  Guiding a robot by visual feedback in assembling tasks , 1973, Pattern Recognit..

[6]  E.N. Johnson,et al.  Vision-only aircraft flight control , 2003, Digital Avionics Systems Conference, 2003. DASC '03. The 22nd.

[7]  Gaurav S. Sukhatme,et al.  Vision-based autonomous landing of an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[8]  Eric N. Johnson,et al.  Vision-Aided Inertial Navigation for Flight Control , 2005, J. Aerosp. Comput. Inf. Commun..

[9]  Misha Pavel,et al.  Neural net based processor for robust, high-integrity multisensor and synthetic vision fusion , 2003, Digital Avionics Systems Conference, 2003. DASC '03. The 22nd.

[10]  Eric N. Johnson,et al.  The Georgia Tech Unmanned Aerial Research Vehicle: GTMax , 2003 .

[11]  F. Miyazaki,et al.  Visual servoing for non-holonomic mobile robots , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).