Simulation Environment for Machine Vision Based Aerial Refueling for UAVs

The design of a simulation environment is described for a machine vision (MV)-based approach for the problem of aerial refueling (AR) for unmanned aerial vehicles (UAVs) using the USAF refueling method. MV-based algorithms are implemented within the proposed scheme to detect the relative position and orientation between the UAV and the tanker. Within this effort, techniques and algorithms for the visualization the tanker aircraft in a virtual reality (VR) setting, for the acquisition of the tanker image, for the feature extraction (FE) from the acquired image, for the feature matching (FM) of the features, for the tanker-UAV pose estimation (PE) have been developed and extensively tested in closed-loop simulations. Detailed mathematical models of the tanker and UAV dynamics, refueling boom, turbulence, wind gusts, and tanker's wake effects, along with the UAV docking control laws have been implemented within the simulation environment. This paper also presents the results of a study relative to the use of passive markers versus feature extraction for the problem of estimating in real time the UAV-tanker relative position and orientation vectors.

[1]  Jean-Jacques E. Slotine,et al.  Robot analysis and control , 1988, Autom..

[2]  J. Alison Noble,et al.  Finding Corners , 1988, Alvey Vision Conference.

[3]  Richard Burns,et al.  The Automated Aerial Refueling Simulation at the AVTAS Laboratory , 2005 .

[4]  Marcello R. Napolitano,et al.  Design and flight-testing of non-linear formation control laws , 2007 .

[5]  Tal Shima,et al.  Optimal scheduling for refueling multiple autonomous aerial vehicles , 2006, IEEE Transactions on Robotics.

[6]  Marcello R. Napolitano,et al.  Modeling and control issues for autonomous aerial refueling for UAVs using a probe–drogue refueling system , 2004 .

[7]  Florian Holzapfel,et al.  Simulation Analysis of Autonomous Aerial Refueling Procedures , 2005 .

[8]  S. Seereeram,et al.  Vision-based relative pose estimation for autonomous rendezvous and docking , 2006, 2006 IEEE Aerospace Conference.

[9]  James H. Myatt,et al.  Control-Surface Deflection Effects on the Innovative Control Effectors (ICE 101) Design , 2000 .

[10]  M. L. Fravolini,et al.  A comparison of Pose Estimation algorithms for Machine Vision based Aerial Refueling for UAVs , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[11]  Monish D. Tandale,et al.  Vision-Based Sensor and Navigation System for Autonomous Air Refueling , 2005 .

[12]  Marc Rauw,et al.  FDC 1.2 - A Simulink Toolbox for Flight Dynamics and Control Analysis , 2001 .

[13]  Tong Lin,et al.  The Use of Flight Simulation and Flight Testing in the Automated Aerial Refueling Program , 2005 .

[14]  Mark W. Spong,et al.  Robot dynamics and control , 1989 .

[15]  William B. Blake,et al.  Comparison of Predicted and Measured Formation Flight Interference Effects , 2001 .

[16]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[17]  N. Kehtarnavaz,et al.  Model-based orientation-independent 3-D machine vision techniques , 1988 .

[18]  David Gingras,et al.  Static and dynamic wind tunnel testing of air vehicles in close proximity , 2001 .

[19]  L. Korbly.  Sensing relative attitudes for automatic docking , 1983 .

[20]  John Valasek,et al.  Autonomous Aerial Refueling Utilizing A Vision Based Navigation System , 2002 .

[21]  M. L. Fravolini,et al.  Feature Matching Algorithms for Machine Vision Based Autonomous Aerial Refueling , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[22]  Marcello R. Napolitano,et al.  Design and Flight Testing Evaluation of Formation Control Laws , 2006, IEEE Transactions on Control Systems Technology.

[23]  Wright-Patterson Afb,et al.  Automated Aerial Refueling: Extending the Effectiveness of Unmanned Air Vehicles , 2005 .

[24]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[25]  Mario G. Perhinschi,et al.  Addressing corner detection issues for machine vision based UAV aerial refueling , 2007, Machine Vision and Applications.

[26]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[27]  Shinji Umeyama.  Parameterized Point Pattern Matching and Its Application to Recognition of Object Families , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Filiberto Pla,et al.  Matching Feature Points in Image Sequences through a Region-Based Method , 1997, Comput. Vis. Image Underst..

[29]  Mario Innocenti,et al.  Vision Algorithms for Formation Flight and Aerial Refueling with Optimal Marker Labeling , 2005 .

[30]  B.A. Kish,et al.  Autonomous aerial refueling based on the tanker reference frame , 2006, 2006 IEEE Aerospace Conference.

[31]  Joe Nalepka,et al.  Automated Aerial Refueling: Extending the Effectiveness of UAVs , 2005 .

[32]  Bernard Etkin,et al.  Dynamics of Atmospheric Flight , 1972 .

[33]  D.V.S. Chandra.  Target orientation estimation using Fourier energy spectrum , 1998 .

[34]  B. Sridhar,et al.  GPS/machine vision navigation system for aircraft , 1997, IEEE Transactions on Aerospace and Electronic Systems.