GPS / MV based Aerial Refueling for UAVs

This paper describes the design of a simulation environment for a GPS / Machine Vision (MV)-based approach for the problem of Aerial Refueling (AR) for Unmanned Aerial Vehicles (UAVs) using the USAF refueling method. MV-based algorithms are implemented within this effort as smart sensor in order to detect the relative position and orientation between the UAV and the tanker. Within this effort, techniques and algorithms for the visualization the tanker aircraft in a Virtual Reality (VR) setting, for the acquisition of the tanker image, for the Feature Extraction (FE) from the acquired image, for the Point Matching (PM) of the features, for the tanker-UAV Pose Estimation (PE) have been developed and extensively tested in closed loop simulations. Detailed mathematical models of the tanker and UAV dynamics, refueling boom, turbulence, wind gusts, and tanker’s wake effects, along with the UAV docking control laws and reference path generation have been implemented within the simulation environment. Mathematical model of the noise produced by GPS, MV, INS and pressure sensors are also derived. This paper also presents an Extended Kalman Filter (EKF) used for the sensors fusion between GPS and MV systems. Results on the accuracy reached for the estimation of the relative position are also provided.

[1]  Marc Rauw,et al.  FDC 1.2 - A Simulink Toolbox for Flight Dynamics and Control Analysis , 2001 .

[2]  Tal Shima,et al.  Optimal scheduling for refueling multiple autonomous aerial vehicles , 2006, IEEE Transactions on Robotics.

[3]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  J. Alison Noble,et al.  Finding Corners , 1988, Alvey Vision Conference.

[5]  S. Seereeram,et al.  Vision-based relative pose estimation for autonomous rendezvous and docking , 2006, 2006 IEEE Aerospace Conference.

[6]  James H. Myatt,et al.  Control-Surface Deflection Effects on the Innovative Control Effectors (ICE 101) Design , 2000 .

[7]  B. Sridhar,et al.  GPS/machine vision navigation system for aircraft , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[8]  David Gingras,et al.  Static and dynamic wind tunnel testing of air vehicles in close proximity , 2001 .

[9]  L. Korbly Sensing relative attitudes for automatic docking , 1983 .

[10]  Marcello R. Napolitano,et al.  Design and Flight Testing Evaluation of Formation Control Laws , 2006, IEEE Transactions on Control Systems Technology.

[11]  Wright-Patterson Afb,et al.  Automated Aerial Refueling: Extending the Effectiveness of Unmanned Air Vehicles , 2005 .

[12]  Marcello R. Napolitano,et al.  Comparison of point matching algorithms for the UAV aerial refueling problem , 2010, Machine Vision and Applications.

[13]  Mario G. Perhinschi,et al.  Machine Vision/GPS Integration Using EKF for the UAV Aerial Refueling Problem , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  Florian Holzapfel,et al.  Simulation Analysis of Autonomous Aerial Refueling Procedures , 2005 .

[15]  Richard Burns,et al.  The Automated Aerial Refueling Simulation at the AVTAS Laboratory , 2005 .

[16]  Monish D. Tandale,et al.  Vision-Based Sensor and Navigation System for Autonomous Air Refueling , 2005 .

[17]  Marcello R. Napolitano,et al.  Modeling and control issues for autonomous aerial refueling for UAVs using a probe–drogue refueling system , 2004 .

[18]  N. Kehtarnavaz,et al.  Model-based orientation-independent 3-D machine vision techniques , 1988 .

[19]  Mario G. Perhinschi,et al.  Addressing corner detection issues for machine vision based UAV aerial refueling , 2007, Machine Vision and Applications.

[20]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[21]  Mark W. Spong,et al.  Robot dynamics and control , 1989 .

[22]  M. L. Fravolini,et al.  Feature Matching Algorithms for Machine Vision Based Autonomous Aerial Refueling , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[23]  M. L. Fravolini,et al.  Simulation Environment for Machine Vision Based Aerial Refueling for UAVs , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[24]  M. L. Fravolini,et al.  A comparison of Pose Estimation algorithms for Machine Vision based Aerial Refueling for UAVs , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[25]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[26]  William B. Blake,et al.  Comparison of Predicted and Measured Formation Flight Interference Effects , 2001 .

[27]  Jean-Jacques E. Slotine,et al.  Robot analysis and control , 1988, Autom..

[28]  B.A. Kish,et al.  Autonomous aerial refueling based on the tanker reference frame , 2006, 2006 IEEE Aerospace Conference.

[29]  Joe Nalepka,et al.  Automated Aerial Refueling: Extending the Effectiveness of UAVs , 2005 .

[30]  Bernard Etkin,et al.  Dynamics of Atmospheric Flight , 1972 .

[31]  D.V.S. Chandra Target orientation estimation using Fourier energy spectrum , 1998 .

[32]  Tong Lin,et al.  The Use of Flight Simulation and Flight Testing in the Automated Aerial Refueling Program , 2005 .

[33]  Giovanni Ulivi,et al.  An outdoor navigation system using GPS and inertial platform , 2002 .

[34]  Filiberto Pla,et al.  Matching Feature Points in Image Sequences through a Region-Based Method , 1997, Comput. Vis. Image Underst..

[35]  Mario Innocenti,et al.  Vision Algorithms for Formation Flight and Aerial Refueling with Optimal Marker Labeling , 2005 .

[36]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[37]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..