Boom and Receptacle Autonomous Air Refueling Using a Visual Pressure Snake Optical Sensor

Autonomous in-flight air refueling is an important capability for the future deployment of unmanned air vehicles, since they will likely be ferried in flight to overseas theaters of operation instead of being shipped unassembled in containers. This paper introduces a vision sensor based on active deformable contour algorithms, and a relative navigation system that enables precise and reliable boom and receptacle autonomous air refueling for non micro sized unmanned air vehicles. The sensor is mounted on the tanker aircraft near the boom, and images a single passive target image painted near the refueling receptacle on the receiver aircraft. Controllers are developed for the automatic control of the refueling boom, and for the station keeping controller of the receiver aircraft. The boom controller is integrated with the active deformable contour sensor system, and feasibility of the total system is demonstrated by simulated docking maneuvers in the presence of various levels of turbulence. Results indicate that the integrated sensor and controller enables precise boom and receptacle air refueling, including consideration of realistic measurement errors and disturbances. I. Introduction There are currently two approaches used for air refueling. The probe-and-drogue refueling system is the standard for the United States Navy and the air forces of most other nations. In this method, the tanker trails a hose with a flexible “basket”, called a drogue, at the end. The drogue is aerodynamically stabilized. It is the responsibility of the pilot of the receiver aircraft to maneuver the receiver’s probe into the drogue. This method is used for small, agile aircraft such as fighters because both the hose and drogue are flexible and essentially passive during re-fueling; a human operator is not required on the tanker. 1‐3 Autonomous in-flight refueling using a probe-and-drogue system is basically a docking situation that probably requires 2 cm accuracy in the relative position of the refueling probe (from the receiving aircraft) with respect to the drogue (from the tanker) during the end-game. This specification is based on the geometry of the existing probe and drogue hardware, and the need to ensure that the tip of the probe contacts only the inner sleeve of the receptacle and not the more lightly constructed and easily damaged shroud. 4 The United States Air Force uses the flying boom developed by Boeing. The boom approach is supervised and controlled by a human operator from a station near the rear of the tanker aircraft, who is responsible for “flying” the boom into the refueling port on the receiver aircraft. In this method, the job of the receiver aircraft is to maintain proper refueling position with respect to the tanker, and leave the precision control function to the human operator in the tanker. 2

[1]  P. Dorato,et al.  Optimal linear regulators: The discrete-time case , 1971 .

[2]  Richard P Shipman Visual Servoing for Autonomous Aircraft Refueling , 1989 .

[3]  Richard A. Bennett Brightness Invariant Port Recognition for Robotic Aircraft Refueling , 1990 .

[4]  Mongi A. Abidi,et al.  The use of multisensor data for robotic applications , 1990, IEEE Trans. Robotics Autom..

[5]  Gérard Lachapelle,et al.  Precise Aircraft-to-Aircraft Positioning Using a Multiple Receiver Configuration , 1994 .

[6]  John Porrill,et al.  Active region models for segmenting medical images , 1994, Proceedings of 1st International Conference on Image Processing.

[7]  R. Kimmel,et al.  A Geometric Approach to Segmentation and Analysis of 3 D Medical , 1996 .

[8]  Romeo Ortega,et al.  Trajectory tracking control , 1998 .

[9]  Richard K. Smith Seventy-Five Years of Inflight Refueling: Highlights, 1923-1998 , 1998 .

[10]  John L. Junkins,et al.  " Vision-Based Navigation for Rendezvous , Docking and Proximity Operation " , 1999 .

[11]  John L. Crassidis,et al.  VISION-BASED RELATIVE NAVIGATION FOR FORMATION FLYING OF SPACECRAFT , 2000 .

[12]  Douglas P. Perrin,et al.  Rethinking classical internal forces for active contour models , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  John Valasek,et al.  Vision Based Sensor and Navigation System for Autonomous Aerial Refueling , 2002 .

[14]  Robert N. Bellah Seventy-Five Years , 2002 .

[15]  John Valasek,et al.  Vision based controller for autonomous aerial refueling , 2002, Proceedings of the International Conference on Control Applications.

[16]  John Valasek,et al.  Autonomous Aerial Refueling Utilizing A Vision Based Navigation System , 2002 .

[17]  John L. Junkins,et al.  A DSP embedded optical navigation system , 2002, 6th International Conference on Signal Processing, 2002..

[18]  Hanspeter Schaub,et al.  Color snakes for dynamic lighting conditions on mobile manipulation platforms , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[19]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[20]  Hanspeter Schaub,et al.  Matching a Statistical Pressure Snake to a Four-Sided Polygon and Estimating the Polygon Corners , 2004 .

[21]  Monish D. Tandale,et al.  Vision-Based Sensor and Navigation System for Autonomous Air Refueling , 2005 .

[22]  Monish D. Tandale,et al.  Trajectory Tracking Controller for Vision-Based Probe and Drogue Autonomous Aerial Refueling , 2005 .

[23]  Hanspeter Schaub,et al.  Efficient polygonal intersection determination with applications to robotics and vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Mark J. Monda,et al.  Spacecraft Relative Motion Estimation using Visual Sensing Techniques , 2005 .

[25]  Lydia E. Kavraki,et al.  Fast intersection checking for parametric deformable models , 2005, SPIE Medical Imaging.

[26]  Mario G. Perhinschi,et al.  Addressing corner detection issues for machine vision based UAV aerial refueling , 2007, Machine Vision and Applications.