A Drogue Detection Method for Vision-Based Autonomous Aerial Refueling

Drogue detection is important for vision-based autonomous aerial refueling. It is a difficult task due to disturbances caused by both the tanker wake vortex and atmospheric turbulence. In this paper, the problem of drogue detection is considered as moving object detection. A method based on multi-scale low rank and sparse decomposition is proposed for drogue detection. Firstly, the image sequences are decomposed by stationary wavelet transform respectively. Then the method based on low rank and sparse decomposition is employed on the low frequency sub-band image sequences of coarsest scale. After obtaining the object, the object is used as object confidence map to feedback the low sub-band image sequences of next fine scale for low rank and sparse decomposition. Thereinto, an alignment method is introduced into the low rank and sparse composition due to the vibration in the drogue video image. This method can overcome the influence of non-structure information, caused by atmospheric or aircrafts. The experimental results show that the proposed algorithm is effective in real autonomous aerial refueling data via multi-scale low rank and sparse decomposition for drogue detection under complex background.

[1]  Z. Zivkovic.  Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[2]  Tao Wang,et al.  Camera Based Localization for Autonomous UAV Formation Flight , 2011 .

[3]  Ezequiel López-Rubio,et al.  Stochastic approximation for background modelling , 2011, Comput. Vis. Image Underst..

[4]  M. L. Fravolini,et al.  Simulation Environment for Machine Vision Based Aerial Refueling for UAVs , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[5]  Mark J. Monda,et al.  Boom and Receptacle Autonomous Air Refueling Using Visual Snake Optical Sensor , 2007 .

[6]  Xin Li,et al.  Simultaneous Video Stabilization and Moving Object Detection in Turbulence , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Mark J. Monda,et al.  Boom and Receptacle Autonomous Air Refueling Using a Visual Pressure Snake Optical Sensor , 2006 .

[9]  Monish D. Tandale,et al.  Vision-Based Sensor and Navigation System for Autonomous Air Refueling , 2005 .

[10]  Monish D. Tandale,et al.  Trajectory Tracking Controller for Vision-Based Probe and Drogue Autonomous Aerial Refueling , 2005 .

[11]  F. O. Eke,et al.  A Survey of the Dynamics and Control of Aircraft During Aerial Refueling , 2008 .

[12]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Mario G. Perhinschi,et al.  Addressing corner detection issues for machine vision based UAV aerial refueling , 2007, Machine Vision and Applications.

[15]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[16]  Chao-I Chen,et al.  Drogue tracking using 3D flash lidar for autonomous aerial refueling , 2011, Defense + Commercial Sensing.