On-board visual navigation system for unmanned aerial vehicles autonomous aerial refueling

In this paper, an on-board binocular visual navigation system based on unmanned aerial vehicles platform is designed for autonomous aerial refueling. The hardware configuration of the entire platform is introduced. Vision algorithms including target tracking, feature extraction, and pose estimation are employed for measuring the relation between two unmanned aerial vehicles. Two situations are considered under long and short distances to make this procedure flexible. Four pose estimation algorithms are implemented and compared in this research. A series of experiments are conducted to verify the feasibility and effectiveness of aerial refueling on the unmanned aerial vehicle platform.

[1]  Michael J. Allen,et al.  Autonomous Airborne Refueling Demonstration, Phase I Flight-Test Results , 2007 .

[2]  Haibin Duan,et al.  Integrated localization system for autonomous unmanned aerial vehicle formation flight , 2016, 2016 12th IEEE International Conference on Control and Automation (ICCA).

[3]  Zheng Guo,et al.  Optimal patterns of dynamic soaring with a small unmanned aerial vehicle , 2017 .

[4]  Marcello R. Napolitano,et al.  Evaluation of Machine Vision Algorithms for Autonomous Aerial Refueling for Unmanned Aerial Vehicles , 2007, J. Aerosp. Comput. Inf. Commun..

[5]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[6]  Jason L. Speyer,et al.  Sensor Fusion Applied to Autonomous Aerial Refueling , 2009 .

[7]  Pascual Campoy Cervera,et al.  A vision-based strategy for autonomous aerial refueling tasks , 2013, Robotics Auton. Syst..

[8]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Mario G. Perhinschi,et al.  Machine Vision/GPS Integration Using EKF for the UAV Aerial Refueling Problem , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  James W. Kamman,et al.  Active control of aerial refueling hose-drogue systems , 2010 .

[11]  Han Li,et al.  Verification of monocular and binocular pose estimation algorithms in vision-based UAVs autonomous aerial refueling system , 2016 .

[12]  Shiqi Li,et al.  A Robust O(n) Solution to the Perspective-n-Point Problem , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Haibin Duan,et al.  Visual Measurement in Simulation Environment for Vision-Based UAV Autonomous Aerial Refueling , 2015, IEEE Transactions on Instrumentation and Measurement.

[14]  Rita Cunha,et al.  Landing of a Quadrotor on a Moving Target Using Dynamic Image-Based Visual Servo Control , 2016, IEEE Transactions on Robotics.

[15]  Emanuele Garone,et al.  Nonlinear control of a tethered UAV: The taut cable case , 2017, Autom..

[16]  M. Innocenti,et al.  Vision-Based Autonomous Probe and Drogue Aerial Refueling , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[17]  Zhijie Liu,et al.  Dynamic modeling and vibration control of a flexible aerial refueling hose , 2016 .

[18]  Tomasz Goetzendorf-Grabowski,et al.  Design of UAV for photogrammetric mission in Antarctic area , 2017 .

[19]  Haibin Duan,et al.  A binocular vision-based measuring system for UAVs autonomous aerial refueling , 2016, 2016 12th IEEE International Conference on Control and Automation (ICCA).

[20]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Mark J. Monda,et al.  Boom and Receptacle Autonomous Air Refueling Using Visual Snake Optical Sensor , 2007 .

[22]  Vincent Lepetit,et al.  Accurate Non-Iterative O(n) Solution to the PnP Problem , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[23]  Monish D. Tandale,et al.  Trajectory Tracking Controller for Vision-Based Probe and Drogue Autonomous Aerial Refueling , 2005 .

[24]  Steve E Bullock,et al.  Advances in air to air refuelling , 2014 .

[25]  Timothy W. McLain,et al.  Aerial rendezvous of small unmanned aircraft using a passive towed cable system , 2014 .

[26]  Jan Flusser,et al.  Pattern recognition by affine moment invariants , 1993, Pattern Recognit..

[27]  Yin Wang,et al.  Tight formation control of multiple unmanned aerial vehicles through an adaptive control method , 2016, Science China Information Sciences.

[28]  Salah Sukkarieh,et al.  Experimental validation of a drogue estimation algorithm for autonomous aerial refueling , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).