Robust Visual Detection–Learning–Tracking Framework for Autonomous Aerial Refueling of UAVs

In this paper, we propose a robust visual detection-learning-tracking framework for autonomous aerial refueling of unmanned aerial vehicles. Two classifiers (D-classifier and T-classifier) are defined in the proposed framework. The D-classifier is a robust linear support vector machine (SVM) classifier trained offline for detecting the drogue object of aerial refueling and a low-dimensional normalized robust local binary pattern feature is proposed to describe the drogue object in the D-classifier. The T-classifier is a state-based structured SVM classifier trained online for tracking the drogue object. A combination strategy between the D-classifier and the T-classifier is proposed in the framework. The D-classifier is used to assess if some positive support vectors in the T-classifier are required to be replaced by positive examples with density peaks. The experimental results on several challenging video sequences validate the effectiveness and robustness of our proposed framework.

[1]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Antoine Bordes,et al.  Sequence Labelling SVMs Trained in One Pass , 2008, ECML/PKDD.

[3]  Nicolas D. Georganas,et al.  Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques , 2011, IEEE Transactions on Instrumentation and Measurement.

[4]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[5]  Pascual Campoy Cervera,et al.  A vision-based strategy for autonomous aerial refueling tasks , 2013, Robotics Auton. Syst..

[6]  Xi Zhou,et al.  Robust Visual Cooperative Tracking Using Constrained Adaptive Sparse Representations and Sparse Classifier Grids , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Fariborz Saghafi,et al.  Vision-Based Navigation in Autonomous Close Proximity Operations using Neural Networks , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[9]  Xudong Jiang,et al.  LBP-Based Edge-Texture Features for Object Recognition , 2014, IEEE Transactions on Image Processing.

[10]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Jason Weston,et al.  Solving multiclass support vector machines with LaRank , 2007, ICML '07.

[12]  Marcello R. Napolitano,et al.  Real-time machine-vision-based position sensing system for UAV aerial refueling , 2007, Journal of Real-Time Image Processing.

[13]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Pascual Campoy Cervera,et al.  Towards Autonomous Air-to-Air Refuelling for UAVs using visual information , 2013, 2013 IEEE International Conference on Robotics and Automation.

[15]  Monish D. Tandale,et al.  Vision-Based Sensor and Navigation System for Autonomous Air Refueling , 2005 .

[16]  Anirban Mukherjee,et al.  Automatic Defect Detection on Hot-Rolled Flat Steel Products , 2013, IEEE Transactions on Instrumentation and Measurement.

[17]  Wanqing Li,et al.  Object detection using Non-Redundant Local Binary Patterns , 2010, 2010 IEEE International Conference on Image Processing.

[18]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[19]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[20]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[21]  Qiang Wu,et al.  PageRank Tracker: From Ranking to Tracking , 2014, IEEE Transactions on Cybernetics.

[22]  De Xu,et al.  Detection and Tracking Strategies for Autonomous Aerial Refuelling Tasks Based on Monocular Vision , 2014 .

[23]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[24]  Yongmei Cheng,et al.  Drogue detection for vision-based autonomous aerial refueling via low rank and sparse decomposition with multiple features , 2013 .

[25]  Simon Baker,et al.  Equivalence and efficiency of image alignment algorithms , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[26]  Li Wei,et al.  Vision-based Estimation of Relative Pose in Autonomous Aerial Refueling , 2011 .

[27]  Marcello R. Napolitano,et al.  Comparison of point matching algorithms for the UAV aerial refueling problem , 2010, Machine Vision and Applications.

[28]  Yuan Xie,et al.  Discriminative Object Tracking via Sparse Representation and Online Dictionary Learning , 2014, IEEE Transactions on Cybernetics.

[29]  De Xu,et al.  Online State-Based Structured SVM Combined With Incremental PCA for Robust Visual Tracking , 2015, IEEE Transactions on Cybernetics.

[30]  Mario G. Perhinschi,et al.  Machine Vision/GPS Integration Using EKF for the UAV Aerial Refueling Problem , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[32]  Horst Bischof,et al.  On-line Boosting and Vision , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[33]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Jae Wook Jeon,et al.  Support Local Pattern and its Application to Disparity Improvement and Texture Classification , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Delin Luo,et al.  Pose estimation for UAV aerial refueling with serious turbulences based on extended Kalman filter , 2014 .

[37]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[39]  Guoying Zhao,et al.  BRINT: Binary Rotation Invariant and Noise Tolerant Texture Classification , 2014, IEEE Transactions on Image Processing.

[40]  Rong Xiao,et al.  Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern , 2014, IEEE Trans. Pattern Anal. Mach. Intell..