Performance evaluation of low resolution visual tracking for unmanned aerial vehicles

Several datasets for unmanned aerial vehicle (UAV) visual tracking research have been released in recent years. Despite their usefulness, whether they are sufficient for understanding the strengths and weakness of different resolution videos tracking remains questionable. Tracking in low resolution videos is a critical problem in UAV tracking. To address this issue, we construct a group of low resolution tracking datasets and study the performance of different trackers on these datasets. We find that some trackers suffered more performance degradation than others, which brings to light a previously unexplored aspect of the tracking methods. The relative rank of these trackers based on their tracking results on the datasets may change in the presence of low resolution. Based on these findings, we develop a multiple feature tracking framework which takes advantage of image enhancement scheme to improve image quality. In addition, we utilize the forward and backward tracking to evaluate multiple feature tracking results. Experimental results demonstrate that our tracker is competitive in performance to state-of-the-art methods in different resolutions scenarios. We believe our studies can provide a solid baseline when conducting experiments for low resolution UAV tracking research.

[1]  Qi Tian,et al.  The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking , 2018, ECCV.

[2]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Hao Shen,et al.  Trace Quotient with Sparsity Priors for Learning Low Dimensional Image Representations , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Yu Li,et al.  Mutually Guided Image Filtering , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Chun Yuan,et al.  Robust Visual Tracking in Low-Resolution Sequence , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[7]  Robert T. Collins,et al.  An Open Source Tracking Testbed and Evaluation Web Site , 2005 .

[8]  Michael Felsberg,et al.  ECO: Efficient Convolution Operators for Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[10]  Bernard Ghanem,et al.  A Benchmark and Simulator for UAV Tracking , 2016, ECCV.

[11]  Yong Wang,et al.  Hard negative mining for correlation filters in visual tracking , 2019, Machine Vision and Applications.

[12]  Ning Wang,et al.  Reliable Re-Detection for Long-Term Tracking , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Fan Yang,et al.  LaSOT: A High-Quality Benchmark for Large-Scale Single Object Tracking , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Leida Li,et al.  Performance Evaluation of Visual Tracking Algorithms on Video Sequences With Quality Degradation , 2017, IEEE Access.

[15]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Han-Ul Kim,et al.  SOWP: Spatially Ordered and Weighted Patch Descriptor for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[17]  Yong Wang,et al.  Deep Convolutional Correlation Filters for Forward-Backward Visual Tracking , 2018, ISVC.

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  Qingming Huang,et al.  Hedged Deep Tracking , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Shuicheng Yan,et al.  Scale-Aware Fast R-CNN for Pedestrian Detection , 2015, IEEE Transactions on Multimedia.

[23]  Yong Wang,et al.  Scale-Aware RPN for Vehicle Detection , 2018, ISVC.

[24]  Yong Wang,et al.  Visual tracking based on group sparsity learning , 2014, Machine Vision and Applications.

[25]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jin Tang,et al.  RGB-T Object Tracking: Benchmark and Baseline , 2018, Pattern Recognit..

[28]  Michael Felsberg,et al.  The Visual Object Tracking VOT2015 Challenge Results , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[29]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Simon Lucey,et al.  Learning Background-Aware Correlation Filters for Visual Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[31]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Kang Li,et al.  Effective Guided Image Filtering for Contrast Enhancement , 2018, IEEE Signal Processing Letters.

[33]  Nan Jiang,et al.  Discriminative Metric Preservation for Tracking Low-Resolution Targets , 2012, IEEE Transactions on Image Processing.

[34]  Zhenyu He,et al.  The Visual Object Tracking VOT2016 Challenge Results , 2016, ECCV Workshops.

[35]  Dit-Yan Yeung,et al.  Visual Object Tracking for Unmanned Aerial Vehicles: A Benchmark and New Motion Models , 2017, AAAI.

[36]  Qi Tian,et al.  Multi-cue Correlation Filters for Robust Visual Tracking , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[37]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Erik Blasch,et al.  Encoding color information for visual tracking: Algorithms and benchmark , 2015, IEEE Transactions on Image Processing.

[39]  Feng Li,et al.  Learning Spatial-Temporal Regularized Correlation Filters for Visual Tracking , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[40]  Michael Felsberg,et al.  Discriminative Scale Space Tracking , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Liang Lin,et al.  Visual Tracking via Dynamic Graph Learning , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Qinghua Hu,et al.  Vision Meets Drones: A Challenge , 2018, ArXiv.

[43]  Michael Felsberg,et al.  Adaptive Decontamination of the Training Set: A Unified Formulation for Discriminative Visual Tracking , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).