Learning Future-Aware Correlation Filters for Efficient UAV Tracking

In recent years, discriminative correlation filter (DCF)-based trackers have made considerable progress and drawn widespread attention in the unmanned aerial vehicle (UAV) tracking community. Most existing trackers collect historical information, e.g., training samples, previous filters, and response maps, to promote their discrimination and robustness. Under UAV-specific tracking challenges, e.g., fast motion and view change, variations of both the target and its environment in the new frame are unpredictable. Interfered by future unknown environments, trackers that trained with historical information may be confused by the new context, resulting in tracking failure. In this paper, we propose a novel future-aware correlation filter tracker, i.e., FACF. The proposed method aims at effectively utilizing context information in the new frame for better discriminative and robust abilities, which consists of two stages: future state awareness and future context awareness. In the former stage, an effective time series forecast method is employed to reason a coarse position of the target, which is the reference for obtaining a context patch in the new frame. In the latter stage, we firstly obtain the single context patch with an efficient target-aware method. Then, we train a filter with the future context information in order to perform robust tracking. Extensive experimental results obtained from three UAV benchmarks, i.e., UAV123_10fps, DTB70, and UAVTrack112, demonstrate the effectiveness and robustness of the proposed tracker. Our tracker has comparable performance with other state-of-the-art trackers while running at ∼49 FPS on a single CPU.

[1]  Feifeng Liu,et al.  Efficient Multipath Clutter Cancellation for UAV Monitoring Using DAB Satellite-Based PBR , 2021, Remote. Sens..

[2]  Ziang Cao,et al.  Onboard Real-Time Aerial Tracking With Efficient Siamese Anchor Proposal Network , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Junjie Ye,et al.  All-Day Object Tracking for Unmanned Aerial Vehicle , 2021, IEEE Transactions on Mobile Computing.

[4]  Changhong Fu,et al.  Object Saliency-Aware Dual Regularized Correlation Filter for Real-Time Aerial Tracking , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Chen Feng,et al.  Learning dynamic regression with automatic distractor repression for real-time UAV tracking , 2021, Eng. Appl. Artif. Intell..

[6]  Jiafeng Li,et al.  MultiRPN-DIDNet: Multiple RPNs and Distance-IoU Discriminative Network for Real-Time UAV Target Tracking , 2021, Remote. Sens..

[7]  Wei Huang,et al.  Online Semantic Subspace Learning with Siamese Network for UAV Tracking , 2020, Remote. Sens..

[8]  Geng Lu,et al.  Correlation Filter for UAV-Based Aerial Tracking: A Review and Experimental Evaluation , 2020, ArXiv.

[9]  Changhong Fu,et al.  Learning Temporary Block-Based Bidirectional Incongruity-Aware Correlation Filters for Efficient UAV Object Tracking , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Yiming Li,et al.  Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning , 2019, Remote. Sens..

[11]  Tao Yang,et al.  Image-Only Real-Time Incremental UAV Image Mosaic for Multi-Strip Flight , 2021, IEEE Transactions on Multimedia.

[12]  Junjie Ye,et al.  Disruptor-Aware Interval-Based Response Inconsistency for Correlation Filters in Real-Time Aerial Tracking , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[14]  J. Sherman,et al.  Adjustment of an Inverse Matrix Corresponding to a Change in One Element of a Given Matrix , 1950 .

[15]  Houqiang Li,et al.  Unsupervised Deep Representation Learning for Real-Time Tracking , 2020, International Journal of Computer Vision.

[16]  Josef Kittler,et al.  Learning Adaptive Discriminative Correlation Filters via Temporal Consistency Preserving Spatial Feature Selection for Robust Visual Object Tracking , 2018, IEEE Transactions on Image Processing.

[17]  Ying Li,et al.  Unmanned Aerial Vehicle Object Tracking by Correlation Filter with Adaptive Appearance Model , 2018, Sensors.

[18]  Asyraf Afthanorhan,et al.  A comparison between single exponential smoothing (SES), double exponential smoothing (DES), holt's (brown) and adaptive response rate exponential smoothing (ARRES) techniques in forecasting Malaysia population , 2014 .

[19]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jin Tang,et al.  Learning spatio-temporal correlation filter for visual tracking , 2021, Neurocomputing.

[21]  Ning Wang,et al.  Real-Time Correlation Tracking Via Joint Model Compression and Transfer , 2019, IEEE Transactions on Image Processing.

[22]  Yiming Li,et al.  Intermittent Contextual Learning for Keyfilter-Aware UAV Object Tracking Using Deep Convolutional Feature , 2020, IEEE Transactions on Multimedia.

[23]  Le Zhang,et al.  Robust visual tracking via co-trained Kernelized correlation filters , 2017, Pattern Recognit..

[24]  Changhong Fu,et al.  Surrounding-aware correlation filter for UAV tracking with selective spatial regularization , 2020, Signal Process..

[25]  Chenggang Clarence Yan,et al.  Mining Spatial-Temporal Similarity for Visual Tracking , 2020, IEEE Transactions on Image Processing.

[26]  Josef Kittler,et al.  Robust Visual Object Tracking Via Adaptive Attribute-Aware Discriminative Correlation Filters , 2021, IEEE Transactions on Multimedia.