Object Tracking in Satellite Videos Based on a Lightweight Network

Object tracking is a hot topic in computer vision. The significantly developed satellite video technology makes object tracking in satellite videos possible. In recent years, Convolutional Neural Network (CNN)-based trackers have achieved satisfying performance in the visual object tracking field. However, CNN cannot be directly applied to object tracking in satellite videos due to the following two reasons. First, the feature map size generally decreases as the network layer deepens, which is unsuitable for the small targets in satellite videos. Second, CNN-based trackers commonly need extensive data to train the network parameters, while few labeled satellite videos are available. Therefore, in this paper, we design a lightweight network for the satellite video tracking task. On one hand, the network generates a response map with the same size as the input image and reserves the spatial resolution of targets. On the other hand, the network parameters are transferred from an existing network and trained with the initial annotated frame, thus no extra data are needed. To make a fair comparison between existing trackers, we further propose a simulated benchmark based on the UAV123 dataset according to the imaging characteristics of satellite videos. Experiments are conducted to compare our method with other state-of-the-art trackers on both the simulated benchmark and real satellite videos and experimental results demonstrate the superiority of our proposed algorithm.

[1]  Fatih Porikli,et al.  Robust visual tracking with channel attention and focal loss , 2020, Neurocomputing.

[2]  Junlong Zhou,et al.  Security-Critical Energy-Aware Task Scheduling for Heterogeneous Real-Time MPSoCs in IoT , 2020, IEEE Transactions on Services Computing.

[3]  Dongdong Li,et al.  When Correlation Filters Meet Siamese Networks for Real-Time Complementary Tracking , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Wei Jiang,et al.  Energy-Aware Design of Stochastic Applications With Statistical Deadline and Reliability Guarantees , 2019, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[5]  Gongjian Wen,et al.  Learning Padless Correlation Filters for Boundary-Effect Free Tracking , 2018, IEEE Sensors Journal.

[6]  Qian Du,et al.  Object Tracking in Satellite Videos by Fusing the Kernel Correlation Filter and the Three-Frame-Difference Algorithm , 2018, IEEE Geoscience and Remote Sensing Letters.

[7]  Mohammed Bennamoun,et al.  Scale space clustering evolution for salient region detection on 3D deformable shapes , 2017, Pattern Recognit..

[8]  Nikos Paragios,et al.  Multitemporal Very High Resolution From Space: Outcome of the 2016 IEEE GRSS Data Fusion Contest , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[10]  Zhenyu He,et al.  Robust Object Tracking via Key Patch Sparse Representation , 2017, IEEE Transactions on Cybernetics.

[11]  Erik Blasch,et al.  Encoding color information for visual tracking: Algorithms and benchmark , 2015, IEEE Transactions on Image Processing.

[12]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Tara N. Sainath,et al.  Deep Convolutional Neural Networks for Large-scale Speech Tasks , 2015, Neural Networks.

[14]  A. Smeulders,et al.  Ieee Transaction on Pattern Analysis and Machine Intelligence 1 Visual Tracking: an Experimental Survey Ieee Transaction on Pattern Analysis and Machine Intelligence , 2022 .

[15]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  John P. Kerekes,et al.  Object Tracking Using High Resolution Satellite Imagery , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  M. Shah,et al.  Object tracking: A survey , 2006, CSUR.

[18]  Anand Singh Jalal,et al.  The State-of-the-Art in Visual Object Tracking , 2012, Informatica.