REAL-TIME TRACKING IN SATELLITE VIDEOS VIA JOINT DISCRIMINATION AND POSE ESTIMATION

Abstract. Object tracking has gained much attention in the field of computer vision and intelligent traffic analysis. Satellite videos are more suitable for long-distance tracking comparing to the road traffic videos. However, most of the state-of-the-art methods produce poor results when applied to satellite videos, due to low resolution of the small target and interference from similar background in satellite videos. In this paper, we present an improved Discriminative Correlation Filter based approach specifically tailored for small objects tracking in satellite videos through applying spatial weight in the filter and estimating the pose by Kalman filter. First, a spatial mask is introduced to encourage the final filter to give different contributions depending on the spatial distance. Furthermore, Kalman filter is incorporated into the approach with the aim of predicting the position when the target run into the large area similar background region. Finally, an efficient strategy for combining the improved DCF tracker and pose estimation is proposed. Experimental results on three satellite videos describing the traffic conditions of three cities demonstrate that the proposed approach can effectively track the targets even though the targets are similar to the background region in a period of time. Compare with other state-of-the-art methods, the final accuracies and speeds of our method achieve the best.

[1]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ming-Hsuan Yang,et al.  Long-term correlation tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Félix F. González-Navarro,et al.  Methodology for Automatic Collection of Vehicle Traffic Data by Object Tracking , 2016, MICAI.

[5]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Luca Bertinetto,et al.  End-to-End Representation Learning for Correlation Filter Based Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Haichao Li,et al.  Moving ship detection based on visual saliency for video satellite , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[9]  Simon Lucey,et al.  Correlation filters with limited boundaries , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Jiri Matas,et al.  Robust scale-adaptive mean-shift for tracking , 2013, Pattern Recognit. Lett..

[11]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[12]  Sandeep Kumar Patel,et al.  Moving Object Tracking Techniques: A Critical Review , 2013 .

[13]  S. Y. Chen,et al.  Kalman Filter for Robot Vision: A Survey , 2012, IEEE Transactions on Industrial Electronics.

[14]  Michael Felsberg,et al.  Convolutional Features for Correlation Filter Based Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[15]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Michael Felsberg,et al.  ECO: Efficient Convolution Operators for Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Neil M. Robertson,et al.  Tracking with intent , 2014, 2014 Sensor Signal Processing for Defence (SSPD).

[18]  Qian Du,et al.  Object Tracking in Satellite Videos by Fusing the Kernel Correlation Filter and the Three-Frame-Difference Algorithm , 2018, IEEE Geoscience and Remote Sensing Letters.

[19]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[20]  Zhenyu He,et al.  Robust Object Tracking via Key Patch Sparse Representation , 2017, IEEE Transactions on Cybernetics.

[21]  Zhongyuan Wang,et al.  Super-Resolution for “Jilin-1” Satellite Video Imagery via a Convolutional Network , 2018, Sensors.

[22]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[24]  Jiri Matas,et al.  Discriminative Correlation Filter with Channel and Spatial Reliability , 2017, CVPR.

[25]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.