The Visual Object Tracking VOT2017 Challenge Results

The Visual Object Tracking challenge VOT2017 is the fifth annual tracker benchmarking activity organized by the VOT initiative. Results of 51 trackers are presented; many are state-of-the-art published at major computer vision conferences or journals in recent years. The evaluation included the standard VOT and other popular methodologies and a new “real-time” experiment simulating a situation where a tracker processes images as if provided by a continuously running sensor. Performance of the tested trackers typically by far exceeds standard baselines. The source code for most of the trackers is publicly available from the VOT page. The VOT2017 goes beyond its predecessors by (i) improving the VOT public dataset and introducing a separate VOT2017 sequestered dataset, (ii) introducing a realtime tracking experiment and (iii) releasing a redesigned toolkit that supports complex experiments. The dataset, the evaluation kit and the results are publicly available at the challenge website.

Li | Michael Felsberg | Fahad Shahbaz Khan | Changsheng Xu | Qingming Huang | Wenbing Tao | Jiri Matas | Titus Zaharia | Guan Huang | Qifeng Yu | Alfredo Petrosino | Martin Danelljan | Gustav Häger | Luca Bertinetto | Sunglok Choi | Abdelrahman Eldesokey | Junliang Xing | Philip H. S. Torr | Ruxandra Tapu | Matej Kristan | Kannappan Palaniappan | Wengang Zhou | Weiming Hu | Junyu Gao | Siwei Lyu | Antoine Manzanera | Wei Zou | Vincenzo Santopietro | Jianke Zhu | Ming-Hsuan Yang | Zhu | João F. Henriques | Longyin Wen | Richard Bowden | Dawei Du | Liu | Aleš Leonardis | Lingxiao Yang | Boyu Chen | Chong Sun | Chang Huang | Lei | Erhan Gundogdu | Ning | Huchuan Lu | Bogdan Mocanu | Jae-chan Jeong | Zhipeng Zhang | Stuart Golodetz | Xiao Bian | Karel Lebeda | Ondrej Miksik | Matthias Mueller | Mahdieh Poostchi | Simon Hadfield | Isabela Drummond | Ke Gao | Dalong Du | Pedro Senna | Goutam Bhat | Zheng | Gustavo Fernández | Alireza Memarmoghadam | Erik Velasco-Salido | Francesco Battistone | Jin Gao | Ji-Wan Kim | Junfei Zhuang | Kai Chen | Mengdan Zhang | Nianhao Xie | Xianguo Yu | Yang Li | Roman Pflugfelder | Wenbo | Mishra | Qiang Wang | Zhang | Kris M. Kitani | Ri-sheng | P. Moallem | Alan Lukežič | Guna | Luka Čehovin | Tianzhu | Vedaldi | Gorthi R K Sai Subrahmanyam | Tomáš Vojı́r̃ | Houqiang Li | Lijun Wang | Hongliang Zhang | Jingyu Liu | A. Leonardis | Longyin Wen | M. Felsberg | Martin Danelljan | R. Bowden | Jiri Matas | Siwei Lyu | Ming-Hsuan Yang | F. Khan | Huchuan Lu | Luca Bertinetto | Chang Huang | Dalong Du | Jianke Zhu | Hongliang Zhang | Qifeng Yu | A. Manzanera | Wen-gang Zhou | Changsheng Xu | Lijun Wang | Houqiang Li | Goutam Bhat | O. Miksik | Kris Kitani | Wei Zou | Weiming Hu | M. Kristan | Tomás Vojír | R. Pflugfelder | G. Fernandez | Luka Cehovin | A. Petrosino | Jin Gao | Junliang Xing | Gustav Häger | A. Lukežič | Alireza Memarmoghadam | A. Alatan | Chong Sun | Dawei Du | Erhan Gundogdu | Francesco Battistone | G. Subrahmanyam | G. Bastos | I. Drummond | Jae-chan Jeong | J. Cho | Jae-Y. Lee | Ji-Wan Kim | Junyu Gao | K. Palaniappan | K. Lebeda | Ke Gao | M. Poostchi | Matthias Mueller | Mengdan Zhang | P. Moallem | P. Senna | Qingming Huang | Rafael Martin-Nieto | Simon Hadfield | S. Golodetz | Sunglok Choi | V. Santopietro | A. Eldesokey | A. Muhic | Antoine Tran | B. Mocanu | Boyu Chen | Erik Velasco-Salido | Guan Huang | J. Noskova | Jingyu Liu | Junfei Zhuang | Kai Chen | Lingxiao Yang | Nianhao Xie | Ruxandra Tapu | T. Zaharia | Wenbing Tao | Xianguo Yu | Xiao Bian | Yifan Xing | Yingruo Fan | Zhipeng Zhang | Zhiqun He | Seetharaman | Wang | Deepak | Zajc | Andrea | David Zhang | Jack | Valmadre | M. PallaviVenugopal | Q. Wang | Yang Li | A. Muhic | Antoine Tran | Aydın Alatan | David Zhang | Guilherme Bastos | Jae-il Cho | Jae-Yeong Lee | Jana Noskova | M PallaviVenugopal | Rafael Martı́n-Nieto | Risheng | Yifan Xing | Yingruo Fan | Zhiqun He | O. Mikšík | Qiang Wang | G. R. S. Subrahmanyam | Rafael Martín-Nieto | Li | Abdelrahman Eldesokey | Mahdieh Poostchi

[1]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[2]  Michael Felsberg,et al.  ECO: Efficient Convolution Operators for Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Guna Seetharaman,et al.  Efficient GPU Implementation of the Integral Histogram , 2012, ACCV Workshops.

[4]  Jiri Matas,et al.  Discriminative Correlation Filter with Channel and Spatial Reliability , 2017, CVPR.

[5]  Ales Leonardis,et al.  Robust visual tracking using template anchors , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[6]  Cordelia Schmid,et al.  Learning Color Names for Real-World Applications , 2009, IEEE Transactions on Image Processing.

[7]  Isabela Drummond,et al.  Real-Time Ensemble-Based Tracker with Kalman Filter , 2017, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[8]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Matej Kristan,et al.  Deformable Parts Correlation Filters for Robust Visual Tracking , 2016, IEEE Transactions on Cybernetics.

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  Jiri Matas,et al.  Tracking the Untrackable: How to Track When Your Object Is Featureless , 2012, ACCV Workshops.

[12]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Ming-Hsuan Yang,et al.  Learning Spatial-Aware Regressions for Visual Tracking , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  J.M. Ferryman,et al.  PETS Metrics: On-Line Performance Evaluation Service , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[15]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Qifeng Yu,et al.  Online structural learning with dense samples and a weighting kernel , 2017, Pattern Recognit. Lett..

[17]  Jiri Matas,et al.  Robust scale-adaptive mean-shift for tracking , 2013, Pattern Recognit. Lett..

[18]  Roman P. Pflugfelder,et al.  Clustering of static-adaptive correspondences for deformable object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Michael Felsberg,et al.  Convolutional Features for Correlation Filter Based Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[21]  Luka Cehovin TraX: The visual Tracking eXchange protocol and library , 2017, Neurocomputing.

[22]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[23]  Francesco Solera,et al.  Towards the evaluation of reproducible robustness in tracking-by-detection , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[24]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[25]  Xiaogang Wang,et al.  Visual Tracking with Fully Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  Haibin Ling,et al.  Real time robust L1 tracker using accelerated proximal gradient approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[28]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Bernard Ghanem,et al.  A Benchmark and Simulator for UAV Tracking , 2016, ECCV.

[30]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Ales Leonardis,et al.  Visual Object Tracking Performance Measures Revisited , 2015, IEEE Transactions on Image Processing.

[32]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Stan Sclaroff,et al.  MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization , 2014, ECCV.

[34]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Luca Bertinetto,et al.  End-to-End Representation Learning for Correlation Filter Based Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Changsheng Xu,et al.  Correlation Particle Filter for Visual Tracking , 2018, IEEE Transactions on Image Processing.

[38]  Michael Felsberg,et al.  A thermal Object Tracking benchmark , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[39]  Jing Zhang,et al.  Framework for Performance Evaluation of Face, Text, and Vehicle Detection and Tracking in Video: Data, Metrics, and Protocol , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[41]  Jiri Matas,et al.  Pixel-Wise Object Segmentations for the VOT 2016 Dataset , 2017 .

[42]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[43]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[44]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Bernard Ghanem,et al.  Context-Aware Correlation Filter Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Silvio Savarese,et al.  Learning to Track at 100 FPS with Deep Regression Networks , 2016, ECCV.

[47]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[48]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Erik Blasch,et al.  Encoding color information for visual tracking: Algorithms and benchmark , 2015, IEEE Transactions on Image Processing.

[50]  Guna Seetharaman,et al.  Feature selection for appearance-based vehicle tracking in geospatial video , 2013, Defense, Security, and Sensing.

[51]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  A. Aydın Alatan,et al.  Good Features to Correlate for Visual Tracking , 2017, IEEE Transactions on Image Processing.

[53]  Antoine Manzanera,et al.  Mixing Hough and Color Histogram Models for Accurate Real-Time Object Tracking , 2017, CAIP.

[54]  Michael Felsberg,et al.  The Visual Object Tracking VOT2013 Challenge Results , 2013, ICCV 2013.

[55]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Changsheng Xu,et al.  Multi-task Correlation Particle Filter for Robust Object Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Michael Felsberg,et al.  The Thermal Infrared Visual Object Tracking VOT-TIR2015 Challenge Results , 2015, ICCV Workshops.

[58]  Ales Leonardis,et al.  Is my new tracker really better than yours? , 2014, IEEE Winter Conference on Applications of Computer Vision.

[59]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Wenbing Tao,et al.  Convolutional Regression for Visual Tracking , 2016, IEEE Transactions on Image Processing.

[61]  Uwe D. Hanebeck,et al.  Template matching using fast normalized cross correlation , 2001, SPIE Defense + Commercial Sensing.

[62]  Shuicheng Yan,et al.  NUS-PRO: A New Visual Tracking Challenge , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Qiang Wang,et al.  DCFNet: Discriminant Correlation Filters Network for Visual Tracking , 2017, ArXiv.

[64]  Ales Leonardis,et al.  Beyond Standard Benchmarks: Parameterizing Performance Evaluation in Visual Object Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[65]  Zhenyu He,et al.  The Visual Object Tracking VOT2016 Challenge Results , 2016, ECCV Workshops.

[66]  Jiri Matas,et al.  A Novel Performance Evaluation Methodology for Single-Target Trackers , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Jiri Matas,et al.  The Enhanced Flock of Trackers , 2014, Registration and Recognition in Images and Videos.

[68]  Stefan Roth,et al.  MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking , 2015, ArXiv.

[69]  Michael Felsberg,et al.  Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking , 2016, ECCV.

[70]  Jae-Yeong Lee,et al.  Visual tracking by partition-based histogram backprojection and maximum support criteria , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[71]  Ales Leonardis,et al.  Robust Visual Tracking Using an Adaptive Coupled-Layer Visual Model , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[72]  José María Martínez Sanchez,et al.  Single Object Long-term Tracker for Smart Control of a PTZ camera , 2014, ICDSC.

[73]  Jiri Matas,et al.  Texture-Independent Long-Term Tracking Using Virtual Corners , 2016, IEEE Transactions on Image Processing.

[74]  Guna Seetharaman,et al.  Spatial pyramid context-aware moving vehicle detection and tracking in urban aerial imagery , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).