The Sixth Visual Object Tracking VOT2018 Challenge Results

The Visual Object Tracking challenge VOT2018 is the sixth annual tracker benchmarking activity organized by the VOT initiative. Results of over eighty trackers are presented; many are state-of-the-art trackers published at major computer vision conferences or in journals in the recent years. The evaluation included the standard VOT and other popular methodologies for short-term tracking analysis and a “real-time” experiment simulating a situation where a tracker processes images as if provided by a continuously running sensor. A long-term tracking subchallenge has been introduced to the set of standard VOT sub-challenges. The new subchallenge focuses on long-term tracking properties, namely coping with target disappearance and reappearance. A new dataset has been compiled and a performance evaluation methodology that focuses on long-term tracking capabilities has been adopted. The VOT toolkit has been updated to support both standard short-term and the new long-term tracking subchallenges. Performance of the tested trackers typically by far exceeds standard baselines. The source code for most of the trackers is publicly available from the VOT page. The dataset, the evaluation kit and the results are publicly available at the challenge website (http://votchallenge.net).

Michael Felsberg | Huchuan Lu | Fahad Shahbaz Khan | Joost van de Weijer | Yan Lu | Jiri Matas | Yee Wei Law | Feng Li | Chong Luo | Houqiang Li | Wenjun Zeng | Hyemin Lee | Álvaro García-Martín | Arnold W. M. Smeulders | Haojie Li | Yan Li | Xiao-Jun Wu | Mohamed H. Abdelpakey | Horst Possegger | Zheng Zhang | Fan Yang | Ning Wang | José María Martínez Sanchez | Martin Danelljan | Luca Bertinetto | Roman P. Pflugfelder | Andrea Vedaldi | Yiannis Demiris | Ales Leonardis | Hyung Jin Chang | Jin Young Choi | Ming Tang | Josef Kittler | Abdelrahman Eldesokey | Fei Zhao | Jinqiao Wang | A. Aydin Alatan | Xinmei Tian | Philip H. S. Torr | Cheng Tian | Matej Kristan | Yuhong Li | Deming Chen | Efstratios Gavves | Junyu Gao | Changick Kim | Ran Tao | Jing Li | Vincenzo Santopietro | Ming-Hsuan Yang | Lijun Wang | Lichao Zhang | Honggang Zhang | Klemen Grm | Vitomir Struc | Changsheng Xu | Dong Wang | Haibin Ling | Yifan Jiao | Liu Si | João F. Henriques | Hamed Kiani Galoogahi | Qiang Wang | Jinqing Qi | Richard Bowden | Rama Krishna Sai Subrahmanyam Gorthi | Sangdoo Yun | Lingxiao Yang | Boyu Chen | Peixia Li | Jack Valmadre | Wei Wu | Gorthi R. K. Sai Subrahmanyam | Bo Li | Payman Moallem | Erhan Gundogdu | Litu Rout | Tianzhu Zhang | Hui Zhi | Heng Fan | Shuangping Huang | Cong Hao | Wei Feng | Ondrej Miksik | Wangmeng Zuo | Yuxuan Sun | Daijin Kim | Siwen Wang | Zhihui Wang | Xiaofan Zhang | Zheng Zhu | Tomás Vojír | Simon Hadfield | Isabela Drummond | Andrej Muhic | Qin Zhou | Wei Zou | Haojie Zhao | Weiming Hu | Luka Cehovin Zajc | Joakim Johnander | Pedro Senna | Mohamed Shehata | Anfeng He | Stuart Golodetz | Goutam Bhat | Deepak Mishra | Xiaohe Wu | Asanka G. Perera | Alan Lukezic | Wei Wang | Changzhen Xiong | Alfredo Petrosino | Gustavo Fernández | Alireza Memarmoghadam | Chong Sun | Erik Velasco-Salido | Francesco Battistone | Guilherme Sousa Bastos | Junfei Zhuang | Rafael Martin Nieto | Wengang Zhou | Zhiqun He | Namhoon Lee | Javaan Singh Chahl | Jongwon Choi | Sihang Wu | Richard Everson | Priya Mariam Raju | Seokeon Choi | George De Ath | Ruihe Qian | Runling Wang | Huiyun Li | Mario Edoardo Maresca | Álvaro Iglesias-Arias | Abel González-García | Dongyoon Wee | Hankyeol Lee | Jaime Spencer Martin | Jinyoung Sung | Jorge Rodríguez Herranz | Lutao Chu | Manqiang Che | Myunggu Kang | Pablo Vicente-Moñivar | Qing Guo | Sergio Vivas | Shuai Bai | Tianyang Xu | Tobias Fischer | Yi Wu | Yicai Yang | Yunhua Zhang | Zhen-Hua Feng | A. Vedaldi | A. Leonardis | A. Smeulders | M. Felsberg | Martin Danelljan | R. Bowden | Jiri Matas | Haibin Ling | Ming-Hsuan Yang | J. Kittler | F. Khan | Huchuan Lu | Y. Demiris | Luca Bertinetto | Jack Valmadre | Bo Li | Namhoon Lee | Xinmei Tian | R. Everson | W. Zuo | J. Chahl | Haojie Li | Deming Chen | Chong Luo | V. Štruc | E. Gavves | Wen-gang Zhou | Changsheng Xu | Daijin Kim | Lijun Wang | Abel Gonzalez-Garcia | Houqiang Li | Tianzhu Zhang | Goutam Bhat | R. Tao | Jinqiao Wang | Wei Zou | Weiming Hu | M. Kristan | Tomás Vojír | R. Pflugfelder | G. Fernandez | A. Petrosino | M. Maresca | Zhenhua Feng | J. Sanchez | Heng Fan | A. Lukežič | Alireza Memarmoghadam | Álvaro García-Martín | Chong Sun | Deepak Mishra | Erhan Gundogdu | Fei Zhao | Francesco Battistone | G. Bastos | Horst Possegger | Hyemin Lee | I. Drummond | J. Choi | Jongwon Choi | Junyu Gao | P. Moallem | P. Senna | Simon Hadfield | S. Golodetz | V. Santopietro | A. Eldesokey | A. Muhic | Aydin Alatan | Boyu Chen | Erik Velasco-Salido | Junfei Zhuang | Lingxiao Yang | Ning Wang | R. Nieto | Zhengyu Zhu | Zhiqun He | Qing Guo | Wei Feng | Changick Kim | Xiaohe Wu | Yunhua Zhang | Klemen Grm | Zheng Zhang | Ming Tang | Tobias Fischer | Xiaojun Wu | Honggang Zhang | Joakim Johnander | Sangdoo Yun | M. Shehata | Dong Wang | Haojie Zhao | Seokeon Choi | Huiyun Li | Jinqing Qi | Siwen Wang | Wei Wang | Changzhen Xiong | W. Zeng | Yi Wu | Litu Rout | Dongyoon Wee | Peixia Li | Cong Hao | Yuhong Li | Jing Li | Xiaofan Zhang | Shuai Bai | O. Mikšík | Zhihui Wang | Qiang Wang | Feng Li | Yuxuan Sun | Lichao Zhang | G. R. S. Subrahmanyam | Shuangping Huang | H. Chang | Tianyang Xu | Ruihe Qian | L. Č. Zajc | Rama Krishna Sai Subrahmanyam Gorthi | Yifan Jiao | Anfeng He | Wei Wu | Álvaro Iglesias-Arias | Cheng Tian | Fan Yang | Hankyeol Lee | Hui Zhi | Jaime Spencer Martin | Jinyoung Sung | J. Herranz | Liu Si | Lutao Chu | Manqiang Che | M. Kang | Pablo Vicente-Moñivar | Qin Zhou | Runling Wang | Sergio Vivas | Sihang Wu | Yan Li | Yan Lu | Yicai Yang | Abdelrahman Eldesokey

[1]  Michael Felsberg,et al.  ECO: Efficient Convolution Operators for Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Haibin Ling,et al.  Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  A. Aydın Alatan,et al.  Good Features to Correlate for Visual Tracking , 2017, IEEE Transactions on Image Processing.

[4]  Thomas Mauthner,et al.  In defense of color-based model-free tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jiri Matas,et al.  Discriminative Correlation Filter with Channel and Spatial Reliability , 2017, CVPR.

[6]  Bernard Ghanem,et al.  A Benchmark and Simulator for UAV Tracking , 2016, ECCV.

[7]  Chun Chen,et al.  A Convolutional Treelets Binary Feature Approach to Fast Keypoint Recognition , 2012, ECCV.

[8]  Haibin Ling,et al.  Real time robust L1 tracker using accelerated proximal gradient approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Arnold W. M. Smeulders,et al.  Long-term Tracking in the Wild: A Benchmark , 2018, ECCV.

[11]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Ales Leonardis,et al.  Beyond Standard Benchmarks: Parameterizing Performance Evaluation in Visual Object Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Maja Pantic,et al.  Mobile Face Tracking: A Survey and Benchmark , 2018 .

[14]  Zhe Chen,et al.  MUlti-Store Tracker (MUSTer): A cognitive psychology inspired approach to object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Jiri Matas,et al.  Robust scale-adaptive mean-shift for tracking , 2013, Pattern Recognition Letters.

[16]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[17]  Ales Leonardis,et al.  Robust visual tracking using template anchors , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[18]  Jiri Matas,et al.  The Enhanced Flock of Trackers , 2014, Registration and Recognition in Images and Videos.

[19]  Alfredo Petrosino,et al.  Watch Out: Embedded Video Tracking with BST for Unmanned Aerial Vehicles , 2018, J. Signal Process. Syst..

[20]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Bernard Ghanem,et al.  TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild , 2018, ECCV.

[22]  Michael Felsberg,et al.  The Thermal Infrared Visual Object Tracking VOT-TIR2015 Challenge Results , 2015, ICCV Workshops.

[23]  Chong Luo,et al.  Towards a Better Match in Siamese Network Based Visual Object Tracker , 2018, ECCV Workshops.

[24]  Cordelia Schmid,et al.  Learning Color Names for Real-World Applications , 2009, IEEE Transactions on Image Processing.

[25]  Jiri Matas,et al.  A Novel Performance Evaluation Methodology for Single-Target Trackers , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Josef Kittler,et al.  Learning Adaptive Discriminative Correlation Filters via Temporal Consistency Preserving Spatial Feature Selection for Robust Visual Object Tracking , 2018, IEEE Transactions on Image Processing.

[27]  Michael Felsberg,et al.  The Visual Object Tracking VOT2015 Challenge Results , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[28]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[29]  Stefan Roth,et al.  MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking , 2015, ArXiv.

[30]  Hyemin Lee,et al.  Salient Region-Based Online Object Tracking , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[31]  Ming-Hsuan Yang,et al.  Learning Spatial-Aware Regressions for Visual Tracking , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[32]  Luka Cehovin TraX: The visual Tracking eXchange protocol and library , 2017, Neurocomputing.

[33]  Alberto Del Bimbo,et al.  Object Tracking by Oversampling Local Features , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Michael Felsberg,et al.  Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking , 2016, ECCV.

[35]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[36]  Simon Lucey,et al.  Need for Speed: A Benchmark for Higher Frame Rate Object Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[37]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Song Wang,et al.  Learning Dynamic Siamese Network for Visual Object Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[39]  Erik Blasch,et al.  Encoding color information for visual tracking: Algorithms and benchmark , 2015, IEEE Transactions on Image Processing.

[40]  Vineet Gandhi,et al.  Long-Term Visual Object Tracking Benchmark , 2017, ACCV.

[41]  Francesco Solera,et al.  Towards the evaluation of reproducible robustness in tracking-by-detection , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[42]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[43]  R. C. Atkinson,et al.  HUMAN MEMORY: A PROPOSED SYSTEM AND ITS CONTROL PROCESSES1 , 1977 .

[44]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[45]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[46]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Xin Pan,et al.  YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Video , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Ales Leonardis,et al.  Robust Visual Tracking Using an Adaptive Coupled-Layer Visual Model , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Isabela Drummond,et al.  Real-Time Ensemble-Based Tracker with Kalman Filter , 2017, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[50]  Luca Bertinetto,et al.  End-to-End Representation Learning for Correlation Filter Based Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Yang Li,et al.  YES NO Cartesian Update Update Feature Extraction Feature Extraction Phase Correlation Resample Min Eq . 3 ? Fourier spaceLog-Polar Cross Correlation Model Fourier space Model Sample Sample , 2018 .

[52]  Jiri Matas,et al.  Long-Term Tracking through Failure Cases , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[53]  Yang Li,et al.  Effective Occlusion Handling for Fast Correlation Filter-based Trackers , 2018, International Journal of Electrical, Electronics and Computers.

[54]  Qiang Wang,et al.  DCFNet: Discriminant Correlation Filters Network for Visual Tracking , 2017, ArXiv.

[55]  Ming-Hsuan Yang,et al.  Long-term correlation tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Michael Felsberg,et al.  Discriminative Scale Space Tracking , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Feng Li,et al.  Learning Spatial-Temporal Regularized Correlation Filters for Visual Tracking , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[58]  Alfredo Petrosino,et al.  Clustering Local Motion Estimates for Robust and Efficient Object Tracking , 2014, ECCV Workshops.

[59]  Michael Felsberg,et al.  The Visual Object Tracking VOT2017 Challenge Results , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[60]  Chong Luo,et al.  A Twofold Siamese Network for Real-Time Object Tracking , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[61]  Jiri Matas,et al.  FCLT - A Fully-Correlational Long-Term Tracker , 2017, ArXiv.

[62]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[63]  Qinghua Hu,et al.  Vision Meets Drones: A Challenge , 2018, ArXiv.

[64]  Jiri Matas,et al.  Now you see me: evaluating performance in long-term visual tracking , 2018, ArXiv.

[65]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[66]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[67]  Mohamed S. Shehata,et al.  DensSiam: End-to-End Densely-Siamese Network with Self-Attention Model for Object Tracking , 2018, ISVC.

[68]  José María Martínez Sanchez,et al.  Single Object Long-term Tracker for Smart Control of a PTZ camera , 2014, ICDSC.

[69]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[70]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[71]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[72]  Richard Everson,et al.  Part-Based Tracking by Sampling , 2018, ArXiv.

[73]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[74]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[75]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[76]  Hongdong Li,et al.  Tracking Randomly Moving Objects on Edge Box Proposals , 2015, ArXiv.

[77]  Changsheng Xu,et al.  Learning Multi-Task Correlation Particle Filters for Visual Tracking , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[79]  Arnold W. M. Smeulders,et al.  Tracking for Half an Hour , 2017, ArXiv.

[80]  Ales Leonardis,et al.  Visual Object Tracking Performance Measures Revisited , 2015, IEEE Transactions on Image Processing.

[81]  Roman P. Pflugfelder,et al.  Clustering of static-adaptive correspondences for deformable object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[82]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  Wei Wu,et al.  High Performance Visual Tracking with Siamese Region Proposal Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[84]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[85]  Zhenyu He,et al.  The Visual Object Tracking VOT2016 Challenge Results , 2016, ECCV Workshops.

[86]  Shuicheng Yan,et al.  NUS-PRO: A New Visual Tracking Challenge , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[87]  Wei Wu,et al.  Distractor-aware Siamese Networks for Visual Object Tracking , 2018, ECCV.

[88]  J.M. Ferryman,et al.  PETS Metrics: On-Line Performance Evaluation Service , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[89]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[90]  Jiri Matas,et al.  Robust scale-adaptive mean-shift for tracking , 2013, Pattern Recognit. Lett..

[91]  Michael Felsberg,et al.  Unveiling the Power of Deep Tracking , 2018, ECCV.

[92]  Stan Sclaroff,et al.  MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization , 2014, ECCV.

[93]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[94]  Simon Lucey,et al.  Learning Background-Aware Correlation Filters for Visual Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[95]  Huchuan Lu,et al.  Correlation Tracking via Joint Discrimination and Reliability Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[96]  Michael Felsberg,et al.  The Visual Object Tracking VOT2013 Challenge Results , 2013, ICCV 2013.

[97]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[98]  Matej Kristan,et al.  Deformable Parts Correlation Filters for Robust Visual Tracking , 2016, IEEE Transactions on Cybernetics.

[99]  Alfredo Petrosino,et al.  MATRIOSKA: A Multi-level Approach to Fast Tracking by Learning , 2013, ICIAP.

[100]  Yuan Dong,et al.  Correlation Filters with Weighted Convolution Responses , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).