Progress and Outlook of Visual Tracking: Bibliographic Analysis and Perspective

Benefitting from continuous progress in computer architecture and computer vision algorithms, the visual tracking field has earned its rapid development in recent years. This paper surveys this interesting field through bibliographic analysis on the Web-of-Science literature from 1990 to 2019. Specifically, statistical analysis methods are used to obtain the most productive authors and countries/regions, the most cited papers, and so on. In order to realize an in-depth analysis, the co-authors, co-keywords and keyword-author co-occurrence networks are built to intuitively exhibit the evolution of research hotspots and the collaboration patterns among world-wide researchers. Brief introductions of the topics that occur frequently in co-keywords networks are provided as well. Furthermore, existing challenges and future research directions within the visual tracking field are discussed, revealing that tracking-by-detection and deep learning will continue receiving much attention. In addition, the parallel vision approach should be adopted for training and evaluating visual tracking models in a virtual-real interaction manner.

[1]  S. Y. Chen,et al.  Kalman Filter for Robot Vision: A Survey , 2012, IEEE Transactions on Industrial Electronics.

[2]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Jin Gao,et al.  Semi-Supervised Tensor-Based Graph Embedding Learning and Its Application to Visual Discriminant Tracking , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Dietrich Paulus,et al.  Simple online and realtime tracking with a deep association metric , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[7]  Shuicheng Yan,et al.  Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Michael Felsberg,et al.  Convolutional Features for Correlation Filter Based Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[9]  U. K. Jaliya,et al.  A Survey on Object Detection and Tracking Methods , 2014 .

[10]  Wei Liu,et al.  Unsupervised Deep Tracking , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[12]  Faouzi Alaya Cheikh,et al.  SINGLE SHOT APPEARANCE MODEL (SSAM) FOR MULTI-TARGET TRACKING , 2019, Electronic Imaging.

[13]  Ramakant Nevatia,et al.  Robust Object Tracking by Hierarchical Association of Detection Responses , 2008, ECCV.

[14]  Arif Khan,et al.  The impact of author-selected keywords on citation counts , 2016, J. Informetrics.

[15]  Huchuan Lu,et al.  Robust object tracking via sparsity-based collaborative model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Huchuan Lu,et al.  Deep gated attention networks for large-scale street-level scene segmentation , 2019, Pattern Recognit..

[17]  Kaiqi Huang,et al.  An Equalized Global Graph Model-Based Approach for Multicamera Object Tracking , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Kunfeng Wang,et al.  Measuring Driving Behaviors from Live Video , 2012, IEEE Intelligent Systems.

[20]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Wei Wu,et al.  SiamRPN++: Evolution of Siamese Visual Tracking With Very Deep Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Li Qiujie,et al.  Survey on Visual Tracking Algorithms Based on Mean Shift , 2012 .

[23]  Nanning Zheng,et al.  Parallel vision for perception and understanding of complex scenes: methods, framework, and perspectives , 2017, Artificial Intelligence Review.

[24]  Alan L. Jennings,et al.  Optical Flow Background Estimation for Real-time Pan/tilt Camera Object Tracking , 2014 .

[25]  Rachid Deriche,et al.  Geodesic active regions and level set methods for motion estimation and tracking , 2005, Comput. Vis. Image Underst..

[26]  Hou Zhi-qiang,et al.  A Survey of Visual Tracking , 2006 .

[27]  Li Wan A Survey of Visual Attention Based Methods for Object Tracking , 2014 .

[28]  Silvio Savarese,et al.  Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Brian D. O. Anderson,et al.  Network Analysis and Synthesis: A Modern Systems Theory Approach , 2006 .

[30]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Kwangjin Yoon,et al.  Data Association for Multi-Object Tracking via Deep Neural Networks , 2019, Sensors.

[32]  Yang Guosheng,et al.  Video Object Tracking Based on Appearance Models Learning , 2015 .

[33]  Francesco Solera,et al.  Performance Measures and a Data Set for Multi-target, Multi-camera Tracking , 2016, ECCV Workshops.

[34]  Faouzi Alaya Cheikh,et al.  A hierarchical feature model for multi-target tracking , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[35]  Dong Liang,et al.  Robust visual tracking via nonlocal regularized multi-view sparse representation , 2019, Pattern Recognit..

[36]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Chunfeng Yuan,et al.  Dual Sticky Hierarchical Dirichlet Process Hidden Markov Model and Its Application to Natural Language Description of Motions , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Christian Theobalt,et al.  GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[39]  Silvio Savarese,et al.  Learning to Track: Online Multi-object Tracking by Decision Making , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[40]  Huchuan Lu,et al.  Visual Tracking via Adaptive Spatially-Regularized Correlation Filters , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Laura Leal-Taixé,et al.  Tracking Without Bells and Whistles , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[42]  Petar M. Djuric,et al.  Gaussian sum particle filtering , 2003, IEEE Trans. Signal Process..

[43]  Sergio A. Velastin,et al.  A Review of Computer Vision Techniques for the Analysis of Urban Traffic , 2011, IEEE Transactions on Intelligent Transportation Systems.

[44]  Hua Yang,et al.  Online Multi-Object Tracking with Dual Matching Attention Networks , 2018, ECCV.

[45]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Bernt Schiele,et al.  PoseTrack: A Benchmark for Human Pose Estimation and Tracking , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[47]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[48]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Carlo Tomasi,et al.  Features for Multi-target Multi-camera Tracking and Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[50]  James M. Rehg,et al.  Multi-object Tracking with Neural Gating Using Bilinear LSTM , 2018, ECCV.

[51]  Mario Sznaier,et al.  Multi-camera Multi-Object Tracking , 2017, ArXiv.

[52]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[53]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[54]  Dayong Shen,et al.  Visual Tracking Based on Dynamic Coupled Conditional Random Field Model , 2016, IEEE Transactions on Intelligent Transportation Systems.

[55]  Huchuan Lu,et al.  Pose-Invariant Embedding for Deep Person Re-Identification , 2017, IEEE Transactions on Image Processing.

[56]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[57]  Silvio Savarese,et al.  Tracking the Untrackable: Learning to Track Multiple Cues with Long-Term Dependencies , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[58]  Yu Liu,et al.  A Bibliographic Analysis and Collaboration Patterns of IEEE Transactions on Intelligent Transportation Systems Between 2000 and 2015 , 2016, IEEE Transactions on Intelligent Transportation Systems.

[59]  Kuk-Jin Yoon,et al.  Robust Online Multi-object Tracking Based on Tracklet Confidence and Online Discriminative Appearance Learning , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[60]  Xuan Li,et al.  The ParallelEye Dataset: A Large Collection of Virtual Images for Traffic Vision Research , 2019, IEEE Transactions on Intelligent Transportation Systems.

[61]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[62]  Aidong Zhang,et al.  Protein Interaction Networks: Computational Analysis , 2009 .

[63]  Wei Wu,et al.  Online Inter-Camera Trajectory Association Exploiting Person Re-Identification and Camera Topology , 2018, ACM Multimedia.

[64]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Faouzi Alaya Cheikh,et al.  HoG based real-time multi-target tracking in Bayesian framework , 2016, 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[66]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[67]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[68]  Ali Emrouznejad,et al.  A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016 , 2018 .

[69]  Faouzi Alaya Cheikh,et al.  Deep Feature Based End-to-End Transportation Network for Multi-Target Tracking , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[70]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[71]  Andreas Geiger,et al.  MOTS: Multi-Object Tracking and Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[72]  Zhong Liu,et al.  Collaborations Patterns and Productivity Analysis for IEEE T-ITS Between 2010 and 2013 , 2014, IEEE Transactions on Intelligent Transportation Systems.

[73]  Mathieu Bastian,et al.  Gephi: An Open Source Software for Exploring and Manipulating Networks , 2009, ICWSM.

[74]  Qiang Ji,et al.  Simultaneous Clustering and Tracklet Linking for Multi-face Tracking in Videos , 2013, 2013 IEEE International Conference on Computer Vision.

[75]  Enrique Herrera-Viedma,et al.  Analyzing Highly Cited Papers in Intelligent Transportation Systems , 2016, IEEE Transactions on Intelligent Transportation Systems.

[76]  Ramakant Nevatia,et al.  Multi-Target Tracking by Online Learning a CRF Model of Appearance and Motion Patterns , 2013, International Journal of Computer Vision.

[77]  E. Trucco,et al.  Video Tracking: A Concise Survey , 2006, IEEE Journal of Oceanic Engineering.

[78]  Faouzi Alaya Cheikh,et al.  A Directed Sparse Graphical Model for Multi-target Tracking , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[79]  Zhongfei Zhang,et al.  A survey of appearance models in visual object tracking , 2013, ACM Trans. Intell. Syst. Technol..

[80]  Yanxi Liu,et al.  Online Selection of Discriminative Tracking Features , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[81]  Bing Wang,et al.  Tracklet Association by Online Target-Specific Metric Learning and Coherent Dynamics Estimation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[82]  Huchuan Lu,et al.  Salient Object Detection with Recurrent Fully Convolutional Networks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[83]  Kaiqi Huang,et al.  Intelligent Visual Surveillance , 2016, Communications in Computer and Information Science.

[84]  Ingemar J. Cox,et al.  An efficient implementation and evaluation of Reid's multiple hypothesis tracking algorithm for visual tracking , 1994, Proceedings of 12th International Conference on Pattern Recognition.