Visual object tracking based on discriminant DCT features

Abstract In this paper, a visual object tracking method is proposed based on sparse 2-dimensional discrete cosine transform (2D DCT) coefficients as discriminative features. To select the discriminative DCT coefficients, we give two propositions. The propositions select the features based on estimated mean of feature distributions in each frame. Some intermediate tracking instances are obtained by (a) computing feature similarity using kernel, (b) finding the maximum classifier score computed using ratio classifier, and (c) combinations of both. Another intermediate tracking instance is obtained using incremental subspace learning method. The final tracked instance amongst the intermediate instances are selected by using a discriminative linear classifier learned in each frame. The linear classifier is updated in each frame using some of the intermediate tracked instances. The proposed method has a better tracking performance as compared to state-of-the-art video trackers in a dataset of 50 challenging video sequences.

[1]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[2]  Martin D. Levine,et al.  Face Recognition Using the Discrete Cosine Transform , 2001, International Journal of Computer Vision.

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  Guillaume-Alexandre Bilodeau,et al.  Exploiting structural constraints for visual object tracking , 2015, Image Vis. Comput..

[5]  Yuan Xie,et al.  Discriminative subspace learning with sparse representation view-based model for robust visual tracking , 2014, Pattern Recognit..

[6]  Huchuan Lu,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Online Object Tracking with Sparse Prototypes , 2022 .

[7]  Philip H. S. Torr,et al.  Struck: Structured output tracking with kernels , 2011, ICCV.

[8]  Kaihua Zhang,et al.  Real-time visual tracking via online weighted multiple instance learning , 2013, Pattern Recognit..

[9]  Mark Reynolds,et al.  Toward Occlusion Handling in Visual Tracking via Probabilistic Finite State Machines , 2020, IEEE Transactions on Cybernetics.

[10]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Yuan Xie,et al.  Discriminative Object Tracking via Sparse Representation and Online Dictionary Learning , 2014, IEEE Transactions on Cybernetics.

[12]  De Xu,et al.  Online State-Based Structured SVM Combined With Incremental PCA for Robust Visual Tracking , 2015, IEEE Transactions on Cybernetics.

[13]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[14]  Qiao Liu,et al.  MSST-ResNet: Deep multi-scale spatiotemporal features for robust visual object tracking , 2019, Knowl. Based Syst..

[15]  Nicolas Chopin,et al.  SMC2: an efficient algorithm for sequential analysis of state space models , 2011, 1101.1528.

[16]  Mónica F. Bugallo,et al.  Sequential Monte Carlo methods under model uncertainty , 2016, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[17]  Nando de Freitas,et al.  An Introduction to Sequential Monte Carlo Methods , 2001, Sequential Monte Carlo Methods in Practice.

[18]  Jun Zhang,et al.  Robust object tracking using least absolute deviation , 2014, Image Vis. Comput..

[19]  Haibin Ling,et al.  Robust visual tracking using ℓ1 minimization , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[20]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Hongliang Li,et al.  Local Polar DCT Features for Image Description , 2013, IEEE Signal Processing Letters.

[24]  Qing Wang,et al.  Object Tracking With Joint Optimization of Representation and Classification , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Youfu Li,et al.  Robust visual tracking with structured sparse representation appearance model , 2012, Pattern Recognit..

[26]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[27]  Zhongfei Zhang,et al.  A survey of appearance models in visual object tracking , 2013, ACM Trans. Intell. Syst. Technol..

[28]  Ali Aghagolzadeh,et al.  Feature extraction using discrete cosine transform and discrimination power analysis with a face recognition technology , 2010, Pattern Recognit..

[29]  Hong Qiao,et al.  Top-down visual attention integrated particle filter for robust object tracking , 2016, Signal Process. Image Commun..

[30]  N. Chopin.  A sequential particle filter method for static models , 2002 .

[31]  Rajiv Kapoor,et al.  Spider monkey optimisation assisted particle filter for robust object tracking , 2017, IET Comput. Vis..

[32]  David Zhang,et al.  Fast Visual Tracking via Dense Spatio-temporal Context Learning , 2014, ECCV.

[33]  Yong Liu,et al.  Large Margin Object Tracking with Circulant Feature Maps , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Lei Zhang,et al.  Real-Time Object Tracking Via Online Discriminative Feature Selection , 2013, IEEE Transactions on Image Processing.

[35]  Stan Sclaroff,et al.  MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization , 2014, ECCV.

[36]  Changsheng Xu,et al.  Correlation Particle Filter for Visual Tracking , 2018, IEEE Transactions on Image Processing.

[37]  Li Bai,et al.  Minimum error bounded efficient ℓ1 tracker with occlusion detection , 2011, CVPR 2011.

[38]  Luca Martino,et al.  Cooperative parallel particle filters for online model selection and applications to urban mobility , 2015, Digit. Signal Process..

[39]  Lei Zhang,et al.  Object Tracking via Dual Linear Structured SVM and Explicit Feature Map , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Nicholas G. Polson,et al.  Particle Learning and Smoothing , 2010, 1011.1098.

[41]  Karim Faez,et al.  Multi-step prediction method for robust object tracking , 2017, Digit. Signal Process..

[42]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Meng Joo Er,et al.  High-speed face recognition based on discrete cosine transform and RBF neural networks , 2005, IEEE Transactions on Neural Networks.

[44]  Shengjie Li,et al.  Accelerated Particle Filter for Real-Time Visual Tracking With Decision Fusion , 2018, IEEE Signal Processing Letters.

[45]  Huchuan Lu,et al.  L2-RLS-Based Object Tracking , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[46]  Long Xu,et al.  Visual tracking using global sparse coding and local convolutional features , 2018, Digit. Signal Process..

[47]  Ömer Nezih Gerek,et al.  Automatic recognition of scenes with power line wires in real life aerial images using DCT-based features , 2017, Digit. Signal Process..

[48]  Hongbing Ji,et al.  Iterative particle filter for visual tracking , 2015, Signal Process. Image Commun..