A novel approach for multi-cue feature fusion for robust object tracking

Object tracking is a significant problem of computer vision due to challenging environmental variations. Single cue appearance model is not sufficient to handle the variations. To this end, we propose a multi-cue tracking framework in which complementary cues namely, LBP and HOG were exploited to develop a robust appearance model. The proposed feature fusion captures the high-level relationship between the features and diminishes the low-level relationship. Transductive reliability is also integrated at each frame to make tracker adaptive with the changing environment. In addition, K-Means based classifier creates clear and concise boundary between positive and negative fragments which are further used to update the reference dictionary. This adaptation strategy prevents the erroneous updation of the proposed tracker during background clutters, occlusion, and fast motion. Qualitative and quantitative analysis on challenging video sequences from OTB-100 dataset, VOT dataset and UAV123 reveal that the proposed tracker performs favorably against 13 others state-of-the-art trackers.

[1]  Zhetao Li,et al.  Visual Tracking With Weighted Adaptive Local Sparse Appearance Model via Spatio-Temporal Context Learning , 2018, IEEE Transactions on Image Processing.

[2]  Xiaochun Cao,et al.  Robust Target Tracking by Online Random Forests and Superpixels , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Yang Cong,et al.  Discriminative multi-task objects tracking with active feature selection and drift correction , 2014, Pattern Recognit..

[4]  Dacheng Tao,et al.  BIT: Biologically Inspired Tracker , 2016, IEEE Transactions on Image Processing.

[5]  Fei Xue,et al.  Learning spatio-temporal context via hierarchical features for visual tracking , 2018, Signal Process. Image Commun..

[6]  Tianzhu Zhang,et al.  Discriminative Reverse Sparse Tracking via Weighted Multitask Learning , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Zhen Liu,et al.  Robust object tracking via multi-cue fusion , 2017, Signal Process..

[8]  Stefan Duffner,et al.  Using Discriminative Motion Context for Online Visual Object Tracking , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Shengping Zhang,et al.  Robust Joint Discriminative Feature Learning for Visual Tracking , 2016, IJCAI.

[10]  Michael Felsberg,et al.  Deep motion and appearance cues for visual tracking , 2019, Pattern Recognit. Lett..

[11]  Yuqing Gao,et al.  Robust Fusion of Color and Depth Data for RGB-D Target Tracking Using Adaptive Range-Invariant Depth Models and Spatio-Temporal Consistency Constraints , 2018, IEEE Transactions on Cybernetics.

[12]  Jiri Matas,et al.  A Novel Performance Evaluation Methodology for Single-Target Trackers , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Narendra Ahuja,et al.  Robust visual tracking via multi-task sparse learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Youfu Li,et al.  Learning Local Appearances With Sparse Representation for Robust and Fast Visual Tracking , 2015, IEEE Transactions on Cybernetics.

[15]  Sing Kiong Nguang,et al.  Robust video tracking algorithm: a multi-feature fusion approach , 2018, IET Comput. Vis..

[16]  Hui Cheng,et al.  Learning Collaborative Sparse Representation for Grayscale-Thermal Tracking , 2016, IEEE Transactions on Image Processing.

[17]  Long Xu,et al.  Visual tracking using global sparse coding and local convolutional features , 2018, Digit. Signal Process..

[18]  Thia Kirubarajan,et al.  Robust discriminative tracking via structured prior regularization , 2018, Image Vis. Comput..

[19]  Kapil Sharma,et al.  Unified Graph-Based Multicue Feature Fusion for Robust Visual Tracking , 2018, IEEE Transactions on Cybernetics.

[20]  Kuldeep Singh,et al.  A novel approach of multi-stage tracking for precise localization of target in video sequences , 2017, Expert Syst. Appl..

[21]  Min Yang,et al.  Robust Discriminative Tracking via Landmark-Based Label Propagation , 2015, IEEE Transactions on Image Processing.

[22]  Ling Shao,et al.  Discriminative Tracking Using Tensor Pooling , 2016, IEEE Transactions on Cybernetics.

[23]  Zhongfei Zhang,et al.  A survey of appearance models in visual object tracking , 2013, ACM Trans. Intell. Syst. Technol..

[24]  Bang Jun Lei,et al.  Improved dual-mode compressive tracking integrating balanced colour and texture features , 2018, IET Comput. Vis..

[25]  Gurjit Singh Walia,et al.  Recent advances on multicue object tracking: a survey , 2016, Artificial Intelligence Review.

[26]  Ehud Rivlin,et al.  Robust Fragments-based Tracking using the Integral Histogram , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[27]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[29]  Kaihua Zhang,et al.  Real-time visual tracking via online weighted multiple instance learning , 2013, Pattern Recognit..

[30]  Zhang Yi,et al.  Trajectory Predictor by Using Recurrent Neural Networks in Visual Tracking , 2017, IEEE Transactions on Cybernetics.

[31]  Qing Guo,et al.  Dynamic Saliency-Aware Regularization for Correlation Filter-Based Object Tracking , 2019, IEEE Transactions on Image Processing.

[32]  Kuldeep Singh,et al.  Robust object tracking with crow search optimized multi-cue particle filter , 2019, Pattern Analysis and Applications.

[33]  Bernard Ghanem,et al.  Context-Aware Correlation Filter Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Michael Felsberg,et al.  Discriminative Scale Space Tracking , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Tianzhu Zhang,et al.  Temporal Restricted Visual Tracking Via Reverse-Low-Rank Sparse Learning , 2017, IEEE Transactions on Cybernetics.

[36]  Haibin Ling,et al.  Real time robust L1 tracker using accelerated proximal gradient approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  S Vasuki,et al.  Contour-based object tracking in video scenes through optical flow and gabor features , 2018 .

[38]  Ran Duan,et al.  Visual tracking with online structural similarity-based weighted multiple instance learning , 2019, Inf. Sci..

[39]  Bernard Ghanem,et al.  A Benchmark and Simulator for UAV Tracking , 2016, ECCV.

[40]  Rama Chellappa,et al.  Joint Sparse Representation and Robust Feature-Level Fusion for Multi-Cue Visual Tracking , 2015, IEEE Transactions on Image Processing.

[41]  Kok-Meng Ong,et al.  Effective moving object tracking using modified flower pollination algorithm for visible image sequences under complicated background , 2019, Appl. Soft Comput..

[42]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[43]  Laura Sevilla-Lara,et al.  Distribution fields for tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Huchuan Lu,et al.  Visual tracking via adaptive structural local sparse appearance model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Dimitrios Makris,et al.  An object-based comparative methodology for motion detection based on the F-Measure , 2008, Comput. Vis. Image Underst..

[46]  Rama Chellappa,et al.  Learning Common and Feature-Specific Patterns: A Novel Multiple-Sparse-Representation-Based Tracker , 2018, IEEE Transactions on Image Processing.

[47]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Zhenyu He,et al.  Robust Object Tracking via Key Patch Sparse Representation , 2017, IEEE Transactions on Cybernetics.

[49]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[50]  Dong Liang,et al.  Robust multi-feature visual tracking via multi-task kernel-based sparse learning , 2017, IET Image Process..

[51]  Jie Yang,et al.  Robust Visual Tracking via Online Discriminative and Low-Rank Dictionary Learning , 2018, IEEE Transactions on Cybernetics.