Robust object tracking via superpixels and keypoints

Most of the part-based methods just use the initial appearance model and feature information of the object. When the object is affected by occlusion, deformation and illumination factors, these methods can not be stable to the tracking object. In this paper, a tracking method is proposed based on keypoint matching and superpixel matching. Our method not only uses the initial feature information of the object, but also uses the feature information between adjacent frames. We use the superpixel to over-segment the candidate region which can be obtained by voting between the globally matched feature points, and then construct superpixel descriptors. The similarity between superpixels is based on the distance of the superpixel feature descriptor. Eventually, the object is selected according to the superpixel vote. Furthermore, we use qualitative and quantitative evaluations to evaluate our method on 18 challenging image sequences. Experimental results show that the proposed method outperforms 6 state-of-the-art tracking algorithms.

[1]  Guillaume-Alexandre Bilodeau,et al.  SPiKeS: Superpixel-Keypoints structure for robust visual tracking , 2016, Machine Vision and Applications.

[2]  Kevin Nickels,et al.  Estimating uncertainty in SSD-based feature tracking , 2002, Image Vis. Comput..

[3]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Huchuan Lu,et al.  Robust Superpixel Tracking , 2014, IEEE Transactions on Image Processing.

[6]  Wolfgang Hürst,et al.  Gesture-based interaction via finger tracking for mobile augmented reality , 2011, Multimedia Tools and Applications.

[7]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[8]  Yasushi Yagi,et al.  Many-to-Many Superpixel Matching for Robust Tracking , 2014, IEEE Transactions on Cybernetics.

[9]  Jinhai Xiang,et al.  Robust visual tracking via bag of superpixels , 2015, Multimedia Tools and Applications.

[10]  Changsheng Xu,et al.  Deep Relative Tracking , 2017, IEEE Transactions on Image Processing.

[11]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jitendra Malik,et al.  Tracking as Repeated Figure/Ground Segmentation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Changsheng Xu,et al.  Robust Visual Tracking via Exclusive Context Modeling , 2016, IEEE Transactions on Cybernetics.

[14]  Meng Wang,et al.  An Efficient Tracking System by Orthogonalized Templates , 2016, IEEE Transactions on Industrial Electronics.

[15]  Qi Wang,et al.  Robust Superpixel Tracking via Depth Fusion , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Ehud Rivlin,et al.  Robust Fragments-based Tracking using the Integral Histogram , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Roman P. Pflugfelder,et al.  Consensus-based matching and tracking of keypoints for object tracking , 2014, IEEE Winter Conference on Applications of Computer Vision.

[18]  Changsheng Xu,et al.  Partial Occlusion Handling for Visual Tracking via Robust Part Matching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Nuno Vasconcelos,et al.  Robust Deformable and Occluded Object Tracking With Dynamic Graph , 2014, IEEE Transactions on Image Processing.

[20]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[21]  Meng Wang,et al.  Robust visual tracking via multi-graph ranking , 2015, Neurocomputing.

[22]  Guillaume-Alexandre Bilodeau,et al.  Part-Based Tracking via Salient Collaborating Features , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[23]  Jiri Matas,et al.  Forward-Backward Error: Automatic Detection of Tracking Failures , 2010, 2010 20th International Conference on Pattern Recognition.

[24]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[25]  Junseok Kwon,et al.  Tracking of a non-rigid object via patch-based dynamic appearance modeling and adaptive Basin Hopping Monte Carlo sampling , 2009, CVPR.

[26]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Shuicheng Yan,et al.  NUS-PRO: A New Visual Tracking Challenge , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.