Object Tracking Based on Stable Feature Mining Using Intraframe Clustering and Interframe Association

Extracting stable features to enhance object representation has proved to be very effective in improving the performance of object tracking. To achieve this, mining techniques, such as $K$ -means clustering and data associating, are often adopted. However, $K$ -means clustering needs the pre-set number of clusters. Real scenarios (heavy occlusion and so on) often make the tracker lose the target object. To handle these problems, we propose an intraframe clustering and interframe association (ICIA)-based stable feature mining algorithm for object tracking. The value (in HSV space) peak contour is employed to automatically estimate the number of clusters and classify value and saturation colors of the object region to get connected subregions. Every subregion is described with observation and increment models. Multi-feature distances-based subregion association, between the current object template and the current observation, is then utilized to mine stable subregion pairs and obtain feature change ratio. Stable subregion displacements, and current detected and historical trajectories are systematically fused to locate the object. And, stable and unstable subregion features are updated separately to restrain the accumulative error. Experimental comparisons are conducted on six test sequences. Compared with several relevant state-of-the-art algorithms, the proposed ICIA tracker most accurately locates objects in four sequences and shows the second-best performance in the other two sequences with only less 1 pixel distance difference than the best method.

[1]  Mohan S. Kankanhalli,et al.  Multimedia data mining: state of the art and challenges , 2010, Multimedia Tools and Applications.

[2]  Peihua Li,et al.  A clustering-based color model and integral images for fast object tracking , 2006, Signal Process. Image Commun..

[3]  Qi Zhao,et al.  A motion observable representation using color correlogram and its applications to tracking , 2009, Comput. Vis. Image Underst..

[4]  Ling Shao,et al.  Learning Spatio-Temporal Representations for Action Recognition: A Genetic Programming Approach , 2016, IEEE Transactions on Cybernetics.

[5]  Changsheng Xu,et al.  Robust Visual Tracking via Exclusive Context Modeling , 2016, IEEE Transactions on Cybernetics.

[6]  Weisi Lin,et al.  Visual Object Tracking by Structure Complexity Coefficients , 2015, IEEE Transactions on Multimedia.

[7]  Anke Meyer-Bäse,et al.  Mining Interaction Patterns among Brain Regions by Clustering , 2014, IEEE Transactions on Knowledge and Data Engineering.

[8]  Weiqiang Wang,et al.  Object tracking based on local dynamic sparse model , 2015, J. Vis. Commun. Image Represent..

[9]  Zhaohui Wu,et al.  Accelerometer-Based Gait Recognition by Sparse Representation of Signature Points With Clusters , 2015, IEEE Transactions on Cybernetics.

[10]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Andrea Cavallaro,et al.  Accepted for Publication in Ieee Transactions on Image Processing Adaptive Appearance Modeling for Video Tracking: Survey and Evaluation , 2022 .

[12]  Yanmin Zhu,et al.  A Survey on Trajectory Data Mining: Techniques and Applications , 2016, IEEE Access.

[13]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  David Zhang,et al.  Fast Visual Tracking via Dense Spatio-temporal Context Learning , 2014, ECCV.

[15]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[16]  Ganesh Sundaramoorthi,et al.  Shape Tracking with Occlusions via Coarse-to-Fine Region-Based Sobolev Descent , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Shumin Fei,et al.  Edge and color contexts based object representation and tracking , 2015 .

[18]  Qi Tian,et al.  Mining spatiotemporal video patterns towards robust action retrieval , 2013, Neurocomputing.

[19]  Youfu Li,et al.  Learning Local Appearances With Sparse Representation for Robust and Fast Visual Tracking , 2015, IEEE Transactions on Cybernetics.

[20]  Qi Wang,et al.  Online Anomaly Detection in Crowd Scenes via Structure Analysis , 2015, IEEE Transactions on Cybernetics.

[21]  Jim X. Chen,et al.  Adaptive collaborative tracking for multiple targets , 2012 .

[22]  David A. Clausi,et al.  Multivariate Image Segmentation Using Semantic Region Growing With Adaptive Edge Penalty , 2010, IEEE Transactions on Image Processing.

[23]  Yasushi Yagi,et al.  Integrating Color and Shape-Texture Features for Adaptive Real-Time Object Tracking , 2008, IEEE Transactions on Image Processing.

[24]  Habiba Drias,et al.  From data mining to knowledge mining: Application to intelligent agents , 2015, Expert Syst. Appl..

[25]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[27]  Junseok Kwon,et al.  Highly Nonrigid Object Tracking via Patch-Based Dynamic Appearance Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Stan Sclaroff,et al.  MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization , 2014, ECCV.

[29]  Xiaoqin Zhang,et al.  Single and Multiple Object Tracking Using Log-Euclidean Riemannian Subspace and Block-Division Appearance Model , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Li Peihua,et al.  A clustering-based color model and integral images for fast object tracking , 2006 .

[31]  Meng Wang,et al.  Robust visual tracking via multi-graph ranking , 2015, Neurocomputing.

[32]  Marcello Demi,et al.  Contour Tracking with a Spatio-Temporal Intensity Moment , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Shonali Krishnaswamy,et al.  A Retrieval Strategy for Case-Based Reasoning Using Similarity and Association Knowledge , 2014, IEEE Transactions on Cybernetics.

[34]  Ludmila I. Kuncheva,et al.  Evaluation of Stability of k-Means Cluster Ensembles with Respect to Random Initialization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Qiang Yang,et al.  Modeling Neuron Selectivity Over Simple Midlevel Features for Image Classification , 2015, IEEE Transactions on Image Processing.

[36]  Yueting Zhuang,et al.  Online Metric-Weighted Linear Representations for Robust Visual Tracking , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Ying Wu,et al.  Context-aware discovery of visual co-occurrence patterns. , 2014, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[38]  Moon Gi Kang,et al.  Motion tracking based on area and level set weighted centroid shifting , 2010 .

[39]  Fabio A. González,et al.  Visual pattern mining in histology image collections using bag of features , 2011, Artif. Intell. Medicine.

[40]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Jessica K. Hodgins,et al.  Hierarchical Aligned Cluster Analysis for Temporal Clustering of Human Motion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Wen Gao,et al.  Learning discriminative features for fast frame-based action recognition , 2013, Pattern Recognit..

[43]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[45]  Philippe C. Cattin,et al.  Tracking the invisible: Learning where the object might be , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[47]  Gang Hua,et al.  Context-Aware Visual Tracking , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Roland Wilson,et al.  Unsupervised learning and clustering using a random field approach , 2007 .

[49]  Changsheng Xu,et al.  Mining Semantic Context Information for Intelligent Video Surveillance of Traffic Scenes , 2013, IEEE Transactions on Industrial Informatics.

[50]  Shumin Fei,et al.  A robust algorithm for tracking object under occlusion and illumination change , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[51]  Yanning Zhang,et al.  Multi-Model Estimation Based Moving Object Detection for Aerial Video , 2015, Sensors.

[52]  Jin Young Choi,et al.  Intelligent visual surveillance — A survey , 2010 .

[53]  Ming-Hsuan Yang,et al.  Long-term correlation tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Alptekin Temizel,et al.  Adaptive mean-shift for automated multi object tracking , 2012 .