Learning distance metric for object contour tracking

Contour tracking can be implemented by measuring the probability distributions (e.g. intensity, color and texture) of both interior and exterior regions of an object contour. Choosing a suitable distance metric for measuring the (dis)similarity between two distributions significantly influences the tracking performance. Most existing contour tracking methods, however, utilize a predefined metric which may not be appropriate for measuring the distributions. This paper presents a novel variational level set framework for contour tracking. The image energy functional is modeled by the distance between the foreground distribution and the given template, divided by the distance between the background distribution and the template. The form of the distance between two distributions is represented by the quadratic distance (Rubner et al. in Int J Comput Vis 40(2):99–121, 2000). To obtain the more robust tracking results, a distance metric learning algorithm is employed to achieve the similarity matrix for the quadratic distance. In addition, a distance between the evolving contour and the zero level set of the reference shape function is adopted as the shape prior to constrain the contour evolution process. Experiments on several video sequences prove the effectiveness and robustness of our method.

[1]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[2]  Ian D. Reid,et al.  Real-time tracking of multiple occluding objects using level sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Rachid Deriche,et al.  Geodesic active regions and level set methods for motion estimation and tracking , 2005, Comput. Vis. Image Underst..

[4]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[5]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[6]  Tryphon T. Georgiou,et al.  Tracking with a new distribution metric in a particle filtering framework , 2008, Electronic Imaging.

[7]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  W. Clem Karl,et al.  Real-time tracking using level sets , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Xin Li,et al.  Contour-based object tracking with occlusion handling in video acquired using mobile cameras , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[11]  Amir Globerson,et al.  Metric Learning by Collapsing Classes , 2005, NIPS.

[12]  Ian D. Reid,et al.  Nonlinear shape manifolds as shape priors in level set segmentation and tracking , 2011, CVPR 2011.

[13]  Kevin Cannons,et al.  A Review of Visual Tracking , 2008 .

[14]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Gregory Hager,et al.  Multiple kernel tracking with SSD , 2004, CVPR 2004.

[16]  Rachid Deriche,et al.  A level set framework using a new incremental, robust Active Shape Model for object segmentation and tracking , 2009, Image Vis. Comput..

[17]  Jayaram K. Udupa,et al.  A framework for evaluating image segmentation algorithms , 2006, Comput. Medical Imaging Graph..

[18]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[19]  Tao Zhang,et al.  Active contours for tracking distributions , 2004, IEEE Transactions on Image Processing.

[20]  Yanxi Liu,et al.  Online Selection of Discriminative Tracking Features , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[22]  Scott T. Acton,et al.  Motion gradient vector flow: an external force for tracking rolling leukocytes with shape and size constrained active contours , 2004, IEEE Transactions on Medical Imaging.

[23]  Alper Yilmaz,et al.  Kernel-based object tracking using asymmetric kernels with adaptive scale and orientation selection , 2011, Machine Vision and Applications.

[24]  Bo Ma,et al.  Learning distribution metric for object contour tracking , 2011, 2011 International Conference on Multimedia Technology.

[25]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[26]  Luc Van Gool,et al.  Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Nan Jiang,et al.  Learning Adaptive Metric for Robust Visual Tracking , 2011, IEEE Transactions on Image Processing.

[28]  Geoffrey E. Hinton,et al.  Neighbourhood Components Analysis , 2004, NIPS.

[29]  Daniel Cremers,et al.  Dynamical statistical shape priors for level set-based tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Namrata Vaswani,et al.  IEEE TRANSACTIONS ON IMAGE PROCESSING 1 A Generic Framework for Tracking using Particle Filter with Dynamic Shape Prior , 2022 .

[32]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[33]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Yoram Singer,et al.  Online and batch learning of pseudo-metrics , 2004, ICML.

[35]  Larry S. Davis,et al.  Probabilistic tracking in joint feature-spatial spaces , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[36]  Bo Ma,et al.  Unscented Kalman filter for visual curve tracking , 2004, Image Vis. Comput..

[37]  Ian D. Reid,et al.  Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors , 2008, ECCV.

[38]  Xiaoqin Zhang,et al.  Visual tracking via incremental Log-Euclidean Riemannian subspace learning , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Stanley T. Birchfield,et al.  Adaptive fragments-based tracking of non-rigid objects using level sets , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[40]  Tao Zhang,et al.  Tracking objects using density matching and shape priors , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.