Covariance Matching for PDE-based Contour Tracking

This paper presents a novel formulation for object tracking. We model the second-order statistics of image regions and perform covariance matching under the variational level set framework. Specifically, covariance matrix is adopted as a visual object representation for partial differential equation (PDE) based contour tracking. Log-Euclidean calculus is used as a covariance distance metric instead of Euclidean distance which is unsuitable for measuring the similarities between covariance matrices, because the matrices typically lie on a non-Euclidean manifold. A novel image energy functional is formulated by minimizing the distance metrics between the candidate object region and a given template, and maximizing the ones between the background region and the template. The corresponding gradient flow is then derived according to a variational approach, enabling PDE-based visual tracking. Experiments on synthetic and real video sequences prove the validity of the proposed method.

[1]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[2]  Shai Avidan Ensemble Tracking , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Rachid Deriche,et al.  Geodesic active regions and level set methods for motion estimation and tracking , 2005, Comput. Vis. Image Underst..

[4]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[5]  W. Clem Karl,et al.  Real-time tracking using level sets , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Daniel Cremers,et al.  Dynamical statistical shape priors for level set-based tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Fatih Murat Porikli,et al.  Covariance Tracking using Model Update Based on Lie Algebra , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Yogesh Rathi,et al.  Segmenting Images on the Tensor Manifold , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Anthony J. Yezzi,et al.  Coarse-to-Fine Segmentation and Tracking Using Sobolev Active Contours , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Abdol-Reza Mansouri,et al.  Region Tracking via Level Set PDEs without Motion Computation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Xavier Bresson,et al.  A Variational Model for Object Segmentation Using Boundary Information and Shape Prior Driven by the Mumford-Shah Functional , 2006, International Journal of Computer Vision.

[13]  Tao Zhang,et al.  Active contours for tracking distributions , 2004, IEEE Transactions on Image Processing.

[14]  Bo Ma,et al.  Unscented Kalman filter for visual curve tracking , 2004, Image Vis. Comput..

[15]  Guillermo Sapiro,et al.  Morphing Active Contours , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Scott T. Acton,et al.  Motion gradient vector flow: an external force for tracking rolling leukocytes with shape and size constrained active contours , 2004, IEEE Transactions on Medical Imaging.

[17]  Nicholas Ayache,et al.  Fast and Simple Calculus on Tensors in the Log-Euclidean Framework , 2005, MICCAI.

[18]  Shai Avidan,et al.  Ensemble Tracking , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[21]  Namrata Vaswani,et al.  IEEE TRANSACTIONS ON IMAGE PROCESSING 1 A Generic Framework for Tracking using Particle Filter with Dynamic Shape Prior , 2022 .