A New Geometric Metric in the Space of Curves, and Applications to Tracking Deforming Objects by Prediction and Filtering

We define a novel metric on the space of closed planar curves which decomposes into three intuitive components. According to this metric, centroid translations, scale changes, and deformations are orthogonal, and the metric is also invariant with respect to reparameterizations of the curve. While earlier related Sobolev metrics for curves exhibit some general similarities to the novel metric proposed in this work, they lacked this important three-way orthogonal decomposition, which has particular relevance for tracking in computer vision. Another positive property of this new metric is that the Riemannian structure that is induced on the space of curves is a smooth Riemannian manifold, which is isometric to a classical well-known manifold. As a consequence, geodesics and gradients of energies defined on the space can be computed using fast closed-form formulas, and this has obvious benefits in numerical applications. The obtained Riemannian manifold of curves is ideal for addressing complex problems in computer vision; one such example is the tracking of highly deforming objects. Previous works have assumed that the object deformation is smooth, which is realistic for the tracking problem, but most have restricted the deformation to belong to a finite-dimensional group—such as affine motions—or to finitely parameterized models. This is too restrictive for highly deforming objects such as the contour of a beating heart. We adopt the smoothness assumption implicit in previous work, but we lift the restriction to finite-dimensional motions/deformations. We define a dynamical model in this Riemannian manifold of curves and use it to perform filtering and prediction to infer and extrapolate not just the pose (a finitely parameterized quantity) of an object but its deformation (an infinite-dimensional quantity) as well. We illustrate these ideas using a simple first-order dynamical model and show that it can be effective even on image sequences where existing methods fail.

[1]  S. Lang Fundamentals of differential geometry , 1998 .

[2]  Anthony J. Yezzi,et al.  Sobolev Active Contours , 2005, International Journal of Computer Vision.

[3]  R. Mathias Evaluating the Frechet derivative of the matrix exponential , 1992 .

[4]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[5]  Daniel Cremers,et al.  Motion Competition: A Variational Approach to Piecewise Parametric Motion Segmentation , 2005, International Journal of Computer Vision.

[6]  Olivier D. Faugeras,et al.  Designing spatially coherent minimizing flows for variational problems based on active contours , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  A. Yezzi,et al.  Metrics in the space of curves , 2004, math/0412454.

[8]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[9]  I. Holopainen Riemannian Geometry , 1927, Nature.

[10]  Laurent Younes,et al.  Computable Elastic Distances Between Shapes , 1998, SIAM J. Appl. Math..

[11]  Martin Rumpf,et al.  A Nonlinear Elastic Shape Averaging Approach , 2009, SIAM J. Imaging Sci..

[12]  Namrata Vaswani,et al.  Particle filtering for geometric active contours with application to tracking moving and deforming objects , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Daniel Cremers Nonlinear Dynamical Shape Priors for Level Set Segmentation , 2007, CVPR.

[14]  Richard Szeliski,et al.  Tracking with Kalman snakes , 1993 .

[15]  Guillermo Sapiro,et al.  Geodesics in Shape Space via Variational Time Discretization , 2009, EMMCVPR.

[16]  Anthony J. Yezzi,et al.  Conformal metrics and true "gradient flows" for curves , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[17]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[18]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[19]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[20]  Guillermo Sapiro,et al.  New Possibilities with Sobolev Active Contours , 2007, International Journal of Computer Vision.

[21]  M. Kilian,et al.  Geometric modeling in shape space , 2007, SIGGRAPH 2007.

[22]  D. Mumford,et al.  VANISHING GEODESIC DISTANCE ON SPACES OF SUBMANIFOLDS AND DIFFEOMORPHISMS , 2004, math/0409303.

[23]  Nicolas Papadakis,et al.  A Variational Technique for Time Consistent Tracking of Curves and Motion , 2008, Journal of Mathematical Imaging and Vision.

[24]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[25]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[26]  C. Wasshuber Computational Single-Electronics , 2001 .

[27]  Stefano Soatto,et al.  DEFORMOTION: Deforming Motion, Shape Average and the Joint Registration and Segmentation of Images , 2002, ECCV.

[28]  Stefano Soatto,et al.  Tracking deformable moving objects under severe occlusions , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[29]  Tony F. Chan,et al.  TRACKING OBJECTS WITH THE CHAN-VESE ALGORITHM , 2003 .

[30]  Anuj Srivastava,et al.  Elastic-string models for representation and analysis of planar shapes , 2004, CVPR 2004.

[31]  Stefano Soatto,et al.  Tracking deforming objects by filtering and prediction in the space of curves , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[32]  N. Peterfreund The velocity snake: Deformable contour for tracking in spatio-velocity space , 1997 .

[33]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[34]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[35]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  B. D. Adelstein,et al.  Calculus of Nonrigid Surfaces for Geometry and Texture Manipulation , 2007 .

[37]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[38]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[39]  Alexander M. Bronstein,et al.  Calculus of Nonrigid Surfaces for Geometry and Texture Manipulation , 2007, IEEE Transactions on Visualization and Computer Graphics.

[40]  Rachid Deriche,et al.  Geodesic Active Regions: A New Framework to Deal with Frame Partition Problems in Computer Vision , 2002, J. Vis. Commun. Image Represent..

[41]  Peter W. Michor,et al.  The action of the diffeomorphism group on the space of immersions , 1991 .

[42]  Anthony J. Yezzi,et al.  A statistical approach to snakes for bimodal and trimodal imagery , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[43]  Patricio A. Vela,et al.  Geometric Observers for Dynamically Evolving Curves , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Rémi Ronfard,et al.  Region-based strategies for active contour models , 1994, International Journal of Computer Vision.

[45]  Andrea C. G. Mennucci,et al.  Metrics of Curves in Shape Optimization and Analysis , 2013 .

[46]  D. Mumford,et al.  A Metric on Shape Space with Explicit Geodesics , 2007, 0706.4299.

[47]  Olivier D. Faugeras,et al.  Approximations of Shape Metrics and Application to Shape Warping and Empirical Shape Statistics , 2005, Found. Comput. Math..

[48]  Janusz Grabowski,et al.  Derivative of the exponential mapping for infinite dimensional lie groups , 1993, Annals of Global Analysis and Geometry.

[49]  K. Mardia,et al.  Shape distributions for landmark data , 1989, Advances in Applied Probability.

[50]  M. Delfour,et al.  Shape identification via metrics constructed from the oriented distance function , 2005 .

[51]  Tai Sing Lee,et al.  Region competition: unifying snakes, region growing, energy/Bayes/MDL for multi-band image segmentation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[52]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[53]  Richard S. Hamilton,et al.  The inverse function theorem of Nash and Moser , 1982 .

[54]  Namrata Vaswani,et al.  Deform PF-MT: Particle Filter With Mode Tracker for Tracking Nonaffine Contour Deformations , 2010, IEEE Transactions on Image Processing.

[55]  D. Luenberger Observing the State of a Linear System , 1964, IEEE Transactions on Military Electronics.

[56]  D. Mumford,et al.  Riemannian geometries on the space of plane curves , 2003 .

[57]  Christoph Schnörr,et al.  View Point Tracking of Rigid Objects Based on Shape Sub-manifolds , 2008, ECCV.

[58]  D. Mumford,et al.  An overview of the Riemannian metrics on spaces of curves using the Hamiltonian approach , 2006, math/0605009.

[59]  Roman Goldenberg,et al.  Fast Geodesic Active Contours , 1999, Scale-Space.

[60]  Anthony J. Yezzi,et al.  Coarse-to-Fine Segmentation and Tracking Using Sobolev Active Contours , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Jean-Philippe Pons,et al.  Generalized Gradients: Priors on Minimization Flows , 2007, International Journal of Computer Vision.

[62]  G. Sundaramoorthi,et al.  Properties of Sobolev-type metrics in the space of curves , 2006, math/0605017.