Reconciling landmarks and level sets: geometric shape warping and matching using generalized gradients and correspondence-augmented implicit representations

Shape warping is a key problem in statistical shape analysis. This paper proposes a framework for geometric shape warping based on both shape distances and landmarks. Taking advantage of the recently proposed spatially coherent flows, our method is mathematically well-posed and uses only intrinsic shape information, namely some similarity measure between shapes and the correspondence of landmarks provided on the shape surface. No extrinsic quantity is considered, neither a diffeomorphism of the embedding space nor point correspondences in this space. Thanks to a recent extension of the level set method allowing point tracking and tangential velocities, our method is compatible with implicit representations. Moreover, a matching between shape surfaces is provided at no additional cost. Although some recent work deals with implicit representations and landmarks, it is, to our knowledge, the first time that landmarks and shape distances are reconciled in a pure geometric level set framework. The feasibility of the method is demonstrated with two- and three-dimensional examples. Combining shape distance and landmarks, our approach reveals to need only a small number of landmarks to obtain improvements on both warping and matching.

[1]  Olivier D. Faugeras,et al.  Reconciling Distance Functions and Level Sets , 1999, Scale-Space.

[2]  F. Bookstein Landmark methods for forms without landmarks: localizing group differences in outline shape , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[3]  Marko Subasic,et al.  Level Set Methods and Fast Marching Methods , 2003 .

[4]  S. Osher,et al.  From Landmark Matching to Shape and Open Curve Matching : A Level Set Approach , 2002 .

[5]  O. Faugeras,et al.  Level set based segmentation with intensity and curvature priors , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[6]  Michael I. Miller,et al.  Group Actions, Homeomorphisms, and Matching: A General Framework , 2004, International Journal of Computer Vision.

[7]  Michael I. Miller,et al.  Landmark Matching via Large Deformation Diffeomorphisms on the Sphere , 2004, Journal of Mathematical Imaging and Vision.

[8]  Olivier D. Faugeras,et al.  Approximations of Shape Metrics and Application to Shape Warping and Empirical Shape Statistics , 2005, Found. Comput. Math..

[9]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[10]  Olivier D. Faugeras,et al.  How to deal with point correspondences and tangential velocities in the level set framework , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  M. Delfour,et al.  Shape analysis via dis-tance functions: Local theory , 1998 .

[12]  Mads Nielsen,et al.  Proceedings of the 7th European Conference on Computer Vision-Part III , 2002 .

[13]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[14]  Simon K. Warfield,et al.  Landmark-Guided Surface Matching and Volumetric Warping for Improved Prostate Biopsy Targeting and Guidance , 2004, MICCAI.

[15]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[16]  S. Osher,et al.  Regular Article: A PDE-Based Fast Local Level Set Method , 1999 .

[17]  G. Matheron Random Sets and Integral Geometry , 1976 .

[18]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[19]  Paul M. Thompson,et al.  The role of image registration in brain mapping , 2001, Image Vis. Comput..

[20]  Nikos Paragios,et al.  Matching Distance Functions: A Shape-to-Area Variational Approach for Global-to-Local Registration , 2002, ECCV.

[21]  Olivier D. Faugeras,et al.  Designing spatially coherent minimizing flows for variational problems based on active contours , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  D. Kendall A Survey of the Statistical Theory of Shape , 1989 .

[23]  R. Cattell,et al.  The Procrustes Program: Producing direct rotation to test a hypothesized factor structure. , 2007 .

[24]  Song Wang,et al.  Landmark-based shape deformation with topology-preserving constraints , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  Alex M. Andrew,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science (2nd edition) , 2000 .

[26]  Anand Rangarajan,et al.  Non rigid registration of shapes via diffeomorphic point matching and clustering , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[27]  Steve McLaughlin,et al.  Comparative study of textural analysis techniques to characterise tissue from intravascular ultrasound , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[28]  Ron Kikinis,et al.  Registration of 3D Intraoperative MR Images of the Brain Using a Finite Element Biomechanical Model , 2001, IEEE Trans. Medical Imaging.

[29]  F. Bookstein Size and Shape Spaces for Landmark Data in Two Dimensions , 1986 .

[30]  A. Toga,et al.  Brain Warping Via Landmark Points and Curves with a Level Set Representation , 2004 .

[31]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Laurent Younes,et al.  Computable Elastic Distances Between Shapes , 1998, SIAM J. Appl. Math..

[33]  Paul M. Thompson,et al.  Linear and non-linear geometric object matching with implicit representation , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[34]  Olivier D. Faugeras,et al.  Shape metrics, warping and statistics , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[35]  Alain Trouvé,et al.  Diffeomorphic Matching Problems in One Dimension: Designing and Minimizing Matching Functionals , 2000, ECCV.

[36]  Stefano Soatto,et al.  DEFORMOTION: Deforming Motion, Shape Average and the Joint Registration and Segmentation of Images , 2002, ECCV.

[37]  S. Osher,et al.  Regular Article: A PDE-Based Fast Local Level Set Method , 1999 .

[38]  L. Younes,et al.  Diffeomorphic matching of distributions: a new approach for unlabelled point-sets and sub-manifolds matching , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[39]  S. Osher,et al.  Variational problems and PDEs on implicit surfaces , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[40]  P. Lions,et al.  Some Properties of Viscosity Solutions of Hamilton-Jacobi Equations. , 1984 .

[41]  A. Dervieux,et al.  A finite element method for the simulation of a Rayleigh-Taylor instability , 1980 .

[42]  Stanley Osher,et al.  New framework for object warping: semi-Lagrangian level set approach , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[43]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .