Learning shape metrics based on deformations and transport

Shape evolutions, as well as shape matchings or image segmentation with shape prior, involve the preliminary choice of a suitable metric in the space of shapes. Instead of choosing a particular one, we propose a framework to learn shape metrics from a set of examples of shapes, designed to be able to handle sparse sets of highly varying shapes, since typical shape datasets, like human silhouettes, are intrinsically high-dimensional and non-dense. We formulate the task of finding the optimal metrics on an empirical manifold of shapes as a classical minimization problem ensuring smoothness, and compute its global optimum fast. First, we design a criterion to compute point-to-point matching between shapes which deals with topological changes. Then, given a training set of shapes, we use these matchings to transport deformations observed on any shape to any other one. Finally, we estimate the metric in the tangent space of any shape, based on transported deformations, weighted by their reliability. Experiments on difficult sets are shown, and applications are proposed.

[1]  Renaud Keriven,et al.  Shape Priors using Manifold Learning Techniques , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[2]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[3]  Alain Trouvé,et al.  Diffeomorphic Matching Problems in One Dimension: Designing and Minimizing Matching Functionals , 2000, ECCV.

[4]  Shimon Ullman,et al.  Class-Specific, Top-Down Segmentation , 2002, ECCV.

[5]  O. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2002, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[6]  Andrew Zisserman,et al.  OBJ CUT , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Namrata Vaswani,et al.  IEEE TRANSACTIONS ON IMAGE PROCESSING 1 A Generic Framework for Tracking using Particle Filter with Dynamic Shape Prior , 2022 .

[9]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[10]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[11]  Daphna Weinshall,et al.  Flexible Syntactic Matching of Curves and Its Application to Automatic Hierarchical Classification of Silhouettes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Olivier Faugeras,et al.  Approximations of Shape Metrics and Application to Shape Warping and Empirical Shape Statistics , 2006, Statistics and Analysis of Shapes.

[13]  Yogesh Rathi,et al.  Comparative Analysis of Kernel Methods for Statistical Shape Learning , 2006, CVAMIA.

[14]  Daniel Cremers,et al.  Efficient Kernel Density Estimation of Shape and Intensity Priors for Level Set Segmentation , 2005, MICCAI.

[15]  Cordelia Schmid,et al.  Accurate Object Detection with Deformable Shape Models Learnt from Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Daniel Cremers,et al.  Fast Matching of Planar Shapes in Sub-cubic Runtime , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[17]  Stefano Soatto,et al.  DEFORMOTION: Deforming Motion, Shape Average and the Joint Registration and Segmentation of Images , 2002, ECCV.

[18]  L. Younes,et al.  Statistics on diffeomorphisms via tangent space representations , 2004, NeuroImage.

[19]  Daniel Cremers,et al.  Matching non-rigidly deformable shapes across images: A globally optimal solution , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Stefano Soatto,et al.  Deformotion: Deforming Motion, Shape Average and the Joint Registration and Approximation of Structures in Images , 2003, International Journal of Computer Vision.