Map-based exploration of intrinsic shape differences and variability

We develop a novel formulation for the notion of shape differences, aimed at providing detailed information about the location and nature of the differences or distortions between the two shapes being compared. Our difference operator, derived from a shape map, is much more informative than just a scalar global shape similarity score, rendering it useful in a variety of applications where more refined shape comparisons are necessary. The approach is intrinsic and is based on a linear algebraic framework, allowing the use of many common linear algebra tools (e.g, SVD, PCA) for studying a matrix representation of the operator. Remarkably, the formulation allows us not only to localize shape differences on the shapes involved, but also to compare shape differences across pairs of shapes, and to analyze the variability in entire shape collections based on the differences between the shapes. Moreover, while we use a map or correspondence to define each shape difference, consistent correspondences between the shapes are not necessary for comparing shape differences, although they can be exploited if available. We give a number of applications of shape differences, including parameterizing the intrinsic variability in a shape collection, exploring shape collections using local variability at different scales, performing shape analogies, and aligning shape collections.

[1]  D'arcy W. Thompson,et al.  On Growth and Form , 1917, Nature.

[2]  Ulrich Pinkall,et al.  Computing Discrete Minimal Surfaces and Their Conjugates , 1993, Exp. Math..

[3]  F. Bookstein Shape and the information in medical images: a decade of the morphometric synthesis , 1997, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[4]  Martin Styner,et al.  Shape versus Size: Improved Understanding of the Morphology of Brain Structures , 2001, MICCAI.

[5]  Timothy F. Cootes,et al.  Statistical models of appearance for medical image analysis and computer vision , 2001, SPIE Medical Imaging.

[6]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[7]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[8]  P. Thomas Fletcher,et al.  Principal geodesic analysis for the study of nonlinear statistics of shape , 2004, IEEE Transactions on Medical Imaging.

[9]  Jovan Popovic,et al.  Deformation transfer for triangle meshes , 2004, ACM Trans. Graph..

[10]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[11]  W. Eric L. Grimson,et al.  Detection and analysis of statistical differences in anatomical shape , 2005, Medical Image Anal..

[12]  Dragomir Anguelov,et al.  SCAPE: shape completion and animation of people , 2005, ACM Trans. Graph..

[13]  Ron Kimmel,et al.  Generalized multidimensional scaling: A framework for isometry-invariant partial surface matching , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Scott Schaefer,et al.  Image deformation using moving least squares , 2006, ACM Trans. Graph..

[15]  Demetri Terzopoulos,et al.  Multilinear (Tensor) ICA and Dimensionality Reduction , 2007, ICA.

[16]  Martin Styner,et al.  STATISTICAL SHAPE ANALYSIS OF BRAIN STRUCTURES USING SPHERICAL WAVELETS , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[17]  M. Kilian,et al.  Geometric modeling in shape space , 2007, SIGGRAPH 2007.

[18]  Craig Gotsman,et al.  Variational harmonic maps for space deformation , 2009, ACM Trans. Graph..

[19]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[20]  Alexander M. Bronstein,et al.  Numerical Geometry of Non-Rigid Shapes , 2009, Monographs in Computer Science.

[21]  Paul M. Thompson,et al.  Multivariate Tensor-based Morphometry on Surfaces: Application to Mapping Ventricular Abnormalities in Hiv/aids Mapping Methods Have Revealed the 3d Profile of Structural Brain , 2022 .

[22]  Arthur W. Toga,et al.  Metric-induced optimal embedding for intrinsic 3D shape analysis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  H. Brezis Functional Analysis, Sobolev Spaces and Partial Differential Equations , 2010 .

[24]  Radu Horaud,et al.  Shape matching based on diffusion embedding and on mutual isometric consistency , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[25]  Vladimir G. Kim,et al.  Blended intrinsic maps , 2011, ACM Trans. Graph..

[26]  Yücel Yemez,et al.  Eurographics Symposium on Geometry Processing 2011 Coarse-to-fine Combinatorial Matching for Dense Isometric Shape Correspondence , 2022 .

[27]  Leonidas J. Guibas,et al.  Exploration of continuous variability in collections of 3D shapes , 2011, ACM Trans. Graph..

[28]  Stephen DiVerdi,et al.  Exploring collections of 3D models using fuzzy correspondences , 2012, ACM Trans. Graph..

[29]  Chang Shu,et al.  Posture-invariant statistical shape analysis using Laplace operator , 2012, Comput. Graph..

[30]  Henrik Schumacher Conformal Maps and p-Dirichlet Energies , 2013 .

[31]  Leonidas J. Guibas,et al.  Analysis and Visualization of Maps Between Shapes , 2013, Comput. Graph. Forum.

[32]  Anuj Srivastava,et al.  Statistical Shape Analysis , 2014, Computer Vision, A Reference Guide.