Compact Part-Based Shape Spaces for Dense Correspondences

We consider the problem of establishing dense correspondences within a set of related shapes of strongly varying geometry. For such input, traditional shape matching approaches often produce unsatisfactory results. We propose an ensemble optimization method that improves given coarse correspondences to obtain dense correspondences. Following ideas from minimum description length approaches, it maximizes the compactness of the induced shape space to obtain high-quality correspondences. We make a number of improvements that are important for computer graphics applications: Our approach handles meshes of general topology and handles partial matching between input of varying topology. To this end we introduce a novel part-based generative statistical shape model. We develop a novel analysis algorithm that learns such models from training shapes of varying topology. We also provide a novel synthesis method that can generate new instances with varying part layouts and subject to generic variational constraints. In practical experiments, we obtain a substantial improvement in correspondence quality over state-of-the-art methods. As example application, we demonstrate a system that learns shape families as assemblies of deformable parts and permits real-time editing with continuous and discrete variability.

[1]  Miriah D. Meyer,et al.  Entropy-Based Particle Systems for Shape Correspondence , 2006 .

[2]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[3]  Daniel Cohen-Or,et al.  Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering , 2011, ACM Trans. Graph..

[4]  Alla Sheffer,et al.  Cross-parameterization and compatible remeshing of 3D models , 2004, ACM Trans. Graph..

[5]  Ghassan Hamarneh,et al.  Prior Knowledge for Part Correspondence , 2011, Comput. Graph. Forum.

[6]  Hildur Ólafsdóttir,et al.  Adding Curvature to Minimum Description Length Shape Models , 2003, BMVC.

[7]  Hans Henrik Thodberg,et al.  Minimum Description Length Shape and Appearance Models , 2003, IPMI.

[8]  Ron Kimmel,et al.  Generalized multidimensional scaling: A framework for isometry-invariant partial surface matching , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Li Zhang,et al.  Spacetime faces: high resolution capture for modeling and animation , 2004, SIGGRAPH 2004.

[10]  Leif Kobbelt,et al.  A remeshing approach to multiresolution modeling , 2004, SGP '04.

[11]  Timothy F. Cootes,et al.  Building 3-D Statistical Shape Models by Direct Optimization , 2010, IEEE Transactions on Medical Imaging.

[12]  Thomas A. Funkhouser,et al.  Möbius voting for surface correspondence , 2009, ACM Trans. Graph..

[13]  Aaron Hertzmann,et al.  Learning 3D mesh segmentation and labeling , 2010, ACM Trans. Graph..

[14]  Hans-Peter Seidel,et al.  A Correlated Parts Model for Object Detection in Large 3D Scans , 2013, Comput. Graph. Forum.

[15]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[16]  Gabriel Taubin,et al.  SSD: Smooth Signed Distance Surface Reconstruction , 2011, Comput. Graph. Forum.

[17]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[18]  Marc Alexa,et al.  As-rigid-as-possible surface modeling , 2007, Symposium on Geometry Processing.

[19]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[20]  Byung-Uck Kim,et al.  Real-time data driven deformation using kernel canonical correlation analysis , 2008, ACM Trans. Graph..

[21]  Byung-Uck Kim,et al.  Real-time data driven deformation using kernel canonical correlation analysis , 2008, SIGGRAPH 2008.

[22]  Leonidas J. Guibas,et al.  An optimization approach for extracting and encoding consistent maps in a shape collection , 2012, ACM Trans. Graph..

[23]  Leonidas J. Guibas,et al.  An Optimization Approach to Improving Collections of Shape Maps , 2011, Comput. Graph. Forum.

[24]  Timothy F. Cootes,et al.  A minimum description length approach to statistical shape modeling , 2002, IEEE Transactions on Medical Imaging.

[25]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[26]  Leonidas J. Guibas,et al.  One Point Isometric Matching with the Heat Kernel , 2010, Comput. Graph. Forum.

[27]  Szymon Rusinkiewicz,et al.  Global non-rigid alignment of 3-D scans , 2007, ACM Trans. Graph..

[28]  Aaron Hertzmann,et al.  Learning 3D mesh segmentation and labeling , 2010, SIGGRAPH 2010.

[29]  Fernando De la Torre,et al.  Interactive region-based linear 3D face models , 2011, SIGGRAPH 2011.

[30]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[31]  Hao Li,et al.  Global Correspondence Optimization for Non‐Rigid Registration of Depth Scans , 2008, Comput. Graph. Forum.

[32]  Bruno Lévy,et al.  Least squares conformal maps for automatic texture atlas generation , 2002, ACM Trans. Graph..

[33]  Christopher J. Taylor,et al.  Automatic construction of eigenshape models by direct optimization , 1998, Medical Image Anal..

[34]  Fernando De la Torre,et al.  Interactive region-based linear 3D face models , 2011, ACM Trans. Graph..

[35]  Hans-Peter Seidel,et al.  Meshless modeling of deformable shapes and their motion , 2008, SCA '08.

[36]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[37]  Vladlen Koltun,et al.  Joint shape segmentation with linear programming , 2011, ACM Trans. Graph..

[38]  Kalle Åström,et al.  Minimizing the description length using steepest descent , 2003, BMVC.

[39]  Vladimir G. Kim,et al.  Blended intrinsic maps , 2011, ACM Trans. Graph..

[40]  Stephen DiVerdi,et al.  Exploring collections of 3D models using fuzzy correspondences , 2012, ACM Trans. Graph..

[41]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[42]  Timothy F. Cootes,et al.  3D Statistical Shape Models Using Direct Optimisation of Description Length , 2002, ECCV.

[43]  Hans-Peter Meinzer,et al.  3D Active Shape Models Using Gradient Descent Optimization of Description Length , 2005, IPMI.

[44]  Brett Allen,et al.  Exploring the space of human body shapes , 2004 .

[45]  Christopher J. Taylor,et al.  Automatic Landmark Generation for Point Distribution Models , 1994, BMVC.