Optimal Mass Transport for Shape Matching and Comparison

Surface based 3D shape analysis plays a fundamental role in computer vision and medical imaging. This work proposes to use optimal mass transport map for shape matching and comparison, focusing on two important applications including surface registration and shape space. The computation of the optimal mass transport map is based on Monge-Brenier theory, in comparison to the conventional method based on Monge-Kantorovich theory, this method significantly improves the efficiency by reducing computational complexity from O(n2) to O(n). For surface registration problem, one commonly used approach is to use conformal map to convert the shapes into some canonical space. Although conformal mappings have small angle distortions, they may introduce large area distortions which are likely to cause numerical instability thus resulting failures of shape analysis. This work proposes to compose the conformal map with the optimal mass transport map to get the unique area-preserving map, which is intrinsic to the Riemannian metric, unique, and diffeomorphic. For shape space study, this work introduces a novel Riemannian framework, Conformal Wasserstein Shape Space, by combing conformal geometry and optimal mass transport theory. In our work, all metric surfaces with the disk topology are mapped to the unit planar disk by a conformal mapping, which pushes the area element on the surface to a probability measure on the disk. The optimal mass transport provides a map from the shape space of all topological disks with metrics to the Wasserstein space of the disk and the pullback Wasserstein metric equips the shape space with a Riemannian metric. We validate our work by numerous experiments and comparisons with prior approaches and the experimental results demonstrate the efficiency and efficacy of our proposed approach.

[1]  Xianfeng Gu,et al.  A discrete uniformization theorem for polyhedral surfaces , 2013, Journal of Differential Geometry.

[2]  Hamid Laga,et al.  Landmark‐Guided Elastic Shape Analysis of Spherically‐Parameterized Surfaces , 2013, Comput. Graph. Forum.

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  S. Yau,et al.  Variational Principles for Minkowski Type Problems, Discrete Optimal Transport, and Discrete Monge-Ampere Equations , 2013, 1302.5472.

[5]  Paul M. Thompson,et al.  A framework for computational anatomy , 2002 .

[6]  Alexander M. Bronstein,et al.  Shape Recognition with Spectral Distances , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Franz Aurenhammer,et al.  Power Diagrams: Properties, Algorithms and Applications , 1987, SIAM J. Comput..

[8]  HARRY BLUM,et al.  Shape description using weighted symmetric axis features , 1978, Pattern Recognit..

[9]  L. Kantorovich On a Problem of Monge , 2006 .

[10]  Anuj Srivastava,et al.  Elastic Geodesic Paths in Shape Space of Parameterized Surfaces , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[12]  A. Dale,et al.  Subregional neuroanatomical change as a biomarker for Alzheimer's disease , 2009, Proceedings of the National Academy of Sciences.

[13]  LévyBruno,et al.  Least squares conformal maps for automatic texture atlas generation , 2002 .

[14]  Allen R. Tannenbaum,et al.  Texture Mapping via Optimal Mass Transport , 2010, IEEE Transactions on Visualization and Computer Graphics.

[15]  Richard M. Leahy,et al.  Comparison of landmark-based and automatic methods for cortical surface registration , 2010, NeuroImage.

[16]  Y. Brenier Polar Factorization and Monotone Rearrangement of Vector-Valued Functions , 1991 .

[17]  C. Villani Topics in Optimal Transportation , 2003 .

[18]  Bruno Lévy,et al.  Least squares conformal maps for automatic texture atlas generation , 2002, ACM Trans. Graph..

[19]  Monica K. Hurdal,et al.  Discrete conformal methods for cortical brain flattening , 2009, NeuroImage.

[20]  Martin Bauer,et al.  Almost Local Metrics on Shape Space of Hypersurfaces in n-Space , 2010, SIAM J. Imaging Sci..

[21]  Douglas W. Jones,et al.  Morphometric analysis of lateral ventricles in schizophrenia and healthy controls regarding genetic and disease-specific factors. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Anuj Srivastava,et al.  Statistical shape analysis: clustering, learning, and testing , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[24]  Patrice Koehl,et al.  Automatic Alignment of Genus-Zero Surfaces , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Ron Kimmel,et al.  Generalized multidimensional scaling: A framework for isometry-invariant partial surface matching , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Quentin Mérigot,et al.  A Multiscale Approach to Optimal Transport , 2011, Comput. Graph. Forum.

[27]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Lijun Yin,et al.  A high-resolution 3D dynamic facial expression database , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[29]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[30]  Ron Kikinis,et al.  Conformal Geometry and Brain Flattening , 1999, MICCAI.

[31]  Anuj Srivastava,et al.  Looking for Shapes in Two-Dimensional Cluttered Point Clouds , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  S. Rachev,et al.  Mass transportation problems , 1998 .

[33]  Paul M. Thompson,et al.  Surface fluid registration of conformal representation: Application to detect disease burden and genetic influence on hippocampus , 2013, NeuroImage.

[34]  Martin Bauer,et al.  Sobolev metrics on shape space of surfaces in n-space , 2010 .

[35]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[36]  Eric L. Schwartz,et al.  A Numerical Solution to the Generalized Mapmaker's Problem: Flattening Nonconvex Polyhedral Surfaces , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  W. Torgerson Multidimensional scaling: I. Theory and method , 1952 .

[38]  Alan C. Bovik,et al.  Anthropometric 3D Face Recognition , 2010, International Journal of Computer Vision.

[39]  Leo Grady,et al.  FOCUSR: Feature Oriented Correspondence Using Spectral Regularization--A Method for Precise Surface Matching , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Xin Zhao,et al.  Area-Preservation Mapping using Optimal Mass Transport , 2013, IEEE Transactions on Visualization and Computer Graphics.

[41]  Wei Zeng,et al.  Area Preserving Brain Mapping , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Pierre Alliez,et al.  An Optimal Transport Approach to Robust Reconstruction and Simplification of 2d Shapes , 2022 .

[43]  Anuj Srivastava,et al.  Shape Analysis of Elastic Curves in Euclidean Spaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Lei Zhu,et al.  Area-Preserving Mappings for the Visualization of Medical Structures , 2003, MICCAI.

[45]  Mathieu Desbrun,et al.  Blue noise through optimal transport , 2012, ACM Trans. Graph..

[46]  Anuj Srivastava,et al.  Elastic Shape Matching of Parameterized Surfaces Using Square Root Normal Fields , 2012, ECCV.

[47]  Gallagher Pryor,et al.  3D nonrigid registration via optimal mass transport on the GPU , 2009, Medical Image Anal..

[48]  Thomas A. Funkhouser,et al.  Möbius voting for surface correspondence , 2009, ACM Trans. Graph..

[49]  Dongmei Zhang,et al.  Harmonic maps and their applications in surface matching , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[50]  Shing-Tung Yau,et al.  Computational Conformal Geometry , 2016 .

[51]  S. Yau,et al.  Numerical Computation of Surface Conformal Mappings , 2012 .

[52]  Laurent Younes,et al.  Spaces and manifolds of shapes in computer vision: An overview , 2012, Image Vis. Comput..

[53]  Hong Qin,et al.  Ricci Flow for 3 D Shape Analysis , 2007 .

[54]  Nicolas Bonnotte,et al.  From Knothe's Rearrangement to Brenier's Optimal Transport Map , 2012, SIAM J. Math. Anal..

[55]  Paul M. Thompson,et al.  Genus zero surface conformal mapping and its application to brain surface mapping , 2004, IEEE Transactions on Medical Imaging.

[56]  D. Mumford,et al.  A Metric on Shape Space with Explicit Geodesics , 2007, 0706.4299.

[57]  Thomas A. Funkhouser,et al.  Algorithms to automatically quantify the geometric similarity of anatomical surfaces , 2011, Proceedings of the National Academy of Sciences.

[58]  Lei Zhu,et al.  Optimal Mass Transport for Registration and Warping , 2004, International Journal of Computer Vision.

[59]  Anqi Qiu,et al.  Multi-manifold diffeomorphic metric mapping for aligning cortical hemispheric surfaces , 2010, NeuroImage.

[60]  Sen Wang,et al.  High Resolution Tracking of Non-Rigid Motion of Densely Sampled 3D Data Using Harmonic Maps , 2008, International Journal of Computer Vision.

[61]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  David Mumford,et al.  2D-Shape Analysis Using Conformal Mapping , 2004, CVPR.

[63]  Peter Li,et al.  LECTURES ON HARMONIC MAPS , 2011 .

[64]  Wei Zeng,et al.  Ricci Flow for 3D Shape Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.