Learning Population-level Shape Statistics and Anatomy Segmentation From Images: A Joint Deep Learning Model

Statistical shape modeling is an essential tool for the quantitative analysis of anatomical populations. Point distribution models (PDMs) represent the anatomical surface via a dense set of correspondences, an intuitive and easy-to-use shape representation for subsequent applications. These correspondences are exhibited in two coordinate spaces: the local coordinates describing the geometrical features of each individual anatomical surface and the world coordinates representing the population-level statistical shape information after removing global alignment differences across samples in the given cohort. We propose a deep-learning-based framework that simultaneously learns these two coordinate spaces directly from the volumetric images. The proposed joint model serves a dual purpose; the world correspondences can directly be used for shape analysis applications, circumventing the heavy pre-processing and segmentation involved in traditional PDM models. Additionally, the local correspondences can be used for anatomy segmentation. We demonstrate the efficacy of this joint model for both shape modeling applications on two datasets and its utility in inferring the anatomical surface.

[1]  J. Gower Generalized procrustes analysis , 1975 .

[2]  Martin Styner,et al.  Framework for the Statistical Shape Analysis of Brain Structures using SPHARM-PDM. , 2006, The insight journal.

[3]  Guido Gerig,et al.  Particle Based Shape Regression of Open Surfaces with Applications to Developmental Neuroimaging , 2009, MICCAI.

[4]  W. Grove,et al.  A latent trait finite mixture model for the analysis of rating agreement. , 1993, Biometrics.

[5]  Manasi Datar,et al.  Statistical shape modeling of cam femoroacetabular impingement , 2013, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[6]  Wenzheng Tao,et al.  DeepSSM: A Blueprint for Image-to-Shape Deep Learning Models , 2021, ArXiv.

[7]  Ulf Grenander,et al.  Hands: A Pattern Theoretic Study of Biological Shapes , 1990 .

[8]  Ross T. Whitaker,et al.  On the Evaluation and Validation of Off-the-shelf Statistical Shape Modeling Tools: A Clinical Application , 2018, ShapeMI@MICCAI.

[9]  Martin Styner,et al.  Shape Modeling and Analysis with Entropy-Based Particle Systems , 2007, IPMI.

[10]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[11]  L. Kavan,et al.  Unsupervised Shape Normality Metric for Severity Quantification , 2020, ArXiv.

[12]  Guido Gerig,et al.  Morphometry of anatomical shape complexes with dense deformations and sparse parameters , 2014, NeuroImage.

[13]  Ross T. Whitaker,et al.  DeepSSM: A Deep Learning Framework for Statistical Shape Modeling from Raw Images , 2018, ShapeMI@MICCAI.

[14]  Arthur W. Toga,et al.  Diffeomorphic Sulcal Shape Analysis on the Cortex , 2012, IEEE Transactions on Medical Imaging.

[15]  Timothy F. Cootes,et al.  A minimum description length approach to statistical shape modeling , 2002, IEEE Transactions on Medical Imaging.

[16]  Shireen Elhabian,et al.  Uncertain-DeepSSM: From Images to Probabilistic Shape Models , 2020, ShapeMI@MICCAI.

[17]  Shireen Y. Elhabian,et al.  ShapeWorks: Particle-Based Shape Correspondence and Visualization Software , 2017 .

[18]  Mert R. Sabuncu,et al.  An Unsupervised Learning Model for Deformable Medical Image Registration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.