Building 3-D Statistical Shape Models by Direct Optimization

Statistical shape models are powerful tools for image interpretation and shape analysis. A simple, yet effective, way of building such models is to capture the statistics of sampled point coordinates over a training set of example shapes. However, a major drawback of this approach is the need to establish a correspondence across the training set. In 2-D, a correspondence is often defined using a set of manually placed ¿landmarks¿ and linear interpolation to sample the shape in between. Such annotation is, however, time-consuming and subjective, particularly when extended to 3-D. In this paper, we show that it is possible to establish a dense correspondence across the whole training set automatically by treating correspondence as an optimization problem. The objective function we use for the optimization is based on the minimum description length principle, which we argue is a criterion that leads to models with good compactness, specificity, and generalization ability. We manipulate correspondence by reparameterizing each training shape. We describe an explicit representation of reparameterization for surfaces in 3-D that makes it impossible to generate an illegal (i.e., not one-to-one) correspondence. We also describe several large-scale optimization strategies for model building, and perform a detailed analysis of each approach. Finally, we derive quantitative measures of model quality, allowing meaningful comparison between models built using different methods. Results are given for several different training sets of 3-D shapes, which show that the minimum description length models perform significantly better than other approaches.

[1]  Dominik S. Meier,et al.  Parameter space warping: shape-based correspondence between morphologically different objects , 2002, IEEE Transactions on Medical Imaging.

[2]  Timothy F. Cootes,et al.  A minimum description length approach to statistical shape modeling , 2002, IEEE Transactions on Medical Imaging.

[3]  Martin Styner,et al.  Shape versus Size: Improved Understanding of the Morphology of Brain Structures , 2001, MICCAI.

[4]  Alain Pitiot,et al.  Learning Object Correspondences with the Observed Transport Shape Measure , 2003, IPMI.

[5]  Joan Alexis Glaunès,et al.  Surface Matching via Currents , 2005, IPMI.

[6]  Martin Styner,et al.  CORRESPONDENCE EVALUATION IN LOCAL SHAPE ANALYSIS AND STRUCTURAL SUBDIVISION , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[7]  Ron Kikinis,et al.  On the Laplace-Beltrami operator and brain surface flattening , 1999, IEEE Transactions on Medical Imaging.

[8]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[9]  Hans-Peter Meinzer,et al.  Active Shape Models for a Fully Automated 3D Segmentation of the Liver - An Evaluation on Clinical Data , 2006, MICCAI.

[10]  Timothy F. Cootes,et al.  The Use of Active Shape Models for Locating Structures in Medical Images , 1993, IPMI.

[11]  Rachid Deriche,et al.  Implicit Active Shape Models for 3D Segmentation in MR Imaging , 2004, MICCAI.

[12]  Christopher J. Taylor,et al.  Automatic Landmark Generation for Point Distribution Models , 1994, BMVC.

[13]  Rasmus R. Paulsen,et al.  Shape Modelling Using Markov Random Field Restoration of Point Correspondences , 2003, IPMI.

[14]  Shaogang Gong,et al.  A Multi-View Nonlinear Active Shape Model Using Kernel PCA , 1999, BMVC.

[15]  W. Eric L. Grimson,et al.  Small Sample Size Learning for Shape Analysis of Anatomical Structures , 2000, MICCAI.

[16]  Timothy F. Cootes,et al.  A Unified Information-Theoretic Approach to Groupwise Non-rigid Registration and Model Building , 2005, IPMI.

[17]  Anand Rangarajan,et al.  Non rigid registration of shapes via diffeomorphic point matching and clustering , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[18]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[19]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  T Heimann,et al.  Automatic Generation of 3D Statistical Shape Models with Optimal Landmark Distributions , 2007, Methods of Information in Medicine.

[21]  Guido Gerig,et al.  Parametrization of Closed Surfaces for 3-D Shape Description , 1995, Comput. Vis. Image Underst..

[22]  C J Taylor,et al.  An automated method for assessing routine radiographs of patients with total hip replacements , 1997, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[23]  John D. Isaacs,et al.  FcγRIIIA‐158V and rheumatoid arthritis: a confirmation study , 2003 .

[24]  Guido Gerig,et al.  Segmentation of 2-D and 3-D objects from MRI volume data using constrained elastic deformations of flexible Fourier contour and surface models , 1996, Medical Image Anal..

[25]  Anand Rangarajan,et al.  The Softassign Procrustes Matching Algorithm , 1997, IPMI.

[26]  David C. Hogg,et al.  An Adaptive Eigenshape Model , 1995, BMVC.

[27]  Paramate Horkaew,et al.  Construction of 3D Dynamic Statistical Deformable Models for Complex Topological Shapes , 2004, MICCAI.

[28]  P P Smyth,et al.  Vertebral shape: automatic measurement with active shape models. , 1999, Radiology.

[29]  Bjarne K. Ersbøll,et al.  FAME-a flexible appearance modeling environment , 2003, IEEE Transactions on Medical Imaging.

[30]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[31]  Timothy F. Cootes,et al.  An Efficient Method for Constructing Optimal Statistical Shape Models , 2001, MICCAI.

[32]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[33]  Timothy F. Cootes,et al.  Combining point distribution models with shape models based on finite element analysis , 1994, Image Vis. Comput..

[34]  J. Waterton,et al.  Reduced animal use in efficacy testing in disease models with use of sequential experimental designs. , 2000 .

[35]  Hans Henrik Thodberg,et al.  Minimum Description Length Shape and Appearance Models , 2003, IPMI.

[36]  David H. Eberly,et al.  Zoom-Invariant Vision of Figural Shape: The Mathematics of Cores , 1996, Comput. Vis. Image Underst..

[37]  David C. Hogg,et al.  Learning Flexible Models from Image Sequences , 1994, ECCV.

[38]  David A. Rottenberg,et al.  Quasi-Conformally Flat Mapping the Human Cerebellum , 1999, MICCAI.

[39]  Kalle Åström,et al.  Minimizing the description length using steepest descent , 2003, BMVC.

[40]  Nicholas Ayache,et al.  A scheme for automatically building three-dimensional morphometric anatomical atlases: application to a skull atlas , 1998, Medical Image Anal..

[41]  Christopher J. Taylor,et al.  Specificity as a Graph-Based Estimator of Cross-Entropy and KL Divergence , 2006, BMVC.

[42]  Christian R. Shelton,et al.  Morphable Surface Models , 2000, International Journal of Computer Vision.

[43]  Katja Bühler,et al.  MDL Spline Models: Gradient and Polynomial Reparameterisations , 2005, BMVC.

[44]  Alejandro F. Frangi,et al.  Automatic construction of multiple-object three-dimensional shape models: Application to cardiac modeling , 2002 .

[45]  Lawrence H. Staib,et al.  Shape-based 3D surface correspondence using geodesics and local geometry , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[46]  Timothy F. Cootes,et al.  A Minimum Description Length Approach to Statistical Shape Modelling , 2001 .

[47]  Guido Gerig,et al.  Duration of illness and treatment effects on hippocampal volume in male patients with schizophrenia , 2005, British Journal of Psychiatry.

[48]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[49]  Zeng Xiao-ping Non-linear Least Squares Curve Fitting , 2004 .

[50]  Timothy F. Cootes,et al.  3D Statistical Shape Models Using Direct Optimisation of Description Length , 2002, ECCV.

[51]  Jürgen Weese,et al.  Automated 3-D PDM construction from segmented images using deformable models , 2003, IEEE Transactions on Medical Imaging.

[52]  S. Duchesne,et al.  Appearance-Based Segmentation of Medial Temporal Lobe Structures , 2002, NeuroImage.

[53]  Christopher J. Taylor,et al.  Construction of 3D Shape Models of Femoral Articular Cartilage Using Harmonic Maps , 2000, MICCAI.

[54]  Fred L. Bookstein,et al.  Landmark methods for forms without landmarks: morphometrics of group differences in outline shape , 1997, Medical Image Anal..

[55]  Timothy F. Cootes,et al.  Shape Discrimination in the Hippocampus Using an MDL Model , 2003, IPMI.

[56]  Martin Styner,et al.  Evaluation of 3D Correspondence Methods for Model Building , 2003, IPMI.

[57]  Hildur Ólafsdóttir,et al.  Adding Curvature to Minimum Description Length Shape Models , 2003, BMVC.

[58]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Alejandro F. Frangi,et al.  Active shape model segmentation with optimal features , 2002, IEEE Transactions on Medical Imaging.

[60]  Guido Gerig,et al.  Elastic model-based segmentation of 3-D neuroradiological data sets , 1999, IEEE Transactions on Medical Imaging.

[61]  J. Rissanen A UNIVERSAL PRIOR FOR INTEGERS AND ESTIMATION BY MINIMUM DESCRIPTION LENGTH , 1983 .

[62]  Milan Sonka,et al.  Segmentation and interpretation of MR brain images. An improved active shape model , 1998, IEEE Transactions on Medical Imaging.

[63]  Michael I. Miller,et al.  Deformable templates using large deformation kinematics , 1996, IEEE Trans. Image Process..

[64]  Christopher J. Taylor,et al.  A Method of Automated Landmark Generation for Automated 3D PDM Construction , 2000, BMVC.

[65]  Timothy F. Cootes,et al.  A mixture model for representing shape variation , 1999, Image Vis. Comput..

[66]  Hemant D. Tagare,et al.  A geometric criterion for shape-based non-rigid correspondence , 1995, Proceedings of IEEE International Conference on Computer Vision.

[67]  Alex Pentland,et al.  Modal Matching for Correspondence and Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Ch. Brechbuhler,et al.  Parameterisation of closed surfaces for 3-D shape description , 1995 .

[69]  Christopher J. Taylor,et al.  Automatic construction of eigenshape models by direct optimization , 1998, Medical Image Anal..

[70]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[71]  Michael I. Miller,et al.  Volumetric transformation of brain anatomy , 1997, IEEE Transactions on Medical Imaging.

[72]  O. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2002, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[73]  James S. Duncan,et al.  Boundary Finding with Parametrically Deformable Models , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  Hans-Peter Meinzer,et al.  3D Active Shape Models Using Gradient Descent Optimization of Description Length , 2005, IPMI.

[75]  Paul A. Yushkevich,et al.  Parametric Medial Shape Representation in 3-D via the Poisson Partial Differential Equation with Non-linear Boundary Conditions , 2005, IPMI.

[76]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[77]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..

[78]  Timothy F. Cootes,et al.  Building optimal 2D statistical shape models , 2003, Image Vis. Comput..

[79]  C J Taylor,et al.  The use of active shape models for making thickness measurements of articular cartilage from MR images , 1997, Magnetic resonance in medicine.

[80]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[81]  Christopher J. Taylor,et al.  The use of kernel principal component analysis to model data distributions , 2003, Pattern Recognit..

[82]  Alejandro F Frangi,et al.  Automatic construction of 3-D statistical deformation models of the brain using nonrigid registration , 2003, IEEE Transactions on Medical Imaging.

[83]  Richard Szeliski,et al.  Matching 3-D anatomical surfaces with non-rigid deformations using octree-splines , 1993, Proceedings of IEEE Workshop on Biomedical Image Analysis.

[84]  Hans-Christian Hege,et al.  A 3D statistical shape model of the pelvic bone for segmentation , 2004, SPIE Medical Imaging.

[85]  Kanti V. Mardia,et al.  Statistics of Directional Data , 1972 .

[86]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[87]  Paramate Horkaew,et al.  Optimal Deformable Surface Models for 3D Medical Image Analysis , 2003, IPMI.

[88]  Alejandro F. Frangi,et al.  Automatic Construction of 3D Statistical Deformation Models of the Brain using Non-Rigid Registration , 2003, IEEE Trans. Medical Imaging.