Deformable models in medical image analysis

This article surveys deformable models, a promising and vigorously researched computer-assisted medical image analysis technique. Among model-based techniques, deformable models offer a unique and powerful approach to image analysis that combines geometry, physics, and approximation theory. They have proven to be effective in segmenting, matching, and tracking anatomic structures by exploiting (bottom-up) constraints derived from the image data together with (top-down) a priori knowledge about the location, size, and shape of these structures. Deformable model are capable of accommodating the significant variability of biological structures over time and across different individuals. Furthermore, they support highly intuitive interaction mechanisms that, when necessary, allow medical scientists and practitioners to bring their expertise to bear on the model-based image interpretation task. This article reviews the rapidly expanding body of work on the development and application of deformable models to problems of fundamental importance in medical image analysis, including segmentation, shape representation, matching, and motion tracking.

[1]  Timothy F. Cootes,et al.  The Use of Active Shape Models for Locating Structures in Medical Images , 1993, IPMI.

[2]  Dmitry B. Goldgof,et al.  Automatic tracking of SPAMM grid and the estimation of deformation parameters from cardiac MR images , 1994, IEEE Trans. Medical Imaging.

[3]  Nicholas Ayache,et al.  Automatic Retrieval of Anatomical Structures in 3D Medical Images , 1995, CVRMed.

[4]  Baba C. Vemuri,et al.  Multiresolution stochastic hybrid shape models with fractal priors , 1994, TOGS.

[5]  A. Young,et al.  Validation of tagging with MR imaging to estimate material deformation. , 1993, Radiology.

[6]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[7]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[8]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  C. Davatzikos,et al.  Using a deformable surface model to obtain a shape representation of the cortex , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[10]  Surendra Ranganath,et al.  Three-dimensional elastic matching of volumes , 1994, IEEE Trans. Image Process..

[11]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[13]  Keith Waters,et al.  Physical model of facial tissue and muscle articulation derived from computer tomography data , 1992, Other Conferences.

[14]  Thomas S. Huang,et al.  Motion analysis and epicardial deformation estimation from angiography data , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Wei-Chung Lin,et al.  A new surface interpolation technique for reconstructing 3-D objects from serial cross sections , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[16]  Dmitry B. Goldgof,et al.  Motion analysis of nonrigid surfaces , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Frederic Fol Leymarie,et al.  Tracking Deformable Objects in the Plane Using an Active Contour Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  W. Eric L. Grimson,et al.  Volumetric object modeling for surgical simulation , 1998, Medical Image Anal..

[19]  Kostas Delibasis,et al.  Designing Fourier Descriptor-Based Geometric Models for Object Interpretation in Medical Images Using Genetic Algorithms , 1997, Comput. Vis. Image Underst..

[20]  Richard Szeliski,et al.  Modeling surfaces of arbitrary topology with dynamic particles , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Paul M. Thompson,et al.  Detection, visualization and animation of abnormal anatomic structure with a deformable probabilistic brain atlas based on random vector field transformations , 1997, Medical Image Anal..

[22]  Marie-Odile Berger Snake growing , 1990, ECCV.

[23]  Guido Gerig,et al.  Segmentation of 2-D and 3-D objects from MRI volume data using constrained elastic deformations of flexible Fourier contour and surface models , 1996, Medical Image Anal..

[24]  James S. Duncan,et al.  Modular system for image analysis using a game-theoretic framework , 1992, Image Vis. Comput..

[25]  Mehran Moshfeghi,et al.  Elastic matching of multimodality medical images , 1991, CVGIP Graph. Model. Image Process..

[26]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  J. Z. Zhu,et al.  The finite element method , 1977 .

[28]  Dimitris N. Metaxas,et al.  Automated 3D Segmentation Using Deformable Models and Fuzzy Affinity , 1997, IPMI.

[29]  Ajit Singh,et al.  Cardiac MR image segmentation using deformable models , 1993, Proceedings of Computers in Cardiology Conference.

[30]  Demetri Terzopoulos,et al.  Topologically adaptable snakes , 1995, Proceedings of IEEE International Conference on Computer Vision.

[31]  Nicholas Ayache,et al.  Non-Rigid Motion Analysis in Medical Images: a Physically Based Approach , 1993, IPMI.

[32]  Gábor Székely,et al.  Velcro Surfaces: Fast Initialization of Deformable Models , 1997, Comput. Vis. Image Underst..

[33]  David N. Levin,et al.  "Brownian Strings": Segmenting Images with Stochastically Deformable Contours , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Nicholas Ayache,et al.  Tracking Points on Deformable Objects Using Curvature Information , 1992, ECCV.

[35]  Irfan Essa,et al.  Physically-based Modeling for Graphics and Vision , 1992 .

[36]  Richard Szeliski,et al.  Anatomy-Based Registration for Computer-Integrated Surgery , 1995, CVRMed.

[37]  L. Axel,et al.  Heart wall motion: improved method of spatial modulation of magnetization for MR imaging. , 1989, Radiology.

[38]  C VemuriBaba,et al.  Shape Modeling with Front Propagation , 1995 .

[39]  Jinah Park,et al.  Analysis of left ventricular wall motion based on volumetric deformable models and MRI-SPAMM , 1996, Medical Image Anal..

[40]  James M. Ortega,et al.  Model-based boundary estimation of complex objects using hierarchical active surface templates , 1995, Pattern Recognit..

[41]  Stanley M. Dunn,et al.  Non-rigid motion analysis and feature labelling of the growth cone , 1994, Proceedings of IEEE Workshop on Biomedical Image Analysis.

[42]  Christopher J. Taylor,et al.  Model-Based Interpretation of 3D Medical Images , 1993, BMVC.

[43]  Rebecca Fahrig,et al.  Segmentation of medical images using an active-contour model incorporating region-based image features , 1994, Other Conferences.

[44]  James S. Duncan,et al.  Toward reliable, noninvasive measurement of myocardial function from 4D images , 1994, Medical Imaging.

[45]  Jean-Philippe Thirion,et al.  Extremal points: definition and application to 3D image registration , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[46]  James S. Duncan,et al.  Deformable Fourier models for surface finding in 3-D images , 1992, Other Conferences.

[47]  Nicholas Ayache,et al.  Fast segmentation, tracking, and analysis of deformable objects , 1993, 1993 (4th) International Conference on Computer Vision.

[48]  Alistair A. Young,et al.  Non-rigid heart wall motion using MR tagging , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  Marcel Worring,et al.  Parameterized Feasible Boundaries in Gradient Vector Fields , 1996, Comput. Vis. Image Underst..

[50]  C. Kambhamettu,et al.  Curvature-based approach to point correspondence recovery in conformal nonrigid motion , 1994 .

[51]  F. Prêteux,et al.  Directional adaptive deformable models for segmentation with application to 2D and 3D medical images , 1993 .

[52]  Laurent D. Cohen,et al.  A Parametric Deformable Model to Fit Unstructured 3D Data , 1998, Comput. Vis. Image Underst..

[53]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[54]  Dmitry B. Goldgof,et al.  Adaptive-Size Meshes for Rigid and Nonrigid Shape Analysis and Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Yongmin Kim,et al.  A multiple active contour model for cardiac boundary detection on echocardiographic sequences , 1996, IEEE Trans. Medical Imaging.

[56]  Guillermo Sapiro,et al.  Minimal Surfaces Based Object Segmentation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Alexis Gourdon Simplification of Irregular Surface Meshes in 3D Medical Images , 1995, CVRMed.

[58]  James S. Duncan,et al.  Boundary Finding with Parametrically Deformable Models , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Guillermo Sapiro,et al.  Object detection and measurements in medical images via geodesic deformable contours , 1995, Optics & Photonics.

[60]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[61]  Hervé Delingette Decimation of iso-surfaces with deformable models , 1997, CVRMed.

[62]  Jayant Shah,et al.  Hybrid boundary-based and region-based deformable models for biomedical image segmentation , 1994, Optics & Photonics.

[63]  Nicholas Ayache,et al.  Locally affine registration of free-form surfaces , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[64]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[65]  Truong Q. Nguyen,et al.  Wavelets and filter banks , 1996 .

[66]  Richard Szeliski,et al.  Recovering the Position and Orientation of Free-Form Objects from Image Contours Using 3D Distance Maps , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[67]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[68]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[69]  Fred L. Bookstein,et al.  Thin-Plate Splines and the Atlas Problem for Biomedical Images , 1991, IPMI.

[70]  Benjamin B. Kimia,et al.  Volumetric Segmentation of Medical Images by Three-Dimensional Bubbles , 1997, Comput. Vis. Image Underst..

[71]  Michael W. Vannier,et al.  Mathematical modeling of the heart using magnetic resonance imaging , 1992, IEEE Trans. Medical Imaging.

[72]  Edward L. Chaney,et al.  Segmentation of Medical Image Objects Using Deformable Shape Loci , 1996, IPMI.

[73]  Nicholas Ayache,et al.  Frequency-Based Nonrigid Motion Analysis: Application to Four Dimensional Medical Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  Alistair A. Young,et al.  Tracking and finite element analysis of stripe deformation in magnetic resonance tagging , 1995, IEEE Trans. Medical Imaging.

[75]  Chin-Tu Chen,et al.  A new surface interpolation technique for reconstructing 3D objects from serial cross-sections , 1989, Comput. Vis. Graph. Image Process..

[76]  Baba C. Vemuri,et al.  Multi-Resolution Stochastic 3D Shape Models for Image Segmentation , 1993, IPMI.

[77]  Katsushi Ikeuchi,et al.  Shape representation and image segmentation using deformable surfaces , 1992, Image Vis. Comput..

[78]  Naonori Ueda,et al.  Tracking Moving Contours Using Energy-Minimizing Elastic Contour Models , 1992, ECCV.

[79]  Donald P. Greenberg,et al.  Time-dependent three-dimensional intravascular ultrasound , 1995, SIGGRAPH.

[80]  ISAAC COHEN,et al.  Using deformable surfaces to segment 3-D images and infer differential structures , 1992, CVGIP Image Underst..

[81]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..

[82]  R. Bajcsy,et al.  Elastically Deforming 3D Atlas to Match Anatomical Brain Images , 1993, Journal of computer assisted tomography.

[83]  P. Cinquin,et al.  Dynamic Segmentation : Detecting Complex Topology 3D-object , 1991, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Volume 13: 1991.

[84]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[85]  Richard Szeliski,et al.  Tracking with Kalman snakes , 1993 .

[86]  Long-Wen Chang,et al.  Reconstruction of 3D medical images: A nonlinear interpolation technique for reconstruction of 3D medical images , 1991, CVGIP Graph. Model. Image Process..

[87]  Nicholas Ayache,et al.  Medical computer vision, virtual reality and robotics , 1995, Image Vis. Comput..

[88]  Jerry L. Prince,et al.  Image registration based on boundary mapping , 1996, IEEE Trans. Medical Imaging.

[89]  Nicholas Ayache,et al.  A General Scheme for Automatically Building 3D Morphometric Anatomical Atlases: application to a Sku , 1995 .

[90]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[91]  Martin R. Stytz,et al.  Three-dimensional medical imaging: algorithms and computer systems , 1991, CSUR.

[92]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[93]  Ross T. Whitaker,et al.  Volumetric deformable models: active blobs , 1994, Other Conferences.

[94]  Jerry L. Prince,et al.  An active contour model for mapping the cortex , 1995, IEEE Trans. Medical Imaging.

[95]  James S. Duncan,et al.  Bending and stretching models for LV wall motion analysis from curves and surfaces , 1992, Image Vis. Comput..

[96]  A. Gupta,et al.  Segmentation and tracking of cine cardiac MR and CT images using a 3-D deformation model , 1994, Computers in Cardiology 1994.

[97]  Francoise J. Preteux,et al.  Deformable markers: mathematical morphology for active contour models control , 1991, Optics & Photonics.

[98]  Alistair A. Young,et al.  Semi-automatic tracking of myocardial motion in MR tagged images , 1995, IEEE Trans. Medical Imaging.

[99]  Kostas Delibasis,et al.  Anatomical object recognition using deformable geometric models , 1994, Image Vis. Comput..

[100]  Steven D. Pieper,et al.  Interactive graphics for plastic surgery: a task-level analysis and implementation , 1992, I3D '92.

[101]  Philippe Cinquin,et al.  From Splines and Snakes to SNAKE SPLINES , 1991, Geometric Reasoning for Perception and Action.

[102]  Nicholas Ayache,et al.  Features extraction and analysis methods for sequences of ultrasound Images , 1992, Image Vis. Comput..

[103]  Laurent D. Cohen,et al.  Superquadrics and Free-Form Deformations: A Global Model to Fit and Track 3D Medical Data , 1995, CVRMed.

[104]  Greg Turk,et al.  Re-tiling polygonal surfaces , 1992, SIGGRAPH.

[105]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[106]  Robert M. O'Bara,et al.  Geometrically deformed models: a method for extracting closed geometric models form volume data , 1991, SIGGRAPH.

[107]  D. Louis Collins,et al.  Warping of a computerized 3-D atlas to match brain image volumes for quantitative neuroanatomical and functional analysis , 1991, Medical Imaging.

[108]  Steve R. Gunn,et al.  A Robust Snake Implementation; A Dual Active Contour , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[109]  Demetri Terzopoulos,et al.  Computer-assisted registration, segmentation, and 3D reconstruction from images of neuronal tissue sections , 1994, IEEE Trans. Medical Imaging.

[110]  Anthony J. Yezzi,et al.  A geometric snake model for segmentation of medical imagery , 1997, IEEE Transactions on Medical Imaging.

[111]  Demetri Terzopoulos,et al.  Adaptive meshes and shells: irregular triangulation, discontinuities, and hierarchical subdivision , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[112]  James S. Duncan,et al.  Deformable boundary finding influenced by region homogeneity , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[113]  Bernard Widrow,et al.  The "Rubber-Mask" Technique I. Pattern Measurement and Analysis , 1973 .

[114]  Thomas S. Huang,et al.  Modeling, Analysis, and Visualization of Left Ventricle Shape and Motion by Hierarchical Decomposition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[115]  Alan L. Yuille,et al.  Deformable Templates for Feature Extraction from Medical Images , 1990, ECCV.

[116]  Isabelle Herlin,et al.  A deformable region model using stochastic processes applied to echocardiographic images , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[117]  C. Broit Optimal registration of deformed images , 1981 .

[118]  Alan C. Evans,et al.  Multiple surface identification and matching in magnetic resonance images , 1994, Other Conferences.

[119]  Nicholas Ayache,et al.  Medical image tracking , 1993 .

[120]  Demetri Terzopoulos,et al.  A dynamic finite element surface model for segmentation and tracking in multidimensional medical images with application to cardiac 4D image analysis. , 1995, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[121]  Max A. Viergever,et al.  A discrete dynamic contour model , 1995, IEEE Trans. Medical Imaging.

[122]  Jinah Park,et al.  Volumetric deformable models with parameter functions: A new approach to the 3D motion analysis of the LV from MRI-SPAMM , 1995, Proceedings of IEEE International Conference on Computer Vision.

[123]  Alex Pentland,et al.  Closed-Form Solutions for Physically Based Shape Modeling and Recognition , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[124]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[125]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[126]  L. Cohen,et al.  Analyzing the Deformation of the Left Ventricle of the Heart with a Parametric Deformable Model , 1996 .

[127]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[128]  Demetri Terzopoulos,et al.  On Matching Deformable Models to Images , 1987, Topical Meeting on Machine Vision.