4D deformable models with temporal constraints: application to 4D cardiac image segmentation

Segmentation of time series of 3D cardiac images is clinically used for the assessment of the mechanical function of the left ventricle. To take into account the 4D (3D+T) nature of those images, we propose to extend the deformable surface framework by introducing time-dependent constraints. Thus, in addition to computing an internal force for enforcing the regularity of the deformable model, prior motion knowledge is introduced in the deformation process through either temporal smoothing or trajectory constraints. In this paper, deformable surfaces are represented as simplex meshes owing to their generality and their ability to compute mean curvature at each vertex. The segmentation accuracy of this 4D deformable model is estimated on synthetic SPECT image sequences for which a ground truth about the LV volume is known. Segmentation of non-synthetic SPECT and other modalities 4D images is also discussed.

[1]  M. Giger,et al.  Automatic segmentation of liver structure in CT images. , 1993, Medical physics.

[2]  Baba C. Vemuri,et al.  From global to local, a continuum of shape models with fractal priors , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  James S. Duncan,et al.  Estimation of 3D left ventricular deformation from echocardiography , 2001, Medical Image Anal..

[4]  ISAAC COHEN,et al.  Using deformable surfaces to segment 3-D images and infer differential structures , 1992, CVGIP Image Underst..

[5]  O. Gérard,et al.  Efficient model-based quantification of left ventricular function in 3-D echocardiography , 2002, IEEE Transactions on Medical Imaging.

[6]  Hervé Delingette,et al.  A Parallel Implementation of Non-rigid Registration Using a Volumetric Biomechanical Model , 2003, WBIR.

[7]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[8]  Hervé Delingette,et al.  General Object Reconstruction Based on Simplex Meshes , 1999, International Journal of Computer Vision.

[9]  Nicholas Ayache,et al.  Dense Non-Rigid Motion Estimation in Sequences of Medical Images Using Differential Constraints , 1995, CAIP.

[10]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[11]  Johan Montagnat,et al.  A review of deformable surfaces: topology, geometry and deformation , 2001, Image Vis. Comput..

[12]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[13]  Nicholas Ayache,et al.  Frequency-Based Nonrigid Motion Analysis: Application to Four Dimensional Medical Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  James S. Duncan,et al.  Combinative Multi-scale Level Set Framework for Echocardiographic Image Segmentation , 2002, MICCAI.

[15]  Alejandro F. Frangi,et al.  ICA vs. PCA Active Appearance Models: Application to Cardiac MR Segmentation , 2003, MICCAI.

[16]  Johan Montagnat,et al.  Globally constrained deformable models for 3D object reconstruction , 1998, Signal Process..

[17]  Rémi Ronfard,et al.  Region-based strategies for active contour models , 1994, International Journal of Computer Vision.

[18]  Johan Montagnat,et al.  Anisotropic filtering for model-based segmentation of 4D cylindrical echocardiographic images , 2003, Pattern Recognit. Lett..

[19]  Bahman Rezaie,et al.  Assessment of left ventricular ejection fraction from technetium-99m-methoxy isobutyl isonitrile multiple-gated radionuclide angiocardiography , 1993, IEEE Trans. Medical Imaging.

[20]  Alejandro F. Frangi,et al.  Three-dimensional modeling for functional analysis of cardiac images, a review , 2001, IEEE Transactions on Medical Imaging.

[21]  Jyrki Lötjönen,et al.  Model extraction from magnetic resonance volume data using the deformable pyramid , 1999, Medical Image Anal..

[22]  Laurent D. Cohen,et al.  Using Deformable Surfaces to Segment 3-D Images and Infer Differential Structures , 1992, ECCV.

[23]  Michel Barlaud,et al.  Space-time segmentation using level set active contours applied to myocardial gated SPECT , 2001, IEEE Transactions on Medical Imaging.

[24]  Touradj Ebrahimi,et al.  MESH: measuring errors between surfaces using the Hausdorff distance , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[25]  Fernando Bello,et al.  Measuring Global and Local Spatial Correspondence Using Information Theory , 1998, MICCAI.

[26]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[27]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[28]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Jean-Antoine Désidéri,et al.  An Electro-mechanical Model of the Heart for Cardiac Image Analysis , 2001, MICCAI.

[30]  Daniel Rueckert,et al.  Construction of a Statistical Model for Cardiac Motion Analysis Using Nonrigid Image Registration , 2003, IPMI.

[31]  Alain Pitiot,et al.  Expert knowledge-guided segmentation system for brain MRI , 2003, NeuroImage.

[32]  Laurent D. Cohen,et al.  Tracking and motion analysis of the left ventricle with deformable superquadrics , 1996, Medical Image Anal..

[33]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[34]  P. Clarysse,et al.  A FEM-based deformable model for the 3D segmentation and tracking of the heart in cardiac MRI , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[35]  Xavier Pennec.  L'incertitude dans les problèmes de reconnaissance et de recalage - Applications en imagerie médicale et biologie moléculaire , 1996 .

[36]  Johan Montagnat,et al.  A Levelset Based Method for Segmenting the Heart in 3D+T Gated SPECT Images , 2003, FIMH.

[37]  Nicholas Ayache,et al.  Definition of a four-dimensional continuous planispheric transformation for the tracking and the analysis of left-ventricle motion , 1998, Medical Image Anal..

[38]  Demetri Terzopoulos,et al.  A dynamic finite element surface model for segmentation and tracking in multidimensional medical images with application to cardiac 4D image analysis. , 1995, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[39]  Alejandro F. Frangi,et al.  Automatic construction of multiple-object three-dimensional statistical shape models: application to cardiac modeling , 2002, IEEE Transactions on Medical Imaging.

[40]  Jinah Park,et al.  Analysis of left ventricular wall motion based on volumetric deformable models and MRI-SPAMM , 1996, Medical Image Anal..

[41]  Jack Bresenham,et al.  Algorithm for computer control of a digital plotter , 1965, IBM Syst. J..

[42]  Nikos Paragios,et al.  A Variational Approach for the Segmentation of the Left Ventricle in Cardiac Image Analysis , 2002, International Journal of Computer Vision.

[43]  P. Bolon,et al.  Analyse d'images: filtrage et segmentation , 1995 .

[44]  D. Lalush,et al.  A realistic spline-based dynamic heart phantom , 1998, 1998 IEEE Nuclear Science Symposium Conference Record. 1998 IEEE Nuclear Science Symposium and Medical Imaging Conference (Cat. No.98CH36255).

[45]  Nicholas Ayache,et al.  Definition of a 4D continuous polar transformation for the tracking and the analysis of LV motion , 1997, CVRMed.

[46]  Hervé Delingette,et al.  Modélisation, déformation et reconnaissance d'objets tridimensionnels à l'aide de maillages simplexes , 1994 .

[47]  Johan Montagnat,et al.  Cylindrical Echocardiographic Image Segmentation Based on 3D Deformable Models , 1999, MICCAI.