A review of segmentation methods in short axis cardiac MR images

For the last 15 years, Magnetic Resonance Imaging (MRI) has become a reference examination for cardiac morphology, function and perfusion in humans. Yet, due to the characteristics of cardiac MR images and to the great variability of the images among patients, the problem of heart cavities segmentation in MRI is still open. This paper is a review of fully and semi-automated methods performing segmentation in short axis images using a cardiac cine MRI sequence. Medical background and specific segmentation difficulties associated to these images are presented. For this particularly complex segmentation task, prior knowledge is required. We thus propose an original categorization for cardiac segmentation methods, with a special emphasis on what level of external information is required (weak or strong) and how it is used to constrain segmentation. After reviewing method principles and analyzing segmentation results, we conclude with a discussion and future trends in this field regarding methodological and medical issues.

[1]  Boudewijn P. F. Lelieveldt,et al.  Time Continuous Tracking and Segmentation of Cardiovascular Magnetic Resonance Images Using Multidimensional Dynamic Programming , 2006, Investigative radiology.

[2]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[3]  B. Cowan,et al.  Model-based Graph Cut Method for Segmentation of the Left Ventricle , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[4]  N Donaldson,et al.  (2011) Fibre-selective Recording from Peripheral Nerves Using a Multiple-contact Cuff: Report on Pilot Pig Experiments. In: 33rd Annual International Conference of the Ieee Engineering in Medicine and Biology Society, Embs , 2022 .

[5]  Georg Mühlenbruch,et al.  Automated vs. manual assessment of left ventricular function in cardiac multidetector row computed tomography: comparison with magnetic resonance imaging , 2006, European Radiology.

[6]  Paul F. Whelan,et al.  Segmenting the Left Ventricle in 3D Using a Coupled ASM and a Learned Non-Rigid Spatial Model , 2009, The MIDAS Journal.

[7]  Ajit Singh,et al.  Cardiac MR image segmentation using deformable models , 1993, Proceedings of Computers in Cardiology Conference.

[8]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[9]  James S. Duncan,et al.  Estimation of 3-D left ventricular deformation from medical images using biomechanical models , 2002, IEEE Transactions on Medical Imaging.

[10]  Anthony J. Yezzi,et al.  A geometric snake model for segmentation of medical imagery , 1997, IEEE Transactions on Medical Imaging.

[11]  Jens von Berg,et al.  Automated Segmentation of the Left Ventricle in Cardiac MRI , 2003, MICCAI.

[12]  S. Hunt,et al.  Right Ventricular Function in Cardiovascular Disease, Part I: Anatomy, Physiology, Aging, and Functional Assessment of the Right Ventricle , 2008, Circulation.

[13]  Milan Sonka,et al.  3-D active appearance models: segmentation of cardiac MR and ultrasound images , 2002, IEEE Transactions on Medical Imaging.

[14]  Max A. Viergever,et al.  Automatic cardiac region-of-interest computation in cine 3D structural MRI , 2004, CARS.

[15]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[16]  D. Louis Collins,et al.  Automatic 3‐D model‐based neuroanatomical segmentation , 1995 .

[17]  S. Allender,et al.  European cardiovascular disease statistics , 2008 .

[18]  Alexander Dick,et al.  Segmentation of Left Ventricle in Cardiac Cine MRI: An Automatic Image-Driven Method , 2009, FIMH.

[19]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[20]  Julien Abi-Nahed,et al.  Robust Active Shape Models: A Robust, Generic and Simple Automatic Segmentation Tool , 2006, MICCAI.

[21]  D. Mozaffarian,et al.  Heart disease and stroke statistics--2010 update: a report from the American Heart Association. , 2010, Circulation.

[22]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Richard L. Van Metter,et al.  Handbook of Medical Imaging , 2009 .

[24]  P. Clarysse,et al.  A FEM-based deformable model for the 3D segmentation and tracking of the heart in cardiac MRI , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[25]  Daniel Rueckert,et al.  Segmentation of 4D cardiac MR images using a probabilistic atlas and the EM algorithm , 2004, Medical Image Anal..

[26]  Nicos Maglaveras,et al.  Model-based processing scheme for quantitative 4-D cardiac MRI analysis , 2002, IEEE Transactions on Information Technology in Biomedicine.

[27]  A. Herment,et al.  An automated myocardial segmentation in cardiac MRI , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Mikkel B. Stegmann,et al.  Automated Segmentation of Cardiac Magnetic Resonance Images , 2001 .

[29]  van Hc Hans Assen,et al.  LV Challenge LKEB Contribution: Fully Automated Myocardial Contour Detection , 2009, The MIDAS Journal.

[30]  J. Fitzpatrick,et al.  Medical image processing and analysis , 2000 .

[31]  Marie-Pierre Jolly,et al.  Automatic Segmentation of the Left Ventricle in Cardiac MR and CT Images , 2006, International Journal of Computer Vision.

[32]  Kim L. Boyer,et al.  A New Deformable Model for Boundary Tracking in Cardiac MRI and Its Application to the Detection of Intra-Ventricular Dyssynchrony , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[33]  Marcel Breeuwer,et al.  Myocardial Delineation via Registration in a Polar Coordinate System , 2002, MICCAI.

[34]  J Paul Finn,et al.  Accurate quantification of right ventricular mass at MR imaging by using cine true fast imaging with steady-state precession: study in dogs. , 2004, Radiology.

[35]  Alejandro F. Frangi,et al.  ICA vs. PCA Active Appearance Models: Application to Cardiac MR Segmentation , 2003, MICCAI.

[36]  Einar Heiberg,et al.  Design and validation of Segment - freely available software for cardiovascular image analysis , 2010, BMC Medical Imaging.

[37]  S Akselrod,et al.  Automatic assessment of cardiac function from short-axis MRI: procedure and clinical evaluation. , 1998, Magnetic resonance imaging.

[38]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[39]  J.H.C. Reiber,et al.  Automated detection of left ventricular epi- and endocardial contours in short-axis MR images , 1994, Computers in Cardiology 1994.

[40]  D. Comaniciu,et al.  A note on future research in segmentation techniques applied to neurology, cardiology, mammography and pathology , 2001 .

[41]  Alejandro F. Frangi,et al.  Statistical Modeling and Segmentation in Cardiac MRI Using a Grid Computing Approach , 2005, EGC.

[42]  Wiro J Niessen,et al.  Automatic image‐driven segmentation of the ventricles in cardiac cine MRI , 2008, Journal of magnetic resonance imaging : JMRI.

[43]  Hugues Talbot,et al.  4D Morphological segmentation and the MICCAI LV-segmentation grand challenge , 2009, The MIDAS Journal.

[44]  Nikos Paragios,et al.  A Variational Approach for the Segmentation of the Left Ventricle in Cardiac Image Analysis , 2002, International Journal of Computer Vision.

[45]  A. Ardeshir Goshtasby,et al.  Segmentation of cardiac cine MR images for extraction of right and left ventricular chambers , 1995, IEEE Trans. Medical Imaging.

[46]  Madhavi Lata,et al.  Medical Image Segmentation , 2008, Encyclopedia of Multimedia.

[47]  Hervé Delingette,et al.  Cardiac Motion Recovery by Coupling an Electromechanical Model and Cine-MRI Data: First Steps , 2008, The MIDAS Journal.

[48]  Alejandro F. Frangi,et al.  Haar-like features with optimally weighted rectangles for rapid object detection , 2010, Pattern Recognition.

[49]  James S. Duncan,et al.  Segmentation of the Left Ventricle From Cardiac MR Images Using a Subject-Specific Dynamical Model , 2010, IEEE Transactions on Medical Imaging.

[50]  James S. Duncan,et al.  Boundary element method-based regularization for recovering of LV deformation , 2007, Medical Image Anal..

[51]  Timothy F. Cootes,et al.  Interpreting face images using active appearance models , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[52]  Hae-Yeoun Lee,et al.  Left ventricle segmentation using graph searching on intensity and gradient and a priori knowledge (lvGIGA) for short‐axis cardiac magnetic resonance imaging , 2008, Journal of magnetic resonance imaging : JMRI.

[53]  Surendra Ranganath,et al.  Contour extraction from cardiac MRI studies using snakes , 1995, IEEE Trans. Medical Imaging.

[54]  F Brunotte,et al.  Automatic detection of left ventricular contours from cardiac cine magnetic resonance imaging using fuzzy logic. , 1999, Investigative radiology.

[55]  Timothy F. Cootes,et al.  Active shape models , 1998 .

[56]  Maxime Sermesant,et al.  Cardiac Function Estimation from MRI Using a Heart Model and Data Assimilation: Advances and Difficulties , 2005, FIMH.

[57]  V Positano,et al.  Automated cardiac MR image segmentation: theory and measurement evaluation. , 2003, Medical engineering & physics.

[58]  Mikkel B. Stegmann,et al.  Bi-temporal 3D active appearance models with applications to unsupervised ejection fraction estimation , 2005, SPIE Medical Imaging.

[59]  Katja Bühler,et al.  Improving Segmentation of the Left Ventricle Using a Two-Component Statistical Model , 2006, MICCAI.

[60]  A. Gupta,et al.  Cardiac MR image segmentation using deformable models , 1993, Proceedings of Computers in Cardiology Conference.

[61]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[62]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[63]  W. Eric L. Grimson,et al.  A shape-based approach to the segmentation of medical imagery using level sets , 2003, IEEE Transactions on Medical Imaging.

[64]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[65]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[66]  Einar Heiberg,et al.  Time resolved three-dimensional segmentation of the left ventricle in multimodality cardiac imaging , 2012 .

[67]  A. Boudraa,et al.  Automated detection of the left ventricular region in magnetic resonance images by Fuzzy C-Means model , 1997, The International Journal of Cardiac Imaging.

[68]  Alessandro Sarti,et al.  Estimation of right ventricular volume without geometrical assumptions utilizing cardiac magnetic resonance data , 2003, Computers in Cardiology, 2003.

[69]  Nicolae Duta,et al.  Segmentation of the Left Ventricle in Cardiac MR Images , 2001, ICCV.

[70]  Milan Sonka,et al.  Multistage hybrid active appearance model matching: segmentation of left and right ventricles in cardiac MR images , 2001, IEEE Transactions on Medical Imaging.

[71]  Daniel Rueckert,et al.  Atlas-Based Segmentation and Tracking of 3D Cardiac MR Images Using Non-rigid Registration , 2002, MICCAI.

[72]  Michel Couprie,et al.  Automated, Accurate and Fast Segmentation of 4D Cardiac MR Images , 2007, FIMH.

[73]  T W Redpath,et al.  Determination of normal regional left ventricular function from cine-MR images using a semi-automated edge detection method. , 1999, Magnetic resonance imaging.

[74]  Feng Liu,et al.  Right Ventricle Extraction by Low level and Model-based algorithm , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[75]  Jasjit S. Suri,et al.  Computer Vision, Pattern Recognition and Image Processing in Left Ventricle Segmentation: The Last 50 Years , 2000, Pattern Analysis & Applications.

[76]  Shuo Li,et al.  Embedding Overlap Priors in Variational Left Ventricle Tracking , 2009, IEEE Transactions on Medical Imaging.

[77]  J. Suri,et al.  Advanced algorithmic approaches to medical image segmentation: state-of-the-art application in cardiology, neurology, mammography and pathology , 2001 .

[78]  Xiang Lin,et al.  Automated Detection of Left Ventricle in 4D MR Images: Experience from a Large Study , 2006, MICCAI.

[79]  David Atkinson,et al.  Robust registration between cardiac MRI images and atlas for segmentation propagation , 2008, SPIE Medical Imaging.

[80]  Françoise J. Prêteux,et al.  A non-rigid registration approach for quantifying myocardial contraction in tagged MRI using generalized information measures , 2005, Medical Image Anal..

[81]  Lorenz von Kurowski,et al.  Cardiac MR image segmentation using deformable models , 1993 .

[82]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[83]  Joan Serra,et al.  Image segmentation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[84]  A. Katouzian,et al.  A New Automated Technique for Left- and Right-Ventricular Segmentation in Magnetic Resonance Imaging , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[85]  N. Bulakbaşı,et al.  Left ventricular mass. , 2006, Anadolu kardiyoloji dergisi : AKD = the Anatolian journal of cardiology.

[86]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[87]  David E. Breen,et al.  Dynamic deformable models for 3D MRI heart segmentation , 2002, SPIE Medical Imaging.

[88]  Jinn-Yi Yeh,et al.  Myocardial border detection by branch-and-bound dynamic programming in magnetic resonance images , 2005, Comput. Methods Programs Biomed..

[89]  Milan Sonka,et al.  Time-Continuous Segmentation of Cardiac Image Sequences Using Active Appearance Motion Models , 2001, IPMI.

[90]  Nikos Paragios,et al.  Knowledge-based registration & segmentation of the left ventricle: a level set approach , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[91]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[92]  James S. Duncan,et al.  Boundary Finding with Parametrically Deformable Models , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[93]  Caroline Petitjean,et al.  Automatic cardiac ventricle segmentation in MR images: a validation study , 2011, International Journal of Computer Assisted Radiology and Surgery.

[94]  Leo Grady,et al.  Combining Registration and Minimum Surfaces for the Segmentation of the Left Ventricle in Cardiac Cine MR Images , 2009, MICCAI.

[95]  Paul F. Whelan,et al.  Segmentation of the Left Ventricle of the Heart in 3-D+t MRI Data Using an Optimized Nonrigid Temporal Model , 2008, IEEE Transactions on Medical Imaging.

[96]  Jérôme Caudron,et al.  Evaluation of left ventricular diastolic function with cardiac MR imaging. , 2011, Radiographics : a review publication of the Radiological Society of North America, Inc.

[97]  David T. Gering,et al.  Automatic Segmentation of Cardiac MRI , 2003, MICCAI.

[98]  J. C. Fu,et al.  Wavelet-based enhancement for detection of left ventricular myocardial boundaries in magnetic resonance images. , 2000, Magnetic resonance imaging.

[99]  Juha Koikkalainen,et al.  Statistical shape model of atria, ventricles and epicardium from short- and long-axis MR images , 2004, Medical Image Anal..

[100]  Yunde Jia,et al.  Segmentation of the Left Ventricle from Cardiac MR Images Based on Degenerated Minimal Surface Diffusion and Shape Priors , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[101]  Marie-Pierre Jolly,et al.  Automatic Recovery of the Left Ventricular Blood Pool in Cardiac Cine MR Images , 2008, MICCAI.

[102]  James S. Duncan,et al.  Deformable boundary finding in medical images by integrating gradient and region information , 1996, IEEE Trans. Medical Imaging.

[103]  Hervé Delingette,et al.  Cardiac Motion Recovery and Boundary Conditions Estimation by Coupling an Electromechanical Model and Cine-MRI Data , 2009, FIMH.

[104]  Michel Couprie,et al.  Segmentation of 4D cardiac MRI: Automated method based on spatio-temporal watershed cuts , 2010, Image Vis. Comput..

[105]  C. Cassen,et al.  Left ventricular segmentation in MRI images , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[106]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[107]  Ioannis A. Kakadiaris,et al.  Automated left ventricular segmentation in cardiac MRI , 2006, IEEE Transactions on Biomedical Engineering.

[108]  Rachid Deriche,et al.  A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape , 2007, International Journal of Computer Vision.

[109]  Alejandro F Frangi,et al.  Active shape models with invariant optimal features (IOF-ASM) application to cardiac MRI segmentation , 2003, Computers in Cardiology, 2003.

[110]  Milan Sonka,et al.  Segmentation of cardiac MR images: an active appearance model approach , 2000, Medical Imaging: Image Processing.

[111]  José M. F. Moura,et al.  STACS: new active contour scheme for cardiac MR image segmentation , 2005, IEEE Transactions on Medical Imaging.

[112]  Alan S. Willsky,et al.  Segmenting and Tracking the Left Ventricle by Learning the Dynamics in Cardiac Images , 2005, IPMI.

[113]  Hervé Delingette,et al.  Deformable biomechanical models: Application to 4D cardiac image analysis , 2003, Medical Image Anal..

[114]  Johan Montagnat,et al.  4D deformable models with temporal constraints: application to 4D cardiac image segmentation , 2005, Medical Image Anal..

[115]  Debiao Li,et al.  Adaptive blood pool segmentation in three‐dimensions: Application to MR cardiac evaluation , 1996, Journal of magnetic resonance imaging : JMRI.

[116]  Marcel Breeuwer,et al.  Automatic Contour Propagation in Cine Cardiac Magnetic Resonance Images , 2006, IEEE Transactions on Medical Imaging.

[117]  Max A. Viergever,et al.  Automatic cardiac MRI myocardium segmentation using graphcut , 2006, SPIE Medical Imaging.

[118]  J Paul Finn,et al.  Left ventricular mass: manual and automatic segmentation of true FISP and FLASH cine MR images in dogs and pigs. , 2004, Radiology.

[119]  Thomas Netsch,et al.  Model-based segmentation of cardiac MRI cine sequences: a Bayesian formulation , 2004, SPIE Medical Imaging.

[120]  Torsten Rohlfing,et al.  Quo Vadis, Atlas-Based Segmentation? , 2005 .

[121]  Paul F. Whelan,et al.  Left-ventricle myocardium segmentation using a coupled level-set with a priori knowledge , 2006, Comput. Medical Imaging Graph..

[122]  Alejandro F. Frangi,et al.  Three-dimensional modeling for functional analysis of cardiac images, a review , 2001, IEEE Transactions on Medical Imaging.

[123]  Alain Lalande,et al.  Journal of Cardiovascular Magnetic Resonance Left Ventricular Ejection Fraction Calculation from Automatically Selected and Processed Diastolic and Systolic Frames in Short-axis Cine-mri , 2022 .

[124]  Frank Y. Shih,et al.  Image Segmentation , 2007, Encyclopedia of Biometrics.

[125]  M. Carlsson,et al.  Time resolved three-dimensional automated segmentation of the left ventricle , 2005, Computers in Cardiology, 2005.

[126]  Junzhou Huang,et al.  DYNAMIC TEXTURE BASED HEART LOCALIZATION AND SEGMENTATION IN 4-D CARDIAC IMAGES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[127]  Paul F. Whelan,et al.  Automatic segmentation of the left ventricle cavity and myocardium in MRI data , 2006, Comput. Biol. Medicine.

[128]  Hüseyin Tek,et al.  Comprehensive Cardiovascular Image Analysis Using MR and CT at Siemens Corporate Research , 2006, International Journal of Computer Vision.

[129]  Marcel Breeuwer,et al.  Myocardial delineation via registration in a polar coordinate system1 , 2003 .

[130]  Milan Sonka,et al.  4-D Cardiac MR Image Analysis: Left and Right Ventricular Morphology and Function , 2010, IEEE Transactions on Medical Imaging.

[131]  Alejandro F. Frangi,et al.  Automatic construction of multiple-object three-dimensional statistical shape models: application to cardiac modeling , 2002, IEEE Transactions on Medical Imaging.