Graph cut-based method for segmenting the left ventricle from MRI or echocardiographic images

In this paper, we present a fast and interactive graph cut method for 3D segmentation of the endocardial wall of the left ventricle (LV) adapted to work on two of the most widely used modalities: magnetic resonance imaging (MRI) and echocardiography. Our method accounts for the fundamentally different nature of both modalities: 3D echocardiographic images have a low contrast, a poor signal-to-noise ratio and frequent signal drop, while MR images are more detailed but also cluttered and contain highly anisotropic voxels. The main characteristic of our method is to work in a 3D Bezier coordinate system instead of the original Euclidean space. This comes with several advantages, including an implicit shape prior and a result guarantied not to have any holes in it. The proposed method is made of 4 steps. First, a 3D sampling of the LV cavity is made based on a Bezier coordinate system. This allows to warp the input 3D image to a Bezier space in which a plane corresponds to an anatomically plausible 3D Euclidean bullet shape. Second, a 3D graph is built and an energy term (which is based on the image gradient and a 3D probability map) is assigned to each edge of the graph, some of which being given an infinite energy to ensure the resulting 3D structure passes through key anatomical points. Third, a max-flow min-cut procedure is executed on the energy graph to delineate the endocardial surface. And fourth, the resulting surface is projected back to the Euclidean space where a post-processing convex hull algorithm is applied on every short axis slice to remove local concavities. Results obtained on two datasets reveal that our method takes between 2 and 5s to segment a 3D volume, it has better results overall than most state-of-the-art methods on the CETUS echocardiographic dataset and is statistically as good as a human operator on MR images.

[1]  Chen Wang,et al.  Standardized Evaluation System for Left Ventricular Segmentation Algorithms in 3D Echocardiography , 2016, IEEE Transactions on Medical Imaging.

[2]  Liang Zhong,et al.  A Framework for Auto-segmentation of Left Ventricle from Magnetic Resonance Images , 2013 .

[3]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Michael G. Strintzis,et al.  Lossless image compression based on optimal prediction, adaptive lifting, and conditional arithmetic coding , 2001, IEEE Trans. Image Process..

[5]  Alejandro F Frangi,et al.  Automatic cardiac LV segmentation in MRI using modified graph cuts with smoothness and interslice constraints , 2014, Magnetic resonance in medicine.

[6]  C. Dhanalakshmi,et al.  Automatic Segmentation and Ventricular Border Detection of 2D Echocardiographic Images Combining K-Means Clustering and Active Contour Model , 2010, 2010 Second International Conference on Computer and Network Technology.

[7]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[8]  Daniel Rueckert,et al.  Automated Abdominal Multi-Organ Segmentation With Subject-Specific Atlas Generation , 2013, IEEE Transactions on Medical Imaging.

[9]  Denis Friboulet,et al.  Whole myocardium tracking in 2D-echocardiography in multiple orientations using a motion constrained level-set , 2014, Medical Image Anal..

[10]  Pierre-Marc Jodoin,et al.  Automatized Evaluation of the Left Ventricular Ejection Fraction from Echocardiographic Images Using Graph Cut , 2014, MICCAI 2014.

[11]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[12]  Paul F. Whelan,et al.  Segmenting the Left Ventricle in 3D Using a Coupled ASM and a Learned Non-Rigid Spatial Model , 2009, The MIDAS Journal.

[13]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[15]  Xianglong Tang,et al.  Probability density difference-based active contour for ultrasound image segmentation , 2010, Pattern Recognit..

[16]  Dan Adam,et al.  Automatic segmentation of cardiac MRI cines validated for long axis views , 2013, Comput. Medical Imaging Graph..

[17]  José M. F. Moura,et al.  STACS: new active contour scheme for cardiac MR image segmentation , 2005, IEEE Transactions on Medical Imaging.

[18]  Otto Kamp,et al.  EAE/ASE recommendations for image acquisition and display using three-dimensional echocardiography. , 2012, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[19]  Örjan Smedby,et al.  Model-based left ventricle segmentation in 3D ultrasound using phase image , 2014, The MIDAS Journal.

[20]  Frederik Maes,et al.  Influence of the Grid Topology of Free-Form Deformation Models on the Performance of 3D Strain Estimation in Echocardiography , 2013, FIMH.

[21]  Sarada Dakua,et al.  Annularcut: A graph-cut design for left ventricle segmentation from magnetic resonance images , 2014, IET Image Process..

[22]  Jürgen Weese,et al.  Automated segmentation of the left ventricle in cardiac MRI , 2004, Medical Image Anal..

[23]  Amine Chikh,et al.  Endocardial Border Detection in Cardiac Magnetic Resonance Images Using Level Set Method , 2012, Journal of Digital Imaging.

[24]  Gustavo Carneiro,et al.  Robust left ventricle segmentation from ultrasound data using deep neural networks and efficient search methods , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[25]  Les A. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communication.

[26]  Phi Vu Tran,et al.  A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI , 2016, ArXiv.

[27]  G. Sainarayanan,et al.  A Novel Method for Echocardiogram Boundary Detection Using Adaptive Neuro -Fuzzy Systems , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[28]  Tomasz Pieciak,et al.  Segmentation of the Left Ventricle Using Active Contour Method with Gradient Vector Flow Forces in Short-Axis MRI , 2012, ITIB.

[29]  Rob J. van der Geest,et al.  Semi-automatic border detection method for left ventricular volume estimation in 4D ultrasound data , 2005, SPIE Medical Imaging.

[30]  Dimitris N. Metaxas,et al.  3D cardiac motion reconstruction from CT data and tagged MRI , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Marie-Pierre Jolly,et al.  Automatic Segmentation of the Left Ventricle in Cardiac MR and CT Images , 2006, International Journal of Computer Vision.

[32]  Yuri Boykov,et al.  Globally optimal segmentation of multi-region objects , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[33]  Yi Wang,et al.  Automatic Left Ventricle Segmentation Using Iterative Thresholding and an Active Contour Model With Adaptation on Short-Axis Cardiac MRI , 2010, IEEE Transactions on Biomedical Engineering.

[34]  Denis Friboulet,et al.  Detection of the whole myocardium in 2D-echocardiography for multiple orientations using a geometrically constrained level-set , 2012, Medical Image Anal..

[35]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[36]  Gary L. Miller,et al.  Graph Partitioning by Spectral Rounding: Applications in Image Segmentation and Clustering , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[37]  Patrick Pérez,et al.  Interactive Image Segmentation Using an Adaptive GMMRF Model , 2004, ECCV.

[38]  Paul F. Whelan,et al.  Left-ventricle myocardium segmentation using a coupled level-set with a priori knowledge , 2006, Comput. Medical Imaging Graph..

[39]  A. M. Andrew,et al.  Another Efficient Algorithm for Convex Hulls in Two Dimensions , 1979, Inf. Process. Lett..

[40]  Christos Davatzikos,et al.  Segmentation of the Left Ventricle Using Distance Regularized Two-Layer Level Set Approach , 2013, MICCAI.

[41]  Xiaoguang Lu,et al.  A novel, automated method for measuring mitral valve annular velocity from standard cine TrueFISP data - a feasibility study , 2011, Journal of Cardiovascular Magnetic Resonance.

[42]  Xiaodong Wu,et al.  Optimal Surface Segmentation in Volumetric Images-A Graph-Theoretic Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Radford Juang,et al.  Automatic segmentation of the left-ventricular cavity and atrium in 3D ultrasound using graph cuts and the radial symmetry transform , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[44]  Yingli Lu,et al.  Watershed segmentation of basal left ventricle for quantitation of cine cardiac MRI function , 2011, Journal of Cardiovascular Magnetic Resonance.

[45]  Hamid Jafarkhani,et al.  A 3-D Active Contour Method for Automated Segmentation of the Left Ventricle From Magnetic Resonance Images , 2017, IEEE Transactions on Biomedical Engineering.

[46]  Caroline Petitjean,et al.  Automatic cardiac ventricle segmentation in MR images: a validation study , 2011, International Journal of Computer Assisted Radiology and Surgery.

[47]  Alain Lalande,et al.  Journal of Cardiovascular Magnetic Resonance Left Ventricular Ejection Fraction Calculation from Automatically Selected and Processed Diastolic and Systolic Frames in Short-axis Cine-mri , 2022 .

[48]  Gustavo Carneiro,et al.  Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance , 2017, Medical Image Anal..

[49]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..