Convolutional neural network‐based approach for segmentation of left ventricle myocardial scar from 3D late gadolinium enhancement MR images

PURPOSE Accurate three-dimensional (3D) segmentation of myocardial replacement fibrosis (i.e., scar) is emerging as a potentially valuable tool for risk stratification and procedural planning in patients with ischemic cardiomyopathy. The main purpose of this study was to develop a semiautomated method using a 3D convolutional neural network (CNN)-based for the segmentation of left ventricle (LV) myocardial scar from 3D late gadolinium enhancement magnetic resonance (LGE-MR) images. METHODS Our proposed CNN is built upon several convolutional and pooling layers aimed at choosing appropriate features from LGE-MR images to distinguish between myocardial scar and healthy tissues of the left ventricle. In contrast to previous methods that consider image intensity as the sole feature, CNN-based algorithms have the potential to improve the accuracy of scar segmentation through the creation of unconventional features that separate scar from normal myocardium in the feature space. The first step of our pipeline was to manually delineate the left ventricular myocardium, which was used as the region of interest for scar segmentation. Our developed algorithm was trained using 265,220 volume patches extracted from ten 3D LGE-MR images, then was validated on 450,454 patches from a testing dataset of 24 3D LGE-MR images, all obtained from patients with chronic myocardial infarction. We evaluated our method in the context of several alternative methods by comparing algorithm-generated segmentations to manual delineations performed by experts. RESULTS Our CNN-based method reported an average Dice similarity coefficient (DSC) and Jaccard Index (JI) of 93.63% ± 2.6% and 88.13% ± 4.70%. In comparison to several previous methods, including K-nearest neighbor (KNN), hierarchical max flow (HMF), full width at half maximum (FWHM), and signal threshold to reference mean (STRM), the developed algorithm reported significantly higher accuracy for DSC with a P-value less than 0.0001. CONCLUSIONS Our experimental results demonstrated that our CNN-based proposed method yielded the highest accuracy of all contemporary LV myocardial scar segmentation methodologies, inclusive of the most widely used signal intensity-based methods, such as FWHM and STRM. To our knowledge, this is the first description of LV myocardial scar tissue segmentation from 3D LGE-MR images using a CNN-based method.

[1]  Huafeng Liu,et al.  Direct delineation of myocardial infarction without contrast agents using a joint motion feature learning architecture , 2018, Medical Image Anal..

[2]  Eranga Ukwatta,et al.  Myocardial scar segmentation from magnetic resonance images using convolutional neural network , 2018, Medical Imaging.

[3]  Stuart A. Taylor,et al.  Fully automatic, multiorgan segmentation in normal whole body magnetic resonance imaging (MRI), using classification forests (CFs), convolutional neural networks (CNNs), and a multi‐atlas (MA) approach , 2017, Medical physics.

[4]  Katherine C. Wu Sudden Cardiac Death Substrate Imaged by Magnetic Resonance Imaging: From Investigational Tool to Clinical Applications , 2017, Circulation. Cardiovascular imaging.

[5]  Katherine C. Wu,et al.  Imaging-Based Simulations for Predicting Sudden Death and Guiding Ventricular Tachycardia Ablation. , 2017, Circulation. Arrhythmia and electrophysiology.

[6]  Amit R. Patel,et al.  3D late gadolinium enhanced cardiovascular MR with CENTRA-PLUS profile/view ordering: Feasibility of right ventricular myocardial damage assessment using a swine animal model. , 2017, Magnetic resonance imaging.

[7]  Asifullah Khan,et al.  Two-phase deep convolutional neural network for reducing class skewness in histopathological images based breast cancer detection , 2017, Comput. Biol. Medicine.

[8]  K. Rhode,et al.  Real-Time X-MRI-Guided Left Ventricular Lead Implantation for Targeted Delivery of Cardiac Resynchronization Therapy. , 2017, JACC. Clinical electrophysiology.

[9]  Patrick van der Smagt,et al.  CNN-based Segmentation of Medical Imaging Data , 2017, ArXiv.

[10]  Antonius M W van Stipdonk,et al.  A novel approach for left ventricular lead placement in cardiac resynchronization therapy: Intraprocedural integration of coronary venous electroanatomic mapping with delayed enhancement cardiac magnetic resonance imaging. , 2017, Heart rhythm.

[11]  Kyong Hwan Jin,et al.  Fast and robust segmentation of the striatum using deep convolutional neural networks , 2016, Journal of Neuroscience Methods.

[12]  Seyed-Ahmad Ahmadi,et al.  Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields , 2016, MICCAI.

[13]  Hiroshi Fujita,et al.  Automated detection of pulmonary nodules in PET/CT images: Ensemble false-positive reduction using a convolutional neural network technique. , 2016, Medical physics.

[14]  Wu Qiu,et al.  Myocardial Infarct Segmentation From Magnetic Resonance Images for Personalized Modeling of Cardiac Electrophysiology , 2016, IEEE Transactions on Medical Imaging.

[15]  Katherine C. Wu,et al.  Arrhythmia risk stratification of patients after myocardial infarction using personalized heart models , 2016, Nature Communications.

[16]  Kebin Jia,et al.  Multiscale CNNs for Brain Tumor Segmentation and Diagnosis , 2016, Comput. Math. Methods Medicine.

[17]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[18]  J. Brugada,et al.  Infarct transmurality as a criterion for first-line endo-epicardial substrate-guided ventricular tachycardia ablation in ischemic cardiomyopathy. , 2016, Heart rhythm.

[19]  Henry Halperin,et al.  Accuracy of prediction of infarct-related arrhythmic circuits from image-based models reconstructed from low and high resolution MRI , 2015, Front. Physiol..

[20]  Eranga Ukwatta,et al.  Image-based reconstruction of three-dimensional myocardial infarct geometry for patient-specific modeling of cardiac electrophysiology. , 2015, Medical physics.

[21]  D. Giavarina Understanding Bland Altman analysis , 2015, Biochemia medica.

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  Terry M. Peters,et al.  Comparison of semi-automated scar quantification techniques using high-resolution, 3-dimensional late-gadolinium-enhancement magnetic resonance imaging , 2015, The International Journal of Cardiovascular Imaging.

[24]  Martin Rajchl,et al.  Model-Based Navigation of Left and Right Ventricular Leads to Optimal Targets for Cardiac Resynchronization Therapy: A Single-Center Feasibility Study , 2014, Circulation. Arrhythmia and electrophysiology.

[25]  Terry M. Peters,et al.  Interactive Hierarchical-Flow Segmentation of Scar Tissue From Late-Enhancement Cardiac MR Images , 2014, IEEE Transactions on Medical Imaging.

[26]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[27]  Kevin Johnson,et al.  Volumetric late gadolinium‐enhanced myocardial imaging with retrospective inversion time selection , 2013, Journal of magnetic resonance imaging : JMRI.

[28]  Ali Kashif Bashir,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2013, ICIRA 2013.

[29]  Xiahai Zhuang,et al.  Challenges and methodologies of fully automatic whole heart segmentation: a review. , 2013, Journal of healthcare engineering.

[30]  Nicholas Ayache,et al.  Integration of Merged Delayed‐Enhanced Magnetic Resonance Imaging and Multidetector Computed Tomography for the Guidance of Ventricular Tachycardia Ablation: A Pilot Study , 2013, Journal of cardiovascular electrophysiology.

[31]  James A. White,et al.  The prognostic role of late gadolinium enhancement magnetic resonance imaging in patients with cardiomyopathy. , 2013, The Canadian journal of cardiology.

[32]  Roy C. P. Kerckhoffs,et al.  Patient Specific Modeling of the Cardiovascular System Technology-Driven Personalized Medicine , 2013 .

[33]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[34]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[35]  Natalia A. Trayanova,et al.  Computational Cardiology: The Heart of the Matter , 2012, ISRN cardiology.

[36]  Alejandro F. Frangi,et al.  Healthy and Scar Myocardial Tissue Classification in DE-MRI , 2012, STACOM.

[37]  Yuesong Yang,et al.  Automated quantification of myocardial infarction using graph cuts on contrast delayed enhanced magnetic resonance images. , 2012, Quantitative imaging in medicine and surgery.

[38]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[39]  Maria Drangova,et al.  Fused whole-heart coronary and myocardial scar imaging using 3-T CMR. Implications for planning of cardiac resynchronization therapy and coronary revascularization. , 2010, JACC. Cardiovascular imaging.

[40]  M. Drangova,et al.  SCAR MORPHOLOGY IN PATIENTS PRESENTING WITH VENTRICULAR ARRHYTHMIAS: IMPLICATIONS FOR RISK STRATIFICATION IN PATIENTS WITH CHRONIC ISCHEMIC CARDIOMYOPATHY , 2010 .

[41]  Viatcheslav Gurev,et al.  Modeling of Whole-Heart Electrophysiology and Mechanics: Toward Patient-Specific Simulations , 2010 .

[42]  Malte Kelm,et al.  Rapid and accurate determination of relative infarct size in humans using contrast-enhanced magnetic resonance imaging , 2009, Clinical Research in Cardiology.

[43]  R. A. Mollineda,et al.  The class imbalance problem in pattern classification and learning , 2009 .

[44]  Gernot Plank,et al.  From mitochondrial ion channels to arrhythmias in the heart: computational techniques to bridge the spatio-temporal scales , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[45]  Raj Shekhar,et al.  Integration of three-dimensional scar maps for ventricular tachycardia ablation with positron emission tomography-computed tomography. , 2008, JACC. Cardiovascular imaging.

[46]  René M. Botnar,et al.  Detection of pulmonary vein and left atrial scar after catheter ablation with three-dimensional navigator-gated delayed enhancement MR imaging: initial experience. , 2007, Radiology.

[47]  Katherine C. Wu,et al.  Infarct Tissue Heterogeneity by Magnetic Resonance Imaging Identifies Enhanced Cardiac Arrhythmia Susceptibility in Patients With Left Ventricular Dysfunction , 2007, Circulation.

[48]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[49]  Raymond J Kim,et al.  Infarct morphology identifies patients with substrate for sustained ventricular tachycardia. , 2005, Journal of the American College of Cardiology.

[50]  Richard D. White,et al.  Segmentation of non-viable myocardium in delayed enhancement magnetic resonance images , 2005, The International Journal of Cardiovascular Imaging.