Automated segmentation of 3D cine cardiovascular magnetic resonance imaging

Introduction As the life expectancy of children with congenital heart disease (CHD) is rapidly increasing and the adult population with CHD is growing, there is an unmet need to improve clinical workflow and efficiency of analysis. Cardiovascular magnetic resonance (CMR) is a noninvasive imaging modality for monitoring patients with CHD. CMR exam is based on multiple breath-hold 2-dimensional (2D) cine acquisitions that should be precisely prescribed and is expert and institution dependent. Moreover, 2D cine images have relatively thick slices, which does not allow for isotropic delineation of ventricular structures. Thus, development of an isotropic 3D cine acquisition and automatic segmentation method is worthwhile to make CMR workflow straightforward and efficient, as the present work aims to establish. Methods Ninety-nine patients with many types of CHD were imaged using a non-angulated 3D cine CMR sequence covering the whole-heart and great vessels. Automatic supervised and semi-supervised deep-learning-based methods were developed for whole-heart segmentation of 3D cine images to separately delineate the cardiac structures, including both atria, both ventricles, aorta, pulmonary arteries, and superior and inferior vena cavae. The segmentation results derived from the two methods were compared with the manual segmentation in terms of Dice score, a degree of overlap agreement, and atrial and ventricular volume measurements. Results The semi-supervised method resulted in a better overlap agreement with the manual segmentation than the supervised method for all 8 structures (Dice score 83.23 ± 16.76% vs. 77.98 ± 19.64%; P-value ≤0.001). The mean difference error in atrial and ventricular volumetric measurements between manual segmentation and semi-supervised method was lower (bias ≤ 5.2 ml) than the supervised method (bias ≤ 10.1 ml). Discussion The proposed semi-supervised method is capable of cardiac segmentation and chamber volume quantification in a CHD population with wide anatomical variability. It accurately delineates the heart chambers and great vessels and can be used to accurately calculate ventricular and atrial volumes throughout the cardiac cycle. Such a segmentation method can reduce inter- and intra- observer variability and make CMR exams more standardized and efficient.

[1]  Adrian V. Dalca,et al.  Learned iterative segmentation of highly variable anatomy from limited data: Applications to whole heart segmentation for congenital heart disease , 2022, Medical Image Anal..

[2]  Holger Roth,et al.  Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images , 2022, BrainLes@MICCAI.

[3]  Yu Wang,et al.  A Dense RNN for Sequential Four-Chamber View Left Ventricle Wall Segmentation and Cardiac State Estimation , 2021, Frontiers in Bioengineering and Biotechnology.

[4]  Qi Tian,et al.  Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation , 2021, ECCV Workshops.

[5]  Jens Petersen,et al.  nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation , 2020, Nature Methods.

[6]  A. Kheradvar,et al.  Fully‑automated deep‑learning segmentation of pediatric cardiovascular magnetic resonance of patients with complex congenital heart diseases , 2020, Journal of Cardiovascular Magnetic Resonance.

[7]  D.-P. Fan,et al.  Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images , 2020, IEEE Transactions on Medical Imaging.

[8]  D. Rueckert,et al.  Deep Learning for Cardiac Image Segmentation: A Review , 2019, Frontiers in Cardiovascular Medicine.

[9]  Hamid Jafarkhani,et al.  Artificial intelligence in pediatric and adult congenital cardiac MRI: an unmet clinical need. , 2019, Cardiovascular diagnosis and therapy.

[10]  Jayanthi Sivaswamy,et al.  RACE-Net: A Recurrent Neural Network for Biomedical Image Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[11]  G. Hasenfuss,et al.  Fully automated quantification of biventricular volumes and function in cardiovascular magnetic resonance: applicability to clinical routine settings , 2019, Journal of Cardiovascular Magnetic Resonance.

[12]  Guang Yang,et al.  Bayesian VoxDRN: A Probabilistic Deep Voxelwise Dilated Residual Network for Whole Heart Segmentation from 3D MR Images , 2018, MICCAI.

[13]  Daniel Rueckert,et al.  Recurrent neural networks for aortic image sequence segmentation with sparse annotations , 2018, MICCAI.

[14]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[15]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[16]  Hao Chen,et al.  Automatic 3D Cardiovascular MR Segmentation with Densely-Connected Volumetric ConvNets , 2017, MICCAI.

[17]  M. Avendi,et al.  Automatic segmentation of the right ventricle from cardiac MRI using a learning‐based approach , 2017, Magnetic resonance in medicine.

[18]  Tim Leiner,et al.  Dilated Convolutional Neural Networks for Cardiovascular MR Segmentation in Congenital Heart Disease , 2016, RAMBO+HVSMR@MICCAI.

[19]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[20]  J. Rankin,et al.  Long‐Term Survival of Individuals Born With Congenital Heart Disease: A Systematic Review and Meta‐Analysis , 2016, Journal of the American Heart Association.

[21]  Alejandro F. Frangi,et al.  An Algorithm for the Segmentation of Highly Abnormal Hearts Using a Generic Statistical Shape Model , 2016, IEEE Transactions on Medical Imaging.

[22]  Hamid Jafarkhani,et al.  A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI , 2015, Medical Image Anal..

[23]  Jan L. Bruse,et al.  A Non-parametric Statistical Shape Model for Assessment of the Surgically Repaired Aortic Arch in Coarctation of the Aorta: How Normal is Abnormal? , 2015, STACOM@MICCAI.

[24]  Polina Golland,et al.  Interactive Whole-Heart Segmentation in Congenital Heart Disease , 2015, MICCAI.

[25]  Ismail Ben Ayed,et al.  Right ventricular segmentation in cardiac MRI with moving mesh correspondences , 2015, Comput. Medical Imaging Graph..

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  D. Comaniciu,et al.  Noninvasive hemodynamic assessment, treatment outcome prediction and follow-up of aortic coarctation from MR imaging. , 2015, Medical physics.

[28]  Christian Szegedy,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[29]  Alistair A. Young,et al.  Rapid D-Affine Biventricular Cardiac Function with Polar Prediction , 2014, MICCAI.

[30]  Kilian M. Pohl,et al.  Regional Manifold Learning for Disease Classification , 2014, IEEE Transactions on Medical Imaging.

[31]  A. Correa,et al.  Temporal Trends in Survival Among Infants With Critical Congenital Heart Defects , 2013, Pediatrics.

[32]  Nassir Navab,et al.  Segmentation by retrieval with guided random walks: Application to left ventricle segmentation in MRI , 2013, Medical Image Anal..

[33]  R. Kikinis,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[34]  Daniel Rueckert,et al.  Automatic Segmentation of Different Pathologies from Cardiac Cine MRI Using Registration and Multiple Component EM Estimation , 2011, FIMH.

[35]  Hervé Delingette,et al.  A Statistical Model for Quantification and Prediction of Cardiac Remodelling: Application to Tetralogy of Fallot , 2011, IEEE Transactions on Medical Imaging.

[36]  A. Fanaroff,et al.  Congenital Heart Defects in Europe: Prevalence and Perinatal Mortality, 2000 to 2005 , 2011, Circulation.

[37]  Milan Sonka,et al.  4-D Cardiac MR Image Analysis: Left and Right Ventricular Morphology and Function , 2010, IEEE Transactions on Medical Imaging.

[38]  J. Lima,et al.  Cardiovascular magnetic resonance imaging: current and emerging applications. , 2004, Journal of the American College of Cardiology.

[39]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[40]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[41]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[42]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[43]  Kilian M. Pohl,et al.  Computing group cardinality constraint solutions for logistic regression problems , 2017, Medical Image Anal..

[44]  S. Gilboa,et al.  Racial differences by gestational age in neonatal deaths attributable to congenital heart defects --- United States, 2003-2006. , 2010, MMWR. Morbidity and mortality weekly report.