Automated Inline Analysis of Myocardial Perfusion MRI with Deep Learning

Purpose To develop a deep neural network-based computational workflow for inline myocardial perfusion analysis that automatically delineates the myocardium, which improves the clinical workflow and offers a "one-click" solution. Materials and Methods In this retrospective study, consecutive adenosine stress and rest perfusion scans were acquired from three hospitals between October 1, 2018 and February 27, 2019. The training and validation set included 1825 perfusion series from 1034 patients (mean age, 60.6 years ± 14.2 [standard deviation]). The independent test set included 200 scans from 105 patients (mean age, 59.1 years ± 12.5). A convolutional neural network (CNN) model was trained to segment the left ventricular cavity, myocardium, and right ventricle by processing an incoming time series of perfusion images. Model outputs were compared with manual ground truth for accuracy of segmentation and flow measures derived on a global and per-sector basis with t test performed for statistical significance. The trained models were integrated onto MR scanners for effective inference. Results The mean Dice ratio of automatic and manual segmentation was 0.93 ± 0.04. The CNN performed similarly to manual segmentation and flow measures for mean stress myocardial blood flow (MBF; 2.25 mL/min/g ± 0.59 vs 2.24 mL/min/g ± 0.59, P = .94) and mean rest MBF (1.08 mL/min/g ± 0.23 vs 1.07 mL/min/g ± 0.23, P = .83). The per-sector MBF values showed no difference between the CNN and manual assessment (P = .92). A central processing unit-based model inference on the MR scanner took less than 1 second for a typical perfusion scan of three slices. Conclusion The described CNN was capable of cardiac perfusion mapping and integrated an automated inline implementation on the MR scanner, enabling one-click analysis and reporting in a manner comparable to manual assessment. Supplemental material is available for this article. © RSNA, 2020.

[1]  Aleksandra Radjenovic,et al.  Myocardial blood flow at rest and stress measured with dynamic contrast‐enhanced MRI: Comparison of a distributed parameter model with a fermi function model , 2013, Magnetic resonance in medicine.

[2]  Euan A. Ashley,et al.  Weakly supervised classification of aortic valve malformations using unlabeled cardiac MRI sequences , 2019, Nature Communications.

[3]  Francesco Sardanelli,et al.  Segmentation of cardiac cine MR images of left and right ventricles: Interactive semiautomated methods and manual contouring by two readers with different education and experience , 2008, Journal of magnetic resonance imaging : JMRI.

[4]  Song Han,et al.  AMC: AutoML for Model Compression and Acceleration on Mobile Devices , 2018, ECCV.

[5]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[6]  Carmel Hayes,et al.  Measurement of extracellular volume and transit time heterogeneity using contrast‐enhanced myocardial perfusion MRI in patients after acute myocardial infarction , 2017, Magnetic resonance in medicine.

[7]  Gautam Srivastava,et al.  Effective Heart Disease Prediction Using Hybrid Machine Learning Techniques , 2019, IEEE Access.

[8]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[9]  Hui Xue,et al.  Automated detection of left ventricle in arterial input function images for inline perfusion mapping using deep learning: A study of 15,000 patients , 2019, Magnetic resonance in medicine.

[10]  Guang-Zhong Yang,et al.  Accurate assessment of the arterial input function during high‐dose myocardial perfusion cardiovascular magnetic resonance , 2004, Journal of magnetic resonance imaging : JMRI.

[11]  B S Abhigna,et al.  Crowdsourcing – A Step Towards Advanced Machine Learning , 2018 .

[12]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[13]  Ayman El-Baz,et al.  A new shape-based framework for the left ventricle wall segmentation from cardiac first-pass perfusion mri , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[14]  Luigi Landini,et al.  Automatic Characterization of Myocardial Perfusion in Contrast Enhanced MRI , 2003, EURASIP J. Adv. Signal Process..

[15]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  P. Kellman,et al.  A quantitative pixel-wise measurement of myocardial blood flow by contrast-enhanced first-pass CMR perfusion imaging: microsphere validation in dogs and feasibility study in humans. , 2012, JACC. Cardiovascular imaging.

[17]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[18]  Herbert Köstler,et al.  Automatic postprocessing for the assessment of quantitative human myocardial perfusion using MRI , 2010, European Radiology.

[19]  L. Mansi,et al.  Myocardial perfusion imaging and risk classification for coronary heart disease in diabetic patients. The IDIS study: a prospective, multicentre trial , 2012, European Journal of Nuclear Medicine and Molecular Imaging.

[20]  Sonia Nielles-Vallespin,et al.  Myocardial perfusion cardiovascular magnetic resonance: optimized dual sequence and reconstruction for quantification , 2017, Journal of Cardiovascular Magnetic Resonance.

[21]  C. Kramer,et al.  Cardiac MRI assessment of myocardial perfusion. , 2014, Future cardiology.

[22]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[23]  Ross T. Whitaker,et al.  Automatic segmentation of cardiac short axis slices in perfusion , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[24]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  NA Pack,et al.  A semi-automatic software package for analysis of dynamic contrast-enhanced MRI myocardial perfusion studies , 2009, 2009 36th Annual Computers in Cardiology Conference (CinC).

[26]  Sara Moccia,et al.  Development and testing of a deep learning-based strategy for scar segmentation on CMR-LGE images , 2018, Magnetic Resonance Materials in Physics, Biology and Medicine.

[27]  Jonathan W. Weinsaft,et al.  Machine learning derived segmentation of phase velocity encoded cardiovascular magnetic resonance for fully automated aortic flow quantification , 2019, Journal of Cardiovascular Magnetic Resonance.

[28]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[29]  Tim Leiner,et al.  Artificial Intelligence Will Transform Cardiac Imaging—Opportunities and Challenges , 2019, Front. Cardiovasc. Med..

[30]  Yang Yang,et al.  Quantitative cardiovascular magnetic resonance perfusion imaging identifies reduced flow reserve in microvascular coronary artery disease , 2018, Journal of Cardiovascular Magnetic Resonance.

[31]  P. Kellman,et al.  Automated Pixel-Wise Quantitative Myocardial Perfusion Mapping by CMR to Detect Obstructive Coronary Artery Disease and Coronary Microvascular Dysfunction: Validation Against Invasive Coronary Physiology. , 2019, JACC. Cardiovascular imaging.

[32]  S. Plein,et al.  Cardiovascular magnetic resonance and single-photon emission computed tomography for diagnosis of coronary heart disease (CE-MARC): a prospective trial , 2012, The Lancet.

[33]  D. Magee,et al.  Quantitative Myocardial Perfusion Imaging Versus Visual Analysis in Diagnosing Myocardial Ischemia: A CE-MARC Substudy. , 2018, JACC. Cardiovascular imaging.

[34]  Ioannis A. Kakadiaris,et al.  Localization and Segmentation of Left Ventricle in Cardiac Cine-MR Images , 2009, IEEE Transactions on Biomedical Engineering.

[35]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[36]  Dwarikanath Mahapatra,et al.  Cardiac Image Segmentation from Cine Cardiac MRI Using Graph Cuts and Shape Priors , 2013, Journal of Digital Imaging.

[37]  Lu Huang,et al.  Automatic Segmentation of the Left Ventricle in Cardiac MRI Using Local Binary Fitting Model and Dynamic Programming Techniques , 2014, PloS one.

[38]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[39]  Hildur Ólafsdóttir,et al.  Automatic Assessment of Cardiac Perfusion MRI , 2004, MICCAI.

[40]  Scott D Flamm,et al.  Standardized image interpretation and post processing in cardiovascular magnetic resonance: Society for Cardiovascular Magnetic Resonance (SCMR) Board of Trustees Task Force on Standardized Post Processing , 2013, Journal of Cardiovascular Magnetic Resonance.

[41]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[42]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association , 2002, The international journal of cardiovascular imaging.

[43]  Ayman El-Baz,et al.  Fully automated framework for the analysis of myocardial first-pass perfusion MR images. , 2014, Medical physics.

[44]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[45]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. , 2002, Journal of nuclear cardiology : official publication of the American Society of Nuclear Cardiology.

[46]  Reza Nezafat,et al.  Automated analysis of cardiovascular magnetic resonance myocardial native T1 mapping images using fully convolutional neural networks , 2019, Journal of Cardiovascular Magnetic Resonance.

[47]  Nourhan Zayed,et al.  Factors Affecting the Segmentation of the Heart Ventricles in Short Axis Cardiac Perfusion MRI Images , 2016, BIOINFORMATICS 2016.

[48]  Marie-Pierre Jolly,et al.  Motion correction for myocardial T1 mapping using image registration with synthetic image estimation , 2012, Magnetic resonance in medicine.

[49]  Dumitru Erhan,et al.  Training Deep Neural Networks on Noisy Labels with Bootstrapping , 2014, ICLR.

[50]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[51]  S. Piechnik,et al.  Diagnosis of Microvascular Angina Using Cardiac Magnetic Resonance , 2018, Journal of the American College of Cardiology.

[52]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[53]  Alexander Rakhlin,et al.  Automatic Instrument Segmentation in Robot-Assisted Surgery Using Deep Learning , 2018, bioRxiv.

[54]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[55]  Simon K. Warfield,et al.  Left Ventricular Segmentation Challenge from Cardiac MRI: A Collation Study , 2011, STACOM.

[56]  S. Sotthivirat,et al.  Active Contours With Automatic Initialization For Myocardial Perfusion Analysis , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[57]  Yi Guo,et al.  Accuracy, uncertainty, and adaptability of automatic myocardial ASL segmentation using deep CNN , 2018, Magnetic resonance in medicine.

[58]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[59]  Einly Lim,et al.  Fully automated segmentation of the left ventricle in cine cardiac MRI using neural network regression , 2018, Journal of magnetic resonance imaging : JMRI.

[60]  P. Kellman,et al.  Quantitative myocardial perfusion in coronary artery disease: A perfusion mapping study , 2019, Journal of magnetic resonance imaging : JMRI.

[61]  Ling Shao,et al.  A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging , 2016, Magnetic Resonance Materials in Physics, Biology and Medicine.