Fully Automated Myocardial Strain Estimation from Cardiovascular MRI–tagged Images Using a Deep Learning Framework in the UK Biobank

Purpose To demonstrate the feasibility and performance of a fully automated deep learning framework to estimate myocardial strain from short-axis cardiac MRI–tagged images. Materials and Methods In this retrospective cross-sectional study, 4508 cases from the U.K. Biobank were split randomly into 3244 training cases, 812 validation cases, and 452 test cases. Ground truth myocardial landmarks were defined and tracked by manual initialization and correction of deformable image registration using previously validated software with five readers. The fully automatic framework consisted of (a) a convolutional neural network (CNN) for localization and (b) a combination of a recurrent neural network (RNN) and a CNN to detect and track the myocardial landmarks through the image sequence for each slice. Radial and circumferential strain were then calculated from the motion of the landmarks and averaged on a slice basis. Results Within the test set, myocardial end-systolic circumferential Green strain errors were −0.001 ± 0.025, −0.001 ± 0.021, and 0.004 ± 0.035 in the basal, mid-, and apical slices, respectively (mean ± standard deviation of differences between predicted and manual strain). The framework reproduced significant reductions in circumferential strain in participants with diabetes, hypertensive participants, and participants with a previous heart attack. Typical processing time was approximately 260 frames (approximately 13 slices) per second on a GPU with 12 GB RAM compared with 6–8 minutes per slice for the manual analysis. Conclusion The fully automated combined RNN and CNN framework for analysis of myocardial strain enabled unbiased strain evaluation in a high-throughput workflow, with similar ability to distinguish impairment due to diabetes, hypertension, and previous heart attack. Published under a CC BY 4.0 license. Supplemental material is available for this article.

[1]  R. Kronmal,et al.  Left Ventricular Concentric Remodeling Is Associated With Decreased Global and Regional Systolic Function: The Multi-Ethnic Study of Atherosclerosis , 2005, Circulation.

[2]  Nicholas Ayache,et al.  3-D Consistent and Robust Segmentation of Cardiac Images by Deep Learning With Spatial Propagation , 2018, IEEE Transactions on Medical Imaging.

[3]  L. Axel,et al.  Heart wall motion: improved method of spatial modulation of magnetization for MR imaging. , 1989, Radiology.

[4]  Christopher M Kramer,et al.  Myocardial tissue tracking with two-dimensional cine displacement-encoded MR imaging: development and initial evaluation. , 2004, Radiology.

[5]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[6]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[7]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[8]  Patrick Clarysse,et al.  Mapping Displacement and Deformation of the Heart With Local Sine-Wave Modeling , 2010, IEEE Transactions on Medical Imaging.

[9]  Pierre Croisille,et al.  Myocardial tagging with MR imaging: overview of normal and pathologic findings. , 2012, Radiographics : a review publication of the Radiological Society of North America, Inc.

[10]  Gustavo Carneiro,et al.  The Segmentation of the Left Ventricle of the Heart From Ultrasound Data Using Deep Learning Architectures and Derivative-Based Search Methods , 2012, IEEE Transactions on Image Processing.

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[13]  M. Heymans,et al.  Feature tracking compared with tissue tagging measurements of segmental strain by cardiovascular magnetic resonance , 2014, Journal of Cardiovascular Magnetic Resonance.

[14]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[15]  Jerry L Prince,et al.  Cardiac motion tracking using CINE harmonic phase (HARP) magnetic resonance imaging , 1999, Magnetic resonance in medicine.

[16]  Zhihai He,et al.  Spatially supervised recurrent convolutional neural networks for visual object tracking , 2016, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[17]  P. Matthews,et al.  UK Biobank’s cardiovascular magnetic resonance protocol , 2015, Journal of Cardiovascular Magnetic Resonance.

[18]  Hamid Jafarkhani,et al.  A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI , 2015, Medical Image Anal..

[19]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. , 2002, Journal of nuclear cardiology : official publication of the American Society of Nuclear Cardiology.

[20]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Jerry L Prince,et al.  Cardiovascular magnetic resonance: deeper insights through bioengineering. , 2013, Annual review of biomedical engineering.

[22]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. , 2002, Circulation.

[23]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[24]  E. Zerhouni,et al.  Human heart: tagging with MR imaging--a method for noninvasive assessment of myocardial motion. , 1988, Radiology.

[25]  Daniel Rueckert,et al.  Independent Left Ventricular Morphometric Atlases Show Consistent Relationships with Cardiovascular Risk Factors: A UK Biobank Study , 2019, Scientific Reports.

[26]  Jerry L. Prince,et al.  Tag and contour detection in tagged MR images of the left ventricle , 1994, IEEE Trans. Medical Imaging.

[27]  Wojciech Mazur,et al.  Myocardial strain measurement with feature-tracking cardiovascular magnetic resonance: normal values. , 2015, European heart journal cardiovascular Imaging.

[28]  E. H. Ibrahim,et al.  Myocardial tagging by Cardiovascular Magnetic Resonance: evolution of techniques--pulse sequences, analysis algorithms, and applications , 2011, Journal of cardiovascular magnetic resonance : official journal of the Society for Cardiovascular Magnetic Resonance.

[29]  Nael F Osman,et al.  Journal of Cardiovascular Magnetic Resonance Open Access Myocardial Tissue Tagging with Cardiovascular Magnetic Resonance , 2009 .

[30]  M. Takeuchi,et al.  Normal range of myocardial layer-specific strain using two-dimensional speckle tracking echocardiography , 2017, PloS one.

[31]  Alistair A. Young,et al.  Tracking and finite element analysis of stripe deformation in magnetic resonance tagging , 1995, IEEE Trans. Medical Imaging.

[32]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[33]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association , 2002, The international journal of cardiovascular imaging.

[34]  B. Cowan,et al.  In-line automated tracking for ventricular function with magnetic resonance imaging. , 2010, JACC. Cardiovascular imaging.

[35]  Kathleen Gliganic,et al.  A comparison of both DENSE and feature tracking techniques with tagging for the cardiovascular magnetic resonance assessment of myocardial strain , 2018, Journal of Cardiovascular Magnetic Resonance.

[36]  B. Cowan,et al.  Image Feature Determinants of Global and Segmental Circumferential Ventricular Strain From Cine CMR. , 2015, JACC. Cardiovascular imaging.

[37]  Alistair A. Young,et al.  Generalized spatiotemporal myocardial strain analysis for DENSE and SPAMM imaging , 2012, Magnetic resonance in medicine.

[38]  Jackie A Cooper,et al.  The impact of cardiovascular risk factors on cardiac structure and function: Insights from the UK Biobank imaging enhancement study , 2017, PloS one.

[39]  Jaco J M Zwanenburg,et al.  Myocardial strain and torsion quantified by cardiovascular magnetic resonance tissue tagging: studies in normal and impaired left ventricular function. , 2006, Journal of the American College of Cardiology.

[40]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[41]  H. Wen,et al.  DENSE: displacement encoding with stimulated echoes in cardiac functional MRI. , 1999, Journal of magnetic resonance.

[42]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.