Neural network-based left ventricle geometry prediction from CMR images with application in biomechanics

Combining biomechanical modelling of left ventricular (LV) function and dysfunction with cardiac magnetic resonance (CMR) imaging has the potential to improve the prognosis of patient-specific cardiovascular disease risks. Biomechanical studies of LV function in three dimensions usually rely on a computerized representation of the LV geometry based on finite element discretization, which is essential for numerically simulating in vivo cardiac dynamics. Detailed knowledge of the LV geometry is also relevant for various other clinical applications, such as assessing the LV cavity volume and wall thickness. Accurately and automatically reconstructing personalized LV geometries from conventional CMR images with minimal manual intervention is still a challenging task, which is a pre-requisite for any subsequent automated biomechanical analysis. We propose a deep learning-based automatic pipeline for predicting the three-dimensional LV geometry directly from routinely-available CMR cine images, without the need to manually annotate the ventricular wall. Our framework takes advantage of a low-dimensional representation of the high-dimensional LV geometry based on principal component analysis. We analyze how the inference of myocardial passive stiffness is affected by using our automatically generated LV geometries instead of manually generated ones. These insights will inform the development of statistical emulators of LV dynamics to avoid computationally expensive biomechanical simulations. Our proposed framework enables accurate LV geometry reconstruction, outperforming previous approaches by delivering a reconstruction error 50% lower than reported in the literature. We further demonstrate that for a nonlinear cardiac mechanics model, using our reconstructed LV geometries instead of manually extracted ones only moderately affects the inference of passive myocardial stiffness described by an anisotropic hyperelastic constitutive law. The developed methodological framework has the potential to make an important step towards personalized medicine by eliminating the need for time consuming and costly manual operations. In addition, our method automatically maps the CMR scan into a low-dimensional representation of the LV geometry, which constitutes an important stepping stone towards the development of an LV geometry-heterogeneous emulator.

[1]  D. Firmin,et al.  Motion in cardiovascular MR imaging. , 2009, Radiology.

[2]  Colin Berry,et al.  Fast parameter inference in a biomechanical model of the left ventricle by using statistical emulation , 2019, Journal of the Royal Statistical Society. Series C, Applied statistics.

[3]  Colin Berry,et al.  Changes and classification in myocardial contractile function in the left ventricle following acute myocardial infarction , 2017, Journal of The Royal Society Interface.

[4]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. , 2002, Journal of nuclear cardiology : official publication of the American Society of Nuclear Cardiology.

[5]  Jonathon Shlens,et al.  A Tutorial on Principal Component Analysis , 2014, ArXiv.

[7]  Hao Gao,et al.  Gaussian process emulation to accelerate parameter estimation in a mechanical model of the left ventricle: a critical step towards clinical end-user relevance , 2019, Journal of the Royal Society Interface.

[8]  Gerhard Sommer,et al.  Biomechanical properties and microstructure of human ventricular myocardium. , 2015, Acta biomaterialia.

[9]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[10]  Boyce E. Griffith,et al.  Quasi-static image-based immersed boundary-finite element model of left ventricle under diastolic loading , 2014, International journal for numerical methods in biomedical engineering.

[11]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[12]  Colin Berry,et al.  Advances in computational modelling for personalised medicine after myocardial infarction , 2017, Heart.

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Yi Liu,et al.  Reconstruction of myocardial tissue motion and strain fields from displacement-encoded MR imaging. , 2009, American journal of physiology. Heart and circulatory physiology.

[16]  M. Nash,et al.  Image-Based Predictive Modeling of Heart Mechanics. , 2015, Annual review of biomedical engineering.

[17]  Martyn P. Nash,et al.  Deep Learning Over Reduced Intrinsic Domains for Efficient Mechanics of the Left Ventricle , 2020, Frontiers in Physics.

[18]  C. Berry,et al.  A Randomized Trial of Deferred Stenting Versus Immediate Stenting to Prevent No- or Slow-Reflow in Acute ST-Segment Elevation Myocardial Infarction (DEFER-STEMI) , 2014, Journal of the American College of Cardiology.

[19]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association , 2002, The international journal of cardiovascular imaging.

[20]  Xi Chen,et al.  Estimation of the Volume of the Left Ventricle From MRI Images Using Deep Neural Networks , 2017, IEEE Transactions on Cybernetics.

[21]  Daniel Rueckert,et al.  Automatic 3D bi-ventricular segmentation of cardiac images by a shape-refined multi-task deep learning approach , 2018, IEEE Transactions on Medical Imaging.

[22]  D. Husmeier,et al.  Analysis of Cardiac Amyloidosis Progression Using Model-Based Markers , 2020, Frontiers in Physiology.

[23]  David Barber,et al.  An automatic service for the personalization of ventricular cardiac meshes , 2014, Journal of The Royal Society Interface.

[24]  Hao Gao,et al.  Parameter estimation in a Holzapfel–Ogden law for healthy myocardium , 2015, Journal of Engineering Mathematics.

[25]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[26]  R. Ogden,et al.  Structure‐based finite strain modelling of the human left ventricle in diastole , 2013, International journal for numerical methods in biomedical engineering.

[27]  Leon Axel,et al.  Recent Advances in Cardiovascular Magnetic Resonance: Techniques and Applications , 2017, Circulation. Cardiovascular imaging.

[28]  D. Rueckert,et al.  Machine learning in cardiovascular magnetic resonance: basic concepts and applications , 2019, Journal of Cardiovascular Magnetic Resonance.

[29]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[30]  Gerhard A Holzapfel,et al.  Constitutive modelling of passive myocardium: a structurally based framework for material characterization , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[31]  Pablo Lamata,et al.  Clinical Diagnostic Biomarkers from the Personalization of Computational Models of Cardiac Physiology , 2015, Annals of Biomedical Engineering.

[32]  Jack Lee,et al.  Multiphysics and multiscale modelling, data–model fusion and integration of organ physiology in the clinic: ventricular cardiac mechanics , 2016, Interface Focus.

[33]  Daniel Rueckert,et al.  Deep learning cardiac motion analysis for human survival prediction , 2018, Nature Machine Intelligence.

[34]  D. Husmeier,et al.  Estimating prognosis in patients with acute myocardial infarction using personalized computational heart models , 2017, Scientific Reports.

[35]  M. Nash,et al.  Efficient estimation of load‐free left ventricular geometry and passive myocardial properties using principal component analysis , 2020, International journal for numerical methods in biomedical engineering.

[36]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[37]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[38]  Colin Berry,et al.  A Novel Method for Estimating Myocardial Strain: Assessment of Deformation Tracking Against Reference Magnetic Resonance Methods in Healthy Volunteers , 2016, Scientific Reports.

[39]  Alistair A. Young,et al.  Large Scale Left Ventricular Shape Atlas Using Automated Model Fitting to Contours , 2013, FIMH.