CNN-based Cardiac Motion Extraction to Generate Deformable Geometric Left Ventricle Myocardial Models from Cine MRI

Patient-specific left ventricle (LV) myocardial models have the potential to be used in a variety of clinical scenarios for improved diagnosis and treatment plans. Cine cardiac magnetic resonance (MR) imaging provides high resolution images to reconstruct patient-specific geometric models of the LV myocardium. With the advent of deep learning, accurate segmentation of cardiac chambers from cine cardiac MR images and unsupervised learning for image registration for cardiac motion estimation on a large number of image datasets is attainable. Here, we propose a deep leaning-based framework for the development of patientspecific geometric models of LV myocardium from cine cardiac MR images, using the Automated Cardiac Diagnosis Challenge (ACDC) dataset. We use the deformation field estimated from the VoxelMorph-based convolutional neural network (CNN) to propagate the isosurface mesh and volume mesh of the end-diastole (ED) frame to the subsequent frames of the cardiac cycle. We assess the CNN-based propagated models against segmented models at each cardiac phase, as well as models propagated using another traditional nonrigid image registration technique.

[1]  Thomas Lewiner,et al.  Efficient Implementation of Marching Cubes' Cases with Topological Guarantees , 2003, J. Graphics, GPU, & Game Tools.

[2]  Suzanne M. Shontz,et al.  A Mesh Warping Algorithm Based on Weighted Laplacian Smoothing , 2003, IMR.

[3]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[4]  Yongpei Zhu,et al.  New loss functions for medical image registration based on VoxelMorph , 2020, Medical Imaging: Image Processing.

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  P. Pathmanathan,et al.  Patient-Specific Cardiovascular Computational Modeling: Diversity of Personalization and Challenges , 2018, Journal of Cardiovascular Translational Research.

[7]  Ziv Yaniv,et al.  Cine cardiac MRI slice misalignment correction towards full 3D left ventricle segmentation , 2018, Medical Imaging.

[8]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[9]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[10]  Stefan Klein,et al.  SimpleElastix: A User-Friendly, Multi-lingual Library for Medical Image Registration , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[11]  Daniel Rueckert,et al.  Deep learning cardiac motion analysis for human survival prediction , 2018, Nature Machine Intelligence.

[12]  Hang Si,et al.  TetGen, a Delaunay-Based Quality Tetrahedral Mesh Generator , 2015, ACM Trans. Math. Softw..

[13]  Helko Lehmann,et al.  euHeart: personalized and integrated cardiac care using patient-specific cardiovascular modelling , 2011, Interface Focus.

[14]  J. Gunn,et al.  Computational fluid dynamics modelling in cardiovascular medicine , 2015, Heart.

[15]  P. Knupp Algebraic mesh quality metrics for unstructured initial meshes , 2003 .

[16]  Mert R. Sabuncu,et al.  Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfaces , 2019, Medical Image Anal..

[17]  Mert R. Sabuncu,et al.  VoxelMorph: A Learning Framework for Deformable Medical Image Registration , 2018, IEEE Transactions on Medical Imaging.

[18]  M. Fornage,et al.  Heart Disease and Stroke Statistics—2017 Update: A Report From the American Heart Association , 2017, Circulation.

[19]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.