Feature Tracking Cardiac Magnetic Resonance via Deep Learning and Spline Optimization

Feature tracking Cardiac Magnetic Resonance (CMR) has recently emerged as an area of interest for quantification of regional cardiac function from balanced, steady state free precession (SSFP) cine sequences. However, currently available techniques lack full automation, limiting reproducibility. We propose a fully automated technique whereby a CMR image sequence is first segmented with a deep, fully convolutional neural network (CNN) architecture, and quadratic basis splines are fitted simultaneously across all cardiac frames using least squares optimization. Experiments are performed using data from 42 patients with hypertrophic cardiomyopathy (HCM) and 21 healthy control subjects. In terms of segmentation, we compared state-of-the-art CNN frameworks, U-Net and dilated convolution architectures, with and without temporal context, using cross validation with three folds. Performance relative to expert manual segmentation was similar across all networks: pixel accuracy was \(\sim 97\%\), intersection-over-union (IoU) across all classes was \(\sim 87\%\), and IoU across foreground classes only was \(\sim 85\%\). Endocardial left ventricular circumferential strain calculated from the proposed pipeline was significantly different in control and disease subjects (\(-25.3{}\%\) vs \(-29.1{}\%\), \(p=0.006{}\)), in agreement with the current clinical literature.

[1]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[2]  W. Marsden I and J , 2012 .

[3]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[4]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Jerry L. Prince,et al.  Imaging heart motion using harmonic phase MRI , 2000, IEEE Transactions on Medical Imaging.

[7]  J. Alison Noble,et al.  Data-driven shape parameterization for segmentation of the right ventricle from 3D+t echocardiography , 2015, Medical Image Anal..

[8]  Henggui Zhang,et al.  A deep learning network for right ventricle segmentation in short-axis MRI , 2016, 2016 Computing in Cardiology Conference (CinC).

[9]  G. Pedrizzetti,et al.  Principles of cardiovascular magnetic resonance feature tracking and echocardiographic speckle tracking for informed clinical use , 2016, Journal of Cardiovascular Magnetic Resonance.

[10]  Richard Stebbing Model-based segmentation methods for analysis of 2D and 3D ultrasound images and sequences , 2014 .

[11]  Andrew Zisserman,et al.  Microscopy cell counting with fully convolutional regression networks , 2015 .

[12]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[13]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[14]  Ronald M. Summers,et al.  Regional infarction identification from cardiac CT images: a computer-aided biomechanical approach , 2016, International Journal of Computer Assisted Radiology and Surgery.

[15]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Phi Vu Tran,et al.  A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI , 2016, ArXiv.

[17]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  J Alison Noble,et al.  Imaging techniques for cardiac strain and deformation: comparison of echocardiography, cardiac magnetic resonance and cardiac computed tomography , 2013, Expert review of cardiovascular therapy.

[20]  Pablo Lamata,et al.  Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation , 2016, RAMBO+HVSMR@MICCAI.

[21]  Surya Ganguli,et al.  Exact solutions to the nonlinear dynamics of learning in deep linear neural networks , 2013, ICLR.