Calculation of Anatomical and Functional Metrics Using Deep Learning in Cardiac MRI: Comparison Between Direct and Segmentation-Based Estimation

In this paper we propose a collection of left ventricle (LV) quantification methods using different versions of a common neural network architecture. In particular, we compare the accuracy obtained with direct calculation (regression) of the desired metrics, a segmentation network and a novel combined approach. We also introduce temporal dynamics through the use of a Long Short-Term Memory (LSTM) network. We train and evaluate our methods on MICCAI 2018 Left Ventricle Full Quantification Challenge dataset. We perform 5-fold cross-validation on the training dataset and compare our results with the state-of-the-art methods evaluated on the same dataset. In our experiments, segmentation-based methods outperform all the other variants as well as current state of the art. The introduction of LSTM does produces only minor improvements in accuracy. The novel segmentation/estimation network improves the results on estimation-only but does not reach the accuracy of segmentation-based metric calculation.

[1]  Phi Vu Tran,et al.  A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI , 2016, ArXiv.

[2]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Wufeng Xue,et al.  Direct Estimation of Regional Wall Thicknesses via Residual Recurrent Neural Network , 2017, IPMI.

[5]  J. Alison Noble,et al.  &OHgr;‐Net (Omega‐Net): Fully automatic, multi‐view cardiac MR detection, orientation, and segmentation with deep neural networks☆ , 2018, Medical Image Anal..

[6]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[7]  Wufeng Xue,et al.  Direct Multitype Cardiac Indices Estimation via Joint Representation and Regression Learning , 2017, IEEE Transactions on Medical Imaging.

[8]  Pablo Lamata,et al.  Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation , 2016, RAMBO+HVSMR@MICCAI.

[9]  J. Alison Noble,et al.  Omega-Net: Fully Automatic, Multi-View Cardiac MR Detection, Orientation, and Segmentation with Deep Neural Networks , 2017, ArXiv.

[10]  J. Francis,et al.  The role of cardiovascular magnetic resonance imaging in heart failure. , 2009, Journal of the American College of Cardiology.

[11]  Wufeng Xue,et al.  Full left ventricle quantification via deep multitask relationships learning , 2018, Medical Image Anal..

[12]  Alistair A. Young,et al.  Quantification of LV function and mass by cardiovascular magnetic resonance: multi-center variability and consensus contours , 2015, Journal of Cardiovascular Magnetic Resonance.

[13]  Wufeng Xue,et al.  Full Quantification of Left Ventricle via Deep Multitask Learning Network Respecting Intra- and Inter-Task Relatedness , 2017, MICCAI.