Left-Ventricle Quantification Using Residual U-Net

Estimating dimensional measurements of the left ventricle provides diagnostic values which can be used to assess cardiac health and identify certain pathologies. In this paper we describe our methodology of calculating measurements from left ventricle segmentations automatically generated using deep learning. We use a U-net convolutional neural network architecture built from residual units to segment the left ventricle and then process these segmentations to estimate the area of the cavity and myocardium, the dimensions of the cavity, and the thickness of the myocardium. Determining if an image is part of the diastolic or systolic portion of the cardiac cycle is done by analysing the cavity volume. The quality of our results are dependent on our training regime where we have generated a large derivative dataset by augmenting the original images with free-form deformations. Our expanded training set, in conjunction with simple affine image transforms, creates a sufficiently large training population to prevent over-fitting of the network while still creating an accurate and robust segmentation network. Assessing our method on the STACOM18 LVQuan challenge dataset we find that it significantly outperforms the previously published state-of-the-art on a 5-fold validation all tasks considered.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Hamid Jafarkhani,et al.  A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI , 2015, Medical Image Anal..

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Wufeng Xue,et al.  Direct Estimation of Regional Wall Thicknesses via Residual Recurrent Neural Network , 2017, IPMI.

[6]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[7]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[8]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[9]  Bin Gu,et al.  Direct Estimation of Cardiac Biventricular Volumes With an Adapted Bayesian Formulation , 2014, IEEE Transactions on Biomedical Engineering.

[10]  Wufeng Xue,et al.  Direct Multitype Cardiac Indices Estimation via Joint Representation and Regression Learning , 2017, IEEE Transactions on Medical Imaging.

[11]  Wufeng Xue,et al.  Full left ventricle quantification via deep multitask relationships learning , 2018, Medical Image Anal..

[12]  Ling Shao,et al.  A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging , 2016, Magnetic Resonance Materials in Physics, Biology and Medicine.

[13]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[14]  Phi Vu Tran,et al.  A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI , 2016, ArXiv.

[15]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[16]  Robert A. McLaughlin,et al.  Convolutional neural network regression for short‐axis left ventricle segmentation in cardiac cine MR sequences , 2017, Medical Image Anal..

[17]  Alistair A. Young,et al.  Quantification of LV function and mass by cardiovascular magnetic resonance: multi-center variability and consensus contours , 2015, Journal of Cardiovascular Magnetic Resonance.

[18]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.