3D Left Ventricular Segmentation from 2D Cardiac MR Images Using Spatial Context

Accurate left ventricular (LV) segmentation in cardiac MRI facilitates quantification of clinical parameters such as LV volume and ejection fraction (EF). We present a CNN-based method to obtain a 3D representation of LV by integrating information from 2D short-axis and horizontal and vertical long-axis images. Our CNN is flexible to the number of input slices and uses an additional input of image coordinates as spatial context. This concept is validated on variations of two well-known CNN architectures for medical image segmentation: U-Net and DeepMedic. Five-fold cross validation on a dataset of 20 patients achieved a correlation of 95.0/93.1\(\%\) for quantification of end-diastolic volume, 91.6/90.8\(\%\) for end-systolic volume and 80.5/84.5\(\%\) for EF for the two architectures respectively. We show that (1) incorporating long-axis data improves segmentation performance and (2) providing spatial context by adding image coordinates as input to the CNN yields similar performance with a smaller receptive field.

[1]  Henggui Zhang,et al.  Multi-Views Fusion CNN for Left Ventricular Volumes Estimation on Cardiac MR Images , 2018, IEEE Transactions on Biomedical Engineering.

[2]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Nicholas Ayache,et al.  3-D Consistent and Robust Segmentation of Cardiac Images by Deep Learning With Spatial Propagation , 2018, IEEE Transactions on Medical Imaging.

[5]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[6]  Zhiming Luo,et al.  Convolutional Neural Network With Shape Prior Applied to Cardiac MRI Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[7]  Paul Suetens,et al.  Automatic 3-D Breath-Hold Related Motion Correction of Dynamic Multislice MRI , 2010, IEEE Transactions on Medical Imaging.

[8]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[9]  Daniel Rueckert,et al.  Automatic 3D bi-ventricular segmentation of cardiac images by a shape-refined multi-task deep learning approach , 2018, IEEE Transactions on Medical Imaging.

[10]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[11]  Konstantinos Kamnitsas,et al.  Multi-input Cardiac Image Super-Resolution Using Convolutional Neural Networks , 2016, MICCAI.

[12]  Örjan Smedby,et al.  Automatic Whole Heart Segmentation Using Deep Learning and Shape Context , 2017, STACOM@MICCAI.

[13]  Pablo Lamata,et al.  Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation , 2016, RAMBO+HVSMR@MICCAI.

[14]  Christian Wachinger,et al.  DeepNAT: Deep convolutional neural network for segmenting neuroanatomy , 2017, NeuroImage.

[15]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.