Quantification of Full Left Ventricular Metrics via Deep Regression Learning With Contour-Guidance

Quantifying full left ventricular (LV) metrics including cavity area, myocardium area, cavity dimensions and wall thicknesses from cardiac magnetic resonance (MR) images, and then assessing regional and global cardiac function plays a crucial role in clinical practice. However, due to highly variable cardiac structures across different subjects, it is challenging to obtain an accurate estimation of LV metrics. In this paper, we propose a novel deep learning framework, called cascaded segmentation and regression network (CSRNet), to improve the quantification results. The CSRNet consists of two components: a segmentation component and a regression component. The segmentation component yields myocardial contours of the left ventricle from the input cardiac MR images, and then the regression component learns hierarchical representations from the segmented images and estimates the desired LV metrics. By introducing the myocardial contours, the regression component can pay more attention to the left ventricle, which contributes to more accurate quantification results, although the cardiac structures are variable. The extensive experiments on a dataset of 145 subjects demonstrate that our framework outperforms the state-of-the-art methods.

[1]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[2]  Wufeng Xue,et al.  Full Quantification of Left Ventricle via Deep Multitask Learning Network Respecting Intra- and Inter-Task Relatedness , 2017, MICCAI.

[3]  Mahmoud R. El-Sakka,et al.  Estimating Ejection Fraction and Left Ventricle Volume Using Deep Convolutional Networks , 2016, ICIAR.

[4]  Bertil Schmidt,et al.  $ν$-net: Deep Learning for Generalized Biventricular Cardiac Mass and Function Parameters , 2017, ArXiv.

[5]  Phi Vu Tran,et al.  A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI , 2016, ArXiv.

[6]  Alistair A. Young,et al.  Quantification of LV function and mass by cardiovascular magnetic resonance: multi-center variability and consensus contours , 2015, Journal of Cardiovascular Magnetic Resonance.

[7]  Gustavo Carneiro,et al.  Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance , 2017, Medical Image Anal..

[8]  Bin Gu,et al.  Direct Estimation of Cardiac Biventricular Volumes With an Adapted Bayesian Formulation , 2014, IEEE Transactions on Biomedical Engineering.

[9]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Gustavo Carneiro,et al.  Left ventricle segmentation from cardiac MRI combining level set methods with deep belief networks , 2013, 2013 IEEE International Conference on Image Processing.

[11]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[12]  Yunde Jia,et al.  Segmentation of the Left Ventricle from Cardiac MR Images Based on Degenerated Minimal Surface Diffusion and Shape Priors , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Jun Chen,et al.  Deep Regression Segmentation for Cardiac Bi-Ventricle MR Images , 2018, IEEE Access.

[14]  Xiantong Zhen,et al.  Direct Estimation of Cardiac Bi-ventricular Volumes with Regression Forests , 2014, MICCAI.

[15]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[16]  Wufeng Xue,et al.  Direct Estimation of Regional Wall Thicknesses via Residual Recurrent Neural Network , 2017, IPMI.

[17]  Hamid Jafarkhani,et al.  A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI , 2015, Medical Image Anal..

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Yunde Jia,et al.  Segmentation of the left ventricle in cardiac cine MRI using a shape-constrained snake model , 2013, Comput. Vis. Image Underst..

[20]  Shuo Li,et al.  Max-flow segmentation of the left ventricle by recovering subject-specific distributions via a bound of the Bhattacharyya measure , 2012, Medical Image Anal..

[21]  Thomas Netsch,et al.  Model-based segmentation of cardiac MRI cine sequences: a Bayesian formulation , 2004, SPIE Medical Imaging.

[22]  Henggui Zhang,et al.  Cardiac left ventricular volumes prediction method based on atlas location and deep learning , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[23]  Henggui Zhang,et al.  Multi-Views Fusion CNN for Left Ventricular Volumes Estimation on Cardiac MR Images , 2018, IEEE Transactions on Biomedical Engineering.

[24]  John K. Tsotsos,et al.  Efficient and generalizable statistical models of shape and appearance for analysis of cardiac MRI , 2008, Medical Image Anal..

[25]  Jorge S. Marques,et al.  Fast segmentation of the left ventricle in cardiac MRI using dynamic programming , 2018, Comput. Methods Programs Biomed..

[26]  Wufeng Xue,et al.  Full left ventricle quantification via deep multitask relationships learning , 2018, Medical Image Anal..

[27]  Heye Zhang,et al.  Direct and simultaneous estimation of cardiac four chamber volumes by multioutput sparse regression , 2017, Medical Image Anal..

[28]  Xiantong Zhen,et al.  Multi-scale deep networks and regression forests for direct bi-ventricular volume estimation , 2016, Medical Image Anal..

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Wufeng Xue,et al.  Direct Multitype Cardiac Indices Estimation via Joint Representation and Regression Learning , 2017, IEEE Transactions on Medical Imaging.