Left Ventricle Full Quantification via Hierarchical Quantification Network

Automatic quantitative analysis of cardiac left ventricle (LV) function is one of challenging task for heart disease diagnosis. Four different parameters, i.e. regional wall thicknesses (RWT), area of myocardium and LV cavity, LV dimensions in different direction and cardiac phase, are used for evaluating the LV function. In this paper, we implemented a novel multi-task quantification network (HQNet) to simultaneously quantify the four different parameters. The network is mainly constituted by a customized convolutional neural network named Hierarchical convolutional neural network (HCNN) which includes different pyramid-like 3D convolution blocks with different kernel sizes for efficient feature embedding; and two long-short term memory (LSTM) networks for temporal modeling. Respecting inter-task correlations, our proposed network uses multi-task constraints for phase to improve the final estimation of phase. Selu activation function is selected instead of relu, which can bring better performance of model in experiments. Experiments on MR sequences of 145 patients show that HQNet achieves high accurate estimation by means of 7-fold cross validation. The mean absolute error (MAE) of average areas, RWT, dimensions are \( 197\,{\text{mm}}^{2} ,1.51\,{\text{mm}},2.57\,{\text{mm}} \) respectively. The error rate of phase classification is 9.8%. These results indicate that the approach we proposed has a promising performance to estimate all four parameters.

[1]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[2]  Bruce E. Rosen,et al.  Ensemble Learning Using Decorrelated Neural Networks , 1996, Connect. Sci..

[3]  Xin Yao,et al.  Ensemble learning via negative correlation , 1999, Neural Networks.

[4]  Pablo Lamata,et al.  Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation , 2016, RAMBO+HVSMR@MICCAI.

[5]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Dit-Yan Yeung,et al.  A Convex Formulation for Learning Task Relationships in Multi-Task Learning , 2010, UAI.

[7]  Wufeng Xue,et al.  Direct Estimation of Regional Wall Thicknesses via Residual Recurrent Neural Network , 2017, IPMI.

[8]  E. Nagel,et al.  Quantification in cardiac MRI: advances in image acquisition and processing , 2010, The International Journal of Cardiovascular Imaging.

[9]  Wufeng Xue,et al.  Full Quantification of Left Ventricle via Deep Multitask Learning Network Respecting Intra- and Inter-Task Relatedness , 2017, MICCAI.

[10]  Wufeng Xue,et al.  Full left ventricle quantification via deep multitask relationships learning , 2018, Medical Image Anal..

[11]  Alex Graves,et al.  Supervised Sequence Labelling , 2012 .

[12]  J. Francis,et al.  The role of cardiovascular magnetic resonance imaging in heart failure. , 2009, Journal of the American College of Cardiology.

[13]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  Shuo Li,et al.  Max-flow segmentation of the left ventricle by recovering subject-specific distributions via a bound of the Bhattacharyya measure , 2012, Medical Image Anal..

[16]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[17]  Shaoting Zhang,et al.  Recognizing End-Diastole and End-Systole Frames via Deep Temporal Regression Network , 2016, MICCAI.

[18]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Bin Gu,et al.  Direct Estimation of Cardiac Biventricular Volumes With an Adapted Bayesian Formulation , 2014, IEEE Transactions on Biomedical Engineering.

[20]  Xiaoou Tang,et al.  Facial Landmark Detection by Deep Multi-task Learning , 2014, ECCV.

[21]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).