Direct Multitype Cardiac Indices Estimation via Joint Representation and Regression Learning

Cardiac indices estimation is of great importance during identification and diagnosis of cardiac disease in clinical routine. However, estimation of multitype cardiac indices with consistently reliable and high accuracy is still a great challenge due to the high variability of cardiac structures and the complexity of temporal dynamics in cardiac MR sequences. While efforts have been devoted into cardiac volumes estimation through feature engineering followed by a independent regression model, these methods suffer from the vulnerable feature representation and incompatible regression model. In this paper, we propose a semi-automated method for multitype cardiac indices estimation. After the manual labeling of two landmarks for ROI cropping, an integrated deep neural network Indices-Net is designed to jointly learn the representation and regression models. It comprises two tightly-coupled networks, such as a deep convolution autoencoder for cardiac image representation, and a multiple output convolution neural network for indices regression. Joint learning of the two networks effectively enhances the expressiveness of image representation with respect to cardiac indices, and the compatibility between image representation and indices regression, thus leading to accurate and reliable estimations for all the cardiac indices. When applied with five-fold cross validation on MR images of 145 subjects, Indices-Net achieves consistently low estimation error for LV wall thicknesses (1.44 ± 0.71 mm) and areas of cavity and myocardium (204 ± 133 mm2). It outperforms, with significant error reductions, segmentation method (55.1% and 17.4%), and two-phase direct volume-only methods (12.7% and 14.6%) for wall thicknesses and areas, respectively. These advantages endow the proposed method a great potential in clinical cardiac function assessment.

[1]  Hamid Jafarkhani,et al.  A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI , 2015, Medical Image Anal..

[2]  Terry M. Peters,et al.  Global Assessment of Cardiac Function Using Image Statistics in MRI , 2012, MICCAI.

[3]  Xiantong Zhen,et al.  Direct and Simultaneous Four-Chamber Volume Estimation by Multi-Output Regression , 2015, MICCAI.

[4]  Ziv Yaniv,et al.  Left Ventricle Segmentation and Quantification from Cardiac Cine MR Images via Multi-task Learning , 2018, STACOM@MICCAI.

[5]  Bin Gu,et al.  Direct Estimation of Cardiac Biventricular Volumes With an Adapted Bayesian Formulation , 2014, IEEE Transactions on Biomedical Engineering.

[6]  Graham W. Taylor,et al.  Deconvolutional networks , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  John Eng,et al.  Normal Left Ventricular Myocardial Thickness for Middle-Aged and Older Subjects With Steady-State Free Precession Cardiac Magnetic Resonance: The Multi-Ethnic Study of Atherosclerosis , 2012, Circulation. Cardiovascular imaging.

[8]  Xiantong Zhen,et al.  Direct Estimation of Cardiac Bi-ventricular Volumes with Regression Forests , 2014, MICCAI.

[9]  Shuo Li,et al.  Embedding Overlap Priors in Variational Left Ventricle Tracking , 2009, IEEE Transactions on Medical Imaging.

[10]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[11]  Gustavo Carneiro,et al.  Left ventricle segmentation from cardiac MRI combining level set methods with deep belief networks , 2013, 2013 IEEE International Conference on Image Processing.

[12]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[13]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. , 2002, Journal of nuclear cardiology : official publication of the American Society of Nuclear Cardiology.

[14]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[15]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[16]  Danny Ziyi Chen,et al.  A Deep Learning Approach for Semantic Segmentation in Histology Tissue Images , 2016, MICCAI.

[17]  Mahmoud R. El-Sakka,et al.  Estimating Ejection Fraction and Left Ventricle Volume Using Deep Convolutional Networks , 2016, ICIAR.

[18]  Anders P. Eriksson,et al.  Fast Convolutional Sparse Coding , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Xiantong Zhen,et al.  Multi-scale deep networks and regression forests for direct bi-ventricular volume estimation , 2016, Medical Image Anal..

[20]  Gustavo Carneiro,et al.  Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance , 2017, Medical Image Anal..

[21]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[22]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[23]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[25]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[26]  R J van der Geest,et al.  Assessment of regional left ventricular wall parameters from short axis magnetic resonance imaging using a three-dimensional extension to the improved centerline method. , 1997, Investigative radiology.

[27]  Phi Vu Tran,et al.  A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI , 2016, ArXiv.

[28]  Pablo Lamata,et al.  Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation , 2016, RAMBO+HVSMR@MICCAI.

[29]  Terry M. Peters,et al.  Regional Assessment of Cardiac Left Ventricular Myocardial Function via MRI Statistical Features , 2014, IEEE Transactions on Medical Imaging.

[30]  Shuo Li,et al.  Max-flow segmentation of the left ventricle by recovering subject-specific distributions via a bound of the Bhattacharyya measure , 2012, Medical Image Anal..

[31]  Paolo Zaffino,et al.  Deep Neural Networks for Fast Segmentation of 3D Medical Images , 2016, MICCAI.

[32]  Ling Shao,et al.  A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging , 2016, Magnetic Resonance Materials in Physics, Biology and Medicine.

[33]  Rama Chellappa,et al.  Growing Regression Forests by Classification: Applications to Object Pose Estimation , 2013, ECCV.

[34]  Eckart Fleck,et al.  Left ventricular chamber dimensions and wall thickness by cardiovascular magnetic resonance: comparison with transthoracic echocardiography. , 2013, European heart journal cardiovascular Imaging.

[35]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[36]  Daniel Rueckert,et al.  Prediction of Clinical Information from Cardiac MRI Using Manifold Learning , 2015, FIMH.