Direct Estimation of Regional Wall Thicknesses via Residual Recurrent Neural Network

Accurate estimation of regional wall thicknesses (RWT) of left ventricular (LV) myocardium from cardiac MR sequences is of significant importance for identification and diagnosis of cardiac disease. Existing RWT estimation still relies on segmentation of LV myocardium, which requires strong prior information and user interaction. No work has been devoted into direct estimation of RWT from cardiac MR images due to the diverse shapes and structures for various subjects and cardiac diseases, as well as the complex regional deformation of LV myocardium during the systole and diastole phases of the cardiac cycle. In this paper, we present a newly proposed Residual Recurrent Neural Network (ResRNN) that fully leverages the spatial and temporal dynamics of LV myocardium to achieve accurate frame-wise RWT estimation. Our ResRNN comprises two paths: (1) a feed forward convolution neural network (CNN) for effective and robust CNN embedding learning of various cardiac images and preliminary estimation of RWT from each frame itself independently, and (2) a recurrent neural network (RNN) for further improving the estimation by modeling spatial and temporal dynamics of LV myocardium. For the RNN path, we design for cardiac sequences a Circle-RNN to eliminate the effect of null hidden input for the first time-step. Our ResRNN is capable of obtaining accurate estimation of cardiac RWT with Mean Absolute Error of 1.44 mm (less than 1-pixel error) when validated on cardiac MR sequences of 145 subjects, evidencing its great potential in clinical cardiac function assessment.

[1]  Liang Lu,et al.  Top-down Tree Long Short-Term Memory Networks , 2015, NAACL.

[2]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[3]  Ling Shao,et al.  A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging , 2016, Magnetic Resonance Materials in Physics, Biology and Medicine.

[4]  John Eng,et al.  Normal Left Ventricular Myocardial Thickness for Middle-Aged and Older Subjects With Steady-State Free Precession Cardiac Magnetic Resonance: The Multi-Ethnic Study of Atherosclerosis , 2012, Circulation. Cardiovascular imaging.

[5]  Pablo Lamata,et al.  Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation , 2016, RAMBO+HVSMR@MICCAI.

[6]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Terry M. Peters,et al.  Global Assessment of Cardiac Function Using Image Statistics in MRI , 2012, MICCAI.

[8]  Eckart Fleck,et al.  Left ventricular chamber dimensions and wall thickness by cardiovascular magnetic resonance: comparison with transthoracic echocardiography. , 2013, European heart journal cardiovascular Imaging.

[9]  Xiantong Zhen,et al.  Multi-scale deep networks and regression forests for direct bi-ventricular volume estimation , 2016, Medical Image Anal..

[10]  Ronald M. Summers,et al.  Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Shaoting Zhang,et al.  Recognizing End-Diastole and End-Systole Frames via Deep Temporal Regression Network , 2016, MICCAI.

[12]  Wenjun Zeng,et al.  Online Human Action Detection using Joint Classification-Regression Recurrent Neural Networks , 2016, ECCV.

[13]  Xiantong Zhen,et al.  Direct and Simultaneous Four-Chamber Volume Estimation by Multi-Output Regression , 2015, MICCAI.

[14]  Xiantong Zhen,et al.  Direct Estimation of Cardiac Bi-ventricular Volumes with Regression Forests , 2014, MICCAI.

[15]  Shuicheng Yan,et al.  Semantic Object Parsing with Local-Global Long Short-Term Memory , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Alex Graves,et al.  Supervised Sequence Labelling , 2012 .

[17]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[18]  Terry M. Peters,et al.  Regional Assessment of Cardiac Left Ventricular Myocardial Function via MRI Statistical Features , 2014, IEEE Transactions on Medical Imaging.

[19]  Shuo Li,et al.  Max-flow segmentation of the left ventricle by recovering subject-specific distributions via a bound of the Bhattacharyya measure , 2012, Medical Image Anal..

[20]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association , 2002, The international journal of cardiovascular imaging.

[21]  Daniel Rueckert,et al.  Prediction of Clinical Information from Cardiac MRI Using Manifold Learning , 2015, FIMH.

[22]  Bin Gu,et al.  Direct Estimation of Cardiac Biventricular Volumes With an Adapted Bayesian Formulation , 2014, IEEE Transactions on Biomedical Engineering.

[23]  Liang Lu,et al.  Tree Recurrent Neural Networks with Application to Language Modeling , 2015, ArXiv.