Dilated-Inception Net: Multi-Scale Feature Aggregation for Cardiac Right Ventricle Segmentation

Segmentation of cardiac ventricle from magnetic resonance images is significant for cardiac disease diagnosis, progression assessment, and monitoring cardiac conditions. Manual segmentation is so time consuming, tedious, and subjective that automated segmentation methods are highly desired in practice. However, conventional segmentation methods performed poorly in cardiac ventricle, especially in the right ventricle. Compared with the left ventricle, whose shape is a simple thick-walled circle, the structure of the right ventricle is more complex due to ambiguous boundary, irregular cavity, and variable crescent shape. Hence, effective feature extractors and segmentation models are preferred. In this paper, we propose a dilated-inception net (DIN) to extract and aggregate multi-scale features for right ventricle segmentation. The DIN outperforms many state-of-the-art models on the benchmark database of right ventricle segmentation challenge. In addition, the experimental results indicate that the proposed model has potential to reach expert-level performance in right ventricular epicardium segmentation. More importantly, DIN behaves similarly to clinical expert with high correlation coefficients in four clinical cardiac indices. Therefore, the proposed DIN is promising for automated cardiac right ventricle segmentation in clinical applications.

[1]  Wufeng Xue,et al.  Full left ventricle quantification via deep multitask relationships learning , 2018, Medical Image Anal..

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[5]  Lin Yang,et al.  Combining Fully Convolutional and Recurrent Neural Networks for 3D Biomedical Image Segmentation , 2016, NIPS.

[6]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[7]  Pierre-André Vuissoz,et al.  Assessment of right ventricle volumes and function by cardiac MRI: Quantification of the regional and global interobserver variability , 2012, Magnetic resonance in medicine.

[8]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[9]  Daniel Rueckert,et al.  Right ventricle segmentation from cardiac MRI: A collation study , 2015, Medical Image Anal..

[10]  Joachim M. Buhmann,et al.  Automatic cardiac RV segmentation using semantic information with graph cuts , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[11]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  A. Santos,et al.  Segmentation of RV in 4D cardiac MR volumes using region-merging graph cuts , 2012, 2012 Computing in Cardiology.

[14]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[16]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[17]  Terry M. Peters,et al.  Left ventricle segmentation in MRI via convex relaxed distribution matching , 2013, Medical Image Anal..

[18]  Vijay K. Devabhaktuni,et al.  Fast, accurate, and fully automatic segmentation of the right ventricle in short-axis cardiac MRI , 2014, Comput. Medical Imaging Graph..

[19]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[20]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[21]  Phi Vu Tran,et al.  A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI , 2016, ArXiv.

[22]  Gustavo Carneiro,et al.  The Segmentation of the Left Ventricle of the Heart From Ultrasound Data Using Deep Learning Architectures and Derivative-Based Search Methods , 2012, IEEE Transactions on Image Processing.

[23]  Julien Abi-Nahed,et al.  Robust Active Shape Models: A Robust, Generic and Simple Automatic Segmentation Tool , 2006, MICCAI.

[24]  Nicos Maglaveras,et al.  Model-based processing scheme for quantitative 4-D cardiac MRI analysis , 2002, IEEE Transactions on Information Technology in Biomedicine.

[25]  Andreas Schuster,et al.  Quantification in cardiac MRI: advances in image acquisition and processing. , 2010, The international journal of cardiovascular imaging.

[26]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[27]  Caroline Petitjean,et al.  Cardiac MRI assessment of right ventricular function in acquired heart disease: factors of variability. , 2012, Academic radiology.

[28]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[29]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[30]  Su Ruan,et al.  Graph cut segmentation with a statistical shape model in cardiac MRI , 2013, Comput. Vis. Image Underst..

[31]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  S. Hunt,et al.  Right Ventricular Function in Cardiovascular Disease, Part II: Pathophysiology, Clinical Importance, and Management of Right Ventricular Failure , 2008, Circulation.

[33]  Hamid Jafarkhani,et al.  Automatic segmentation of the right ventricle from cardiac MRI using a learning‐based approach , 2017, Magnetic resonance in medicine.

[34]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[35]  Daniel Rueckert,et al.  A Probabilistic Patch-Based Label Fusion Model for Multi-Atlas Segmentation With Registration Refinement: Application to Cardiac MR Images , 2013, IEEE Transactions on Medical Imaging.

[36]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[39]  Sébastien Ourselin,et al.  Multi-atlas Propagation Whole Heart Segmentation from MRI and CTA Using a Local Normalised Correlation Coefficient Criterion , 2013, FIMH.

[40]  Caroline Petitjean,et al.  Diagnostic accuracy and variability of three semi-quantitative methods for assessing right ventricular systolic function from cardiac MRI in patients with acquired heart disease , 2011, European Radiology.

[41]  S. Hunt,et al.  Right Ventricular Function in Cardiovascular Disease, Part I: Anatomy, Physiology, Aging, and Functional Assessment of the Right Ventricle , 2008, Circulation.

[42]  Seyed-Ahmad Ahmadi,et al.  Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields , 2016, MICCAI.