AIDAN: An Attention-Guided Dual-Path Network for Pediatric Echocardiography Segmentation

Accurate segmentation of pediatric echocardiography images is essential for a wide range of diagnostic and pre-interventional planning, but remains challenging (e.g., low signal to noise ratio and internal variability in heart appearance). To address these problems, in this paper, we propose a novel Cardiac Attention-guided Dual-path Network (i.e., AIDAN). AIDAN comprises a convolutional block attention module (CBAM) attached to a spatial (i.e., SPA) and context paths (i.e., CPA), which can guide the network and learn the most discriminative features. The spatial path captures low-level spatial features, and the context path is designed to exploit high-level context. Finally, features learned from the two paths are fused efficiently using a specially designed feature fusion module (FFM), and these are used to predict the final segmentation map. We experiment on a self-collected dataset of 127 pediatric echocardiography cases which are videos containing at least a complete cardiac cycle, and obtain a Dice coefficient of 0.951 and 0.914, in the left ventricle and atrium segments, respectively. AIDAN outperforms other state-of-the-art methods and has great potential for pediatric echocardiography images analysis.

[1]  Yong Xia,et al.  Attention Residual Learning for Skin Lesion Classification , 2019, IEEE Transactions on Medical Imaging.

[2]  Ping Chen,et al.  Segmentation of Fetal Left Ventricle in Echocardiographic Sequences Based on Dynamic Convolutional Neural Networks , 2017, IEEE Transactions on Biomedical Engineering.

[3]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Dong Ni,et al.  Multi-task learning for quality assessment of fetal head ultrasound images , 2019, Medical Image Anal..

[7]  Boris Escalante-Ramírez,et al.  Left ventricle segmentation in fetal echocardiography using a multi-texture active appearance model based on the steered Hermite transform , 2016, Comput. Methods Programs Biomed..

[8]  Tanveer F. Syeda-Mahmood,et al.  Echocardiography segmentation based on a shape-guided deformable model driven by a fully convolutional network prior , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[9]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[10]  Xu Wang,et al.  Towards Automatic Semantic Segmentation in Volumetric Ultrasound , 2017, MICCAI.

[11]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[12]  Chi-Ming Chow,et al.  Automation, machine learning, and artificial intelligence in echocardiography: A brave new world , 2018, Echocardiography.

[13]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[15]  Boudewijn P. F. Lelieveldt,et al.  Fully‐automatic left ventricular segmentation from long‐axis cardiac cine MR scans , 2017, Medical Image Anal..

[16]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  X. Chen,et al.  OC12.03: A national survey of fetal congenital heart diseases in China , 2015 .

[18]  Kipp W. Johnson,et al.  Deep learning for cardiovascular medicine: a practical primer. , 2019, European heart journal.

[19]  John Gorcsan,et al.  Guidelines and recommendations for digital echocardiography : A report from the digital echocardiography committee of the American Society of Echocardiography , 2005 .

[20]  Bruce R. Rosen,et al.  Implementation and Validation of a Three-dimensional Cardiac Motion Estimation Network. , 2019, Radiology. Artificial intelligence.

[21]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[24]  Dong Ni,et al.  Deep Learning in Medical Ultrasound Analysis: A Review , 2019, Engineering.

[25]  Alexander Sergeev,et al.  Horovod: fast and easy distributed deep learning in TensorFlow , 2018, ArXiv.

[26]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Liang Chen,et al.  DRINet for Medical Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[28]  S. Plein,et al.  Deep Learning-based Method for Fully Automatic Quantification of Left Ventricle Function from Cine MR Images: A Multivendor, Multicenter Study. , 2019, Radiology.

[29]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[30]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]  Ruzena Bajcsy,et al.  Fully Automated Echocardiogram Interpretation in Clinical Practice , 2018, Circulation.

[32]  J. Alison Noble,et al.  &OHgr;‐Net (Omega‐Net): Fully automatic, multi‐view cardiac MR detection, orientation, and segmentation with deep neural networks☆ , 2018, Medical Image Anal..

[33]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[34]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[35]  Gang Yu,et al.  BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation , 2018, ECCV.

[36]  Baiying Lei,et al.  Fully Automatic Pediatric Echocardiography Segmentation Using Deep Convolutional Networks Based on BiSeNet , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[37]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  R. Krasuski,et al.  Congenital Heart Disease Epidemiology in the United States: Blindly Feeling for the Charging Elephant , 2016, Circulation.

[39]  Frederic Cervenansky,et al.  Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography , 2019, IEEE Transactions on Medical Imaging.

[40]  Gustavo Carneiro,et al.  The Segmentation of the Left Ventricle of the Heart From Ultrasound Data Using Deep Learning Architectures and Derivative-Based Search Methods , 2012, IEEE Transactions on Image Processing.

[41]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Dimitris N. Metaxas,et al.  Quantized Densely Connected U-Nets for Efficient Landmark Localization , 2018, ECCV.

[43]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[44]  S. Colan,et al.  Recommendations for quantification methods during the performance of a pediatric echocardiogram: a report from the Pediatric Measurements Writing Group of the American Society of Echocardiography Pediatric and Congenital Heart Disease Council. , 2010, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[45]  Daniel Rueckert,et al.  Automatic 3D bi-ventricular segmentation of cardiac images by a shape-refined multi-task deep learning approach , 2018, IEEE Transactions on Medical Imaging.

[46]  Nicholas Ayache,et al.  3-D Consistent and Robust Segmentation of Cardiac Images by Deep Learning With Spatial Propagation , 2018, IEEE Transactions on Medical Imaging.

[47]  Abhinav Gupta,et al.  Learning a Predictable and Generative Vector Representation for Objects , 2016, ECCV.

[48]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[49]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[50]  Shuo Li,et al.  Direct Segmentation-Based Full Quantification for Left Ventricle via Deep Multi-Task Regression Learning Network , 2019, IEEE Journal of Biomedical and Health Informatics.