DW-Net: A cascaded convolutional neural network for apical four-chamber view segmentation in fetal echocardiography

Fetal echocardiography (FE) is a widely used medical examination for early diagnosis of congenital heart disease (CHD). The apical four-chamber view (A4C) is an important view among early FE images. Accurate segmentation of crucial anatomical structures in the A4C view is a useful and important step for early diagnosis and timely treatment of CHDs. However, it is a challenging task due to several unfavorable factors: (a) artifacts and speckle noise produced by ultrasound imaging. (b) category confusion caused by the similarity of anatomical structures and variations of scanning angles. (c) missing boundaries. In this paper, we propose an end-to-end DW-Net for accurate segmentation of seven important anatomical structures in the A4C view. The network comprises two components: 1) a Dilated Convolutional Chain (DCC) for "gridding issue" reduction, multi-scale contextual information aggregation and accurate localization of cardiac chambers. 2) a W-Net for gaining more precise boundaries and yielding refined segmentation results. Extensive experiments of the proposed method on a dataset of 895 A4C views have demonstrated that DW-Net can achieve good segmentation results, including the Dice Similarity Coefficient (DSC) of 0.827, the Pixel Accuracy (PA) of 0.933, the AUC of 0.990 and it substantially outperformed some well-known segmentation methods. Our work was highly valued by experienced clinicians. The accurate and automatic segmentation of the A4C view using the proposed DW-Net can benefit further extractions of useful clinical indicators in early FE and improve the prenatal diagnostic accuracy and efficiency of CHDs.

[1]  J. Green,et al.  Fetal echocardiographic screening for congenital heart disease: the importance of the four-chamber view. , 1987, American journal of obstetrics and gynecology.

[2]  Seyed-Ahmad Ahmadi,et al.  Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound , 2016, Comput. Vis. Image Underst..

[3]  Fa Wu,et al.  Cascade convolutional neural networks for automatic detection of thyroid nodules in ultrasound images , 2017, Medical physics.

[4]  Sylvie Sevestre,et al.  A new Markov random field model based on κ-distribution for textured ultrasound image , 2004, SPIE Medical Imaging.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  K. Helen Prabha,et al.  Preserving the border and curvature of fetal heart chambers through TDyWT perspective geometry wrap segmentation , 2017, Multimedia Tools and Applications.

[7]  J. Alison Noble,et al.  A shape-space-based approach to tracking myocardial borders and quantifying regional left-ventricular function applied in echocardiography , 2002, IEEE Transactions on Medical Imaging.

[8]  Yongmin Kim,et al.  Parametric shape modeling using deformable superellipses for prostate segmentation , 2004, IEEE Transactions on Medical Imaging.

[9]  Pavel Kisilev,et al.  Medical Image Description Using Multi-task-loss CNN , 2016, LABELS/DLMIA@MICCAI.

[10]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[11]  Yu Cao,et al.  Segmentation of Anatomical Structures in Four-Chamber View Echocardiogram Images , 2014, 2014 22nd International Conference on Pattern Recognition.

[12]  N. Sandoval Congenital heart disease in Colombia and worldwide , 2015 .

[13]  Larry S. Davis,et al.  Stacked U-Nets: A No-Frills Approach to Natural Image Segmentation , 2018, ArXiv.

[14]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[15]  Marios Anthimopoulos,et al.  Semantic Segmentation of Pathological Lung Tissue With Dilated Fully Convolutional Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[16]  Ping Chen,et al.  Segmentation of Fetal Left Ventricle in Echocardiographic Sequences Based on Dynamic Convolutional Neural Networks , 2017, IEEE Transactions on Biomedical Engineering.

[17]  Xin Yang,et al.  Standard plane localization in ultrasound by radial component model and selective search. , 2014, Ultrasound in medicine & biology.

[18]  Nirmala Sivaraj,et al.  Fuzzy Connectedness Based Segmentation of Fetal Heart from Clinical Ultrasound Images , 2014 .

[19]  Dorin Comaniciu,et al.  Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features , 2008, IEEE Transactions on Medical Imaging.

[20]  J. Noble,et al.  Quantitative regional analysis of myocardial wall motion. , 2001, Ultrasound in medicine & biology.

[21]  Daniel Rueckert,et al.  Automatic 3D bi-ventricular segmentation of cardiac images by a shape-refined multi-task deep learning approach , 2018, IEEE Transactions on Medical Imaging.

[22]  Jianwei Lu,et al.  A Coarse-to-Fine Fully Convolutional Neural Network for Fundus Vessel Segmentation , 2018, Symmetry.

[23]  Pheng-Ann Heng,et al.  Cascaded Fully Convolutional Networks for automatic prenatal ultrasound image segmentation , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[24]  Jun Xie,et al.  Segmentation of kidney from ultrasound images based on texture and shape priors , 2005, IEEE Transactions on Medical Imaging.

[25]  Inas A. Yassine,et al.  Automatic localization of the left ventricle in cardiac MRI images using deep learning , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[26]  L. Allan,et al.  Screening for congenital heart disease prenatally. Results of a 2½‐year study in the South East Thames Region , 1992, British journal of obstetrics and gynaecology.

[27]  Guang Yang,et al.  A Two-Stage U-Net Model for 3D Multi-class Segmentation on Full-Resolution Cardiac Data , 2018, STACOM@MICCAI.

[28]  Phi Vu Tran,et al.  A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI , 2016, ArXiv.

[29]  X. Chen,et al.  OC12.03: A national survey of fetal congenital heart diseases in China , 2015 .

[30]  Han Wang,et al.  SMT Solder Joint Inspection via a Novel Cascaded Convolutional Neural Network , 2018, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[31]  Ruey-Feng Chang,et al.  Automatic ultrasound segmentation and morphology based diagnosis of solid breast tumors , 2004, Breast Cancer Research and Treatment.

[32]  Hamid Jafarkhani,et al.  A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI , 2015, Medical Image Anal..

[33]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[34]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[35]  Bo Du,et al.  Deeply-supervised CNN for prostate segmentation , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[36]  Michael Unser,et al.  Spatio-temporal nonrigid registration for ultrasound cardiac motion estimation , 2005, IEEE Transactions on Medical Imaging.

[37]  Chen Wang,et al.  Standardized Evaluation System for Left Ventricular Segmentation Algorithms in 3D Echocardiography , 2016, IEEE Transactions on Medical Imaging.

[38]  Tim Leiner,et al.  Dilated Convolutional Neural Networks for Cardiovascular MR Segmentation in Congenital Heart Disease , 2016, RAMBO+HVSMR@MICCAI.

[39]  Jun Fu,et al.  Stacked Deconvolutional Network for Semantic Segmentation , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[40]  R. Schiavina*,et al.  Screening for congenital heart disease with the four-chamber view of the fetal heart. , 1992, American journal of obstetrics and gynecology.

[41]  Lei Song,et al.  Value of four-chamber view of the fetal echocardiography for the prenatal diagnosis of congenital heart dise. , 2002, Zhonghua fu chan ke za zhi.

[42]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[43]  Hamid Jafarkhani,et al.  Automatic segmentation of the right ventricle from cardiac MRI using a learning‐based approach , 2017, Magnetic resonance in medicine.

[44]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[45]  S. M. Masudur Rahman Al-Arif,et al.  Fully automatic cervical vertebrae segmentation framework for X-ray images , 2018, Comput. Methods Programs Biomed..

[46]  Guang Yang,et al.  Automatic Prostate Zonal Segmentation Using Fully Convolutional Network With Feature Pyramid Attention , 2019, IEEE Access.

[47]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[48]  Fa Wu,et al.  Ultrasound image-based thyroid nodule automatic segmentation using convolutional neural networks , 2017, International Journal of Computer Assisted Radiology and Surgery.

[49]  Gustavo Carneiro,et al.  Left ventricle segmentation from cardiac MRI combining level set methods with deep belief networks , 2013, 2013 IEEE International Conference on Image Processing.

[50]  R. Krasuski,et al.  Congenital Heart Disease Epidemiology in the United States: Blindly Feeling for the Charging Elephant , 2016, Circulation.

[51]  M. Tang,et al.  Prenatal diagnosis of congenital heart malformations: classification based on abnormalities detected by the four‐chamber view , 1999, Prenatal diagnosis.

[52]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[53]  Jun Chen,et al.  Correlated Regression Feature Learning for Automated Right Ventricle Segmentation , 2018, IEEE Journal of Translational Engineering in Health and Medicine.

[54]  Larry S. Davis,et al.  Stacked U-Nets for Ground Material Segmentation in Remote Sensing Imagery , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[55]  Shuo Li,et al.  Spine‐GAN: Semantic segmentation of multiple spinal structures , 2018, Medical Image Anal..

[56]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[57]  C. Lamberti,et al.  Maximum likelihood segmentation of ultrasound images with Rayleigh distribution , 2005, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.