Segmentation atrioventricular septal defect by using convolutional neural networks based on U-NET architecture

Congenital heart disease often occurs, especially in infants and fetuses. Fetal image is one of the issues that can be related to the segmentation process. The fetal heart is an important indicator in the process of structural segmentation and functional assessment of congenital heart disease. This study is very challenging due to the fetal heart has a relatively unclear structural anatomical appearance, especially in the artifacts in ultrasound images. There are several types of congenital heart disease that often occurs namely in septal defects it consists of the atrial septal defect, ventricular septal defect, and atrioventricular septal defect. The process of identifying the standard of the heart, especially the fetus, can be identified with a 2D ultrasound video in the initial steps to diagnose congenital heart disease. The process of diagnosis of fetal heart standards can be seen from a variety of spaces, i.e., 4 chamber views. In this study, the standard semantic segmentation process of the fetal heart is abnormal and normal in terms of the perspective of 4 chamber views. The validation evaluation results obtained in this study amounted to 99.79% pixel accuracy, mean iou 96.10%, mean accuracy 97.82%, precision 96.41% recall 95.72% and F1 score 96.02%.

[1]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[2]  Dong Ni,et al.  Quality Assessment of Fetal Head Ultrasound Images Based on Faster R-CNN , 2018, POCUS/BIVPCS/CuRIOUS/CPM@MICCAI.

[3]  Konstantinos Kamnitsas,et al.  SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound , 2016, IEEE Transactions on Medical Imaging.

[4]  Vaanathi Sundaresan,et al.  Automated characterization of the fetal heart in ultrasound images using fully convolutional neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[5]  J. Alison Noble,et al.  Image Analysis Using Machine Learning: Anatomical Landmarks Detection in Fetal Ultrasound Images , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference.

[6]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[7]  Nam Chul Kim,et al.  Surface Extraction Using SVM-Based Texture Classification for 3D Fetal Ultrasound Imaging , 2006, 2006 First International Conference on Communications and Electronics.

[8]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[9]  G. Padmavathi,et al.  Empirical Evaluation of Suitable Segmentation Algorithms for IR Images , 2010 .

[10]  Krishna Chaitanya Kaluva.  CardioNet : Identification of fetal cardiac standard planes from 2 D Ultrasound data , 2018 .

[11]  Annisa Darmawahyuni,et al.  Deep Learning-Based Stacked Denoising and Autoencoder for ECG Heartbeat Classification , 2020, Electronics.

[12]  Pallavi Vajinepalli,et al.  Segmentation of 2D fetal ultrasound images by exploiting context information using conditional random fields , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Thomas Wiatowski,et al.  A Mathematical Theory of Deep Convolutional Neural Networks for Feature Extraction , 2015, IEEE Transactions on Information Theory.

[14]  Annisa Darmawahyuni,et al.  An Automated ECG Beat Classification System Using Deep Neural Networks with an Unsupervised Feature Extraction Technique , 2019, Applied Sciences.

[15]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[16]  Ping Chen,et al.  Segmentation of Fetal Left Ventricle in Echocardiographic Sequences Based on Dynamic Convolutional Neural Networks , 2017, IEEE Transactions on Biomedical Engineering.

[17]  Xavier Bresson,et al.  Evaluation and Comparison of Current Fetal Ultrasound Image Segmentation Methods for Biometric Measurements: A Grand Challenge , 2014, IEEE Transactions on Medical Imaging.

[18]  D. Sparrow,et al.  Environmental Risk Factors for Congenital Heart Disease. , 2019, Cold Spring Harbor perspectives in biology.

[19]  J. Hoffman,et al.  The incidence of congenital heart disease. , 2002, Journal of the American College of Cardiology.

[20]  Bart Bijnens,et al.  Machine Learning in Fetal Cardiology: What to Expect , 2020, Fetal Diagnosis and Therapy.

[21]  Jian Sun,et al.  Convolutional feature masking for joint object and stuff segmentation , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Vidhi Rawat,et al.  Automated Techniques for the Interpretation of Fetal Abnormalities: A Review , 2018, Applied bionics and biomechanics.

[23]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[24]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.