Standard Plane Identification in Fetal Brain Ultrasound Scans Using a Differential Convolutional Neural Network

Ultrasound scanning has become a highly recommended examination in prenatal diagnosis in many countries. The accurate identification of fetal brain ultrasound scans is crucial to accurate head measurement and brain lesion detection, such as the measurement of the biparietal diameter and the detection of hydrocephalus. In recent years, deep learning has made great progress in the field of image processing. However, there are two difficulties in the identification of fetal brain ultrasound standard planes (FBSPs). First, since the fetal brain tissue is not mature, the fetal brain tissue features are not easy to be detected. Second, because of the expensive collection costs, the amount of labeled image data is limited, which can cause over-fitting and decrease the identification precision. In this study, we proposed a differential convolutional neural network (differential-CNN) to automatically identify six fetal brain standard planes (FBSPs) from the non-standard planes. In this differential-CNN framework, the additional differential feature maps were derived from the feature maps in the original CNN using differential operators. The derivation process did not increase the number of convolution layers and parameters. Moreover, the differential convolution maps have the large advantage of analyzing the directional pattern of pixels and their neighborhoods using additional variation calculations. Therefore, the differential convolution maps would result in good identification performance and cost no extra computational burden. To test the performance of these algorithms, we constructed a dataset consisting of 30,000 2D ultrasound images from 155 fetal subjects ranging from 16 to 34 weeks. The experimental results showed that this method achieved an accuracy of 92.93%. Our work shows that the differential-CNN can be used to facilitate the implementation of the automated identification of FBSPs.

[1]  Maryam Mohammadi,et al.  Development of an innovative technology to segment luminal borders of intravascular ultrasound image sequences in a fully automated manner , 2019, Comput. Biol. Medicine.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[4]  Hao Chen,et al.  Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks , 2015, IEEE Journal of Biomedical and Health Informatics.

[5]  Damjan Zazula,et al.  Computerized detection and recognition of follicles in ovarian ultrasound images: a review , 2012, Medical & Biological Engineering & Computing.

[6]  Zhen Chen,et al.  Integration of A Deep Learning Classifier with A Random Forest Approach for Predicting Malonylation Sites , 2018, Genom. Proteom. Bioinform..

[7]  Pheng-Ann Heng,et al.  Ultrasound Standard Plane Detection Using a Composite Neural Network Framework , 2017, IEEE Transactions on Cybernetics.

[8]  J. Alison Noble,et al.  Learning-based prediction of gestational age from ultrasound images of the fetal brain , 2015, Medical Image Anal..

[9]  David Dagan Feng,et al.  Plane identification in fetal ultrasound images using saliency maps and convolutional neural networks , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[10]  Xin Yang,et al.  Standard plane localization in ultrasound by radial component model and selective search. , 2014, Ultrasound in medicine & biology.

[11]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jaime S. Cardoso,et al.  A Deep Learning Design for Improving Topology Coherence in Blood Vessel Segmentation , 2019, MICCAI.

[13]  Dong Ni,et al.  FUIQA: Fetal Ultrasound Image Quality Assessment With Deep Convolutional Networks , 2017, IEEE Transactions on Cybernetics.

[14]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  Dong Ni,et al.  A Deep Convolutional Neural Network-Based Framework for Automatic Fetal Facial Standard Plane Recognition , 2018, IEEE Journal of Biomedical and Health Informatics.

[16]  Nobuo Suga,et al.  Modulation of auditory processing by cortico-cortical feed-forward and feedback projections , 2008, Proceedings of the National Academy of Sciences.

[17]  Keiji Yanai,et al.  Recognition of Multiple-Food Images by Detecting Candidate Regions , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[18]  Mayank Bansal,et al.  De-correlating CNN Features for Generative Classification , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[19]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[20]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[21]  Guowu Yang,et al.  Breast Tumor Detection in Ultrasound Images Using Deep Learning , 2017, Patch-MI@MICCAI.

[22]  Fan Yang,et al.  [Diagnostic value of power Doppler ultrasonography for Sirenomelia Seguence in prenatal]. , 2011, Sichuan da xue xue bao. Yi xue ban = Journal of Sichuan University. Medical science edition.

[23]  Yi-Hong Chou,et al.  Boundary Regularized Convolutional Neural Network for Layer Parsing of Breast Anatomy in Automated Whole Breast Ultrasound , 2017, MICCAI.

[24]  Tianfu Wang,et al.  Intelligent scanning: automated standard plane selection and biometric measurement of early gestational sac in routine ultrasound examination. , 2012, Medical physics.

[25]  Jiebo Luo,et al.  Image segmentation via adaptive K-mean clustering and knowledge-based morphological operations with biomedical applications , 1998, IEEE Trans. Image Process..

[26]  Masahiko Kobayashi,et al.  Biparietal Thinning: Accidental Death by a Fall from Standing Height , 2017, Journal of forensic sciences.

[27]  Heng-Da Cheng,et al.  Computer-aided detection and classification of microcalcifications in mammograms: a survey , 2003, Pattern Recognit..

[28]  Nilanjan Dey,et al.  A survey of the state-of-the-arts on neutrosophic sets in biomedical diagnoses , 2019, Int. J. Mach. Learn. Cybern..

[29]  Dong Ni,et al.  Automatic Recognition of Fetal Facial Standard Plane in Ultrasound Image via Fisher Vector , 2015, PloS one.

[30]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..

[31]  Bram van Ginneken,et al.  Automated Fetal Head Detection and Circumference Estimation from Free-Hand Ultrasound Sweeps Using Deep Learning in Resource-Limited Countries. , 2019, Ultrasound in medicine & biology.

[32]  Trevor Darrell,et al.  Beyond spatial pyramids: Receptive field learning for pooled image features , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Konstantinos Kamnitsas,et al.  SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound , 2016, IEEE Transactions on Medical Imaging.

[34]  Hugh G. Lewis,et al.  A generalized confusion matrix for assessing area estimates from remotely sensed data , 2001 .

[35]  Hang Li,et al.  Segmentation of breast anatomy for automated whole breast ultrasound images with boundary regularized convolutional encoder-decoder network , 2018, Neurocomputing.

[36]  Gabriel Kiss,et al.  Automatic measurement of biparietal diameter with a portable ultrasound device , 2014, 2014 IEEE International Ultrasonics Symposium.

[37]  Mohammad I. Daoud,et al.  Accurate and fully automatic segmentation of breast ultrasound images by combining image boundary and region information , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[38]  Tatiana Baidyk,et al.  Improved method of handwritten digit recognition tested on MNIST database , 2004, Image Vis. Comput..

[39]  Buse Melis Ozyildirim,et al.  Differential convolutional neural network , 2019, Neural Networks.

[40]  Zhiguo Jiang,et al.  Classification for Dermoscopy Images Using Convolutional Neural Networks Based on Region Average Pooling , 2018, IEEE Access.

[41]  飯田 直成,et al.  両児とも Holoprosencephaly を呈した一卵性双生児 , 1998 .

[42]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[43]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[44]  Stan Z. Li,et al.  Learn Convolutional Neural Network for Face Anti-Spoofing , 2014, ArXiv.

[45]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Lin Shi,et al.  A survey of GPU-based medical image computing techniques. , 2012, Quantitative imaging in medicine and surgery.

[47]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[48]  Pai-Chi Li,et al.  Liver fibrosis grade classification with B-mode ultrasound. , 2003, Ultrasound in medicine & biology.

[49]  Jun Wang,et al.  A support vector machine with a hybrid kernel and minimal Vapnik-Chervonenkis dimension , 2004, IEEE Transactions on Knowledge and Data Engineering.