Fetal Skull Reconstruction via Deep Convolutional Autoencoders

Ultrasound (US) imaging is arguably the most commonly used modality for fetal screening. Recently, 3DUS has been progressively adopted in modern obstetric practice, showing promising diagnosis capabilities, and alleviating many of the inherent limitations of traditional 2DUS, such as subjectivity and operator dependence. However, the involuntary movements of the fetus, and the difficulty for the operator to inspect the entire volume in real-time can hinder the acquisition of the entire region of interest. In this paper, we present two deep convolutional architectures for the reconstruction of the fetal skull in partially occluded 3DUS volumes: a TL deep convolutional network (TL-Net), and a conditional variational autoencoder (CVAE). The performance of the two networks was evaluated for occlusion rates up to 50%, both showing accurate results even when only 60% of the skull is included in the US volume (Dice coeff. $0.84\pm 0.04$ for CVAE and $0.83\pm 0.03$ for TL-Net). The reconstruction networks proposed here have the potential to optimize image acquisition protocols in obstetric sonography, reducing the acquisition time and providing comprehensive anatomical information even from partially occluded images.

[1]  Abhinav Gupta,et al.  Learning a Predictable and Generative Vector Representation for Objects , 2016, ECCV.

[2]  K Y Leung,et al.  Fetal biometry by an inexperienced operator using two‐ and three‐dimensional ultrasound , 2010, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[3]  J. Wladimiroff,et al.  The role of three‐dimensional ultrasound in visualizing the fetal cranial sutures and fontanels during the second half of pregnancy , 2004, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[4]  Honglak Lee,et al.  Learning Structured Output Representation using Deep Conditional Generative Models , 2015, NIPS.

[5]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Daniel Rueckert,et al.  Fetal Skull Segmentation in 3D Ultrasound via Structured Geodesic Random Forest , 2017, FIFI/OMIA@MICCAI.

[8]  Konstantinos Kamnitsas,et al.  SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound , 2016, IEEE Transactions on Medical Imaging.

[9]  Thomas D Shipp,et al.  Three-dimensional US of the fetus: volume imaging. , 2006, Radiology.

[10]  Xu Wang,et al.  Towards Automatic Semantic Segmentation in Volumetric Ultrasound , 2017, MICCAI.