A Multi-task Approach Using Positional Information for Ultrasound Placenta Segmentation

Automatic segmentation of the placenta in fetal ultrasound (US) is challenging due to its high variations in shape, position and appearance. Convolutional neural networks (CNN) are the state-of-the-art in medical image segmentation and have already been applied successfully to extract the placenta in US. However, the performance of CNNs depends highly on the availability of large training sets which also need to be representative for new unseen data. In this work, we propose to inform the network about the variability in the data distribution via an auxiliary task to improve performances for under representative training sets. The auxiliary task has two objectives: (i) enlarging of the training set with easily obtainable labels, and (ii) including more information about the variability of the data in the training process. In particular, we use transfer learning and multi-task learning to incorporate the placental position in a U-Net architecture. We test different models for the segmentation of anterior and posterior placentas in fetal US. Our results suggest that these placenta types represent different distributions. By including the position of the placenta as an auxiliary task, the segmentation accuracy for both anterior and posterior placentas is improved when the specific type of placenta is not included in the training set.

[1]  Paul A. Yushkevich,et al.  Combining Deep Learning and Multi-atlas Label Fusion for Automated Placenta Segmentation from 3DUS , 2018, DATRA/PIPPI@MICCAI.

[2]  Philip H. S. Torr,et al.  Learn To Pay Attention , 2018, ICLR.

[3]  J. Noble,et al.  3-D Ultrasound Segmentation of the Placenta Using the Random Walker Algorithm: Reliability and Agreement. , 2015, Ultrasound in medicine & biology.

[4]  Bishesh Khanal,et al.  Towards Whole Placenta Segmentation at Late Gestation Using Multi-view Ultrasound Images , 2019, MICCAI.

[5]  Patrick Leisching,et al.  Comb-locked frequency-swept synthesizer for high precision broadband spectroscopy , 2020, Scientific Reports.

[6]  Curtis P. Langlotz,et al.  AppendiXNet: Deep Learning for Diagnosis of Appendicitis from A Small Dataset of CT Exams Using Video Pretraining , 2020, Scientific Reports.

[7]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[8]  Jon Kleinberg,et al.  Transfusion: Understanding Transfer Learning for Medical Imaging , 2019, NeurIPS.

[9]  Walter Plasencia,et al.  Fully automated, real-time 3D ultrasound segmentation to estimate first trimester placental volume using deep learning. , 2018, JCI insight.

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Ipek Oguz,et al.  Minimally interactive placenta segmentation from three-dimensional ultrasound images , 2020, Journal of medical imaging.

[12]  Xin Yang,et al.  Towards Automated Semantic Segmentation in Prenatal Volumetric Ultrasound , 2019, IEEE Transactions on Medical Imaging.

[13]  Daniel Rueckert,et al.  Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Prediction , 2019, MICCAI.