PlacentaNet: Automatic Morphological Characterization of Placenta Photos with Deep Learning

Analysis of the placenta is extremely useful for evaluating health risks of the mother and baby after delivery. In this paper, we tackle the problem of automatic morphological characterization of placentas, including the tasks of placenta image segmentation, umbilical cord insertion point localization, and maternal/fetal side classification. We curated an existing dataset consisting of around 1,000 placenta images taken at Northwestern Memorial Hospital, together with their pixel-level segmentation map. We propose a novel pipeline, PlacentaNet, which consists of three encoder-decoder convolutional neural networks with a shared encoder, to address these morphological characterization tasks by employing a transfer learning training strategy. We evaluated its effectiveness using the curated dataset as well as the pathology reports in the medical record. The system produced accurate morphological characterization, which enabled subsequent feature analysis of placentas. In particular, we show promising results for detection of retained placenta (i.e., incomplete placenta) and umbilical cord insertion type categorization, both of which may possess clinical impact.

[1]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[2]  Matthew J. Sottile,et al.  Unsupervised Segmentation for Inflammation Detection in Histopathology Images , 2010, ICISP.

[3]  D. Kidron,et al.  Automated image analysis of placental villi and syncytial knots in histological sections. , 2017, Placenta.

[4]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Konstantinos Kamnitsas,et al.  Fast Fully Automatic Segmentation of the Human Placenta from Motion Corrupted MRI , 2016, MICCAI.

[6]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Christian Payer,et al.  Integrating spatial configuration into heatmap regression based CNNs for landmark localization , 2019, Medical Image Anal..

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  M Yampolsky,et al.  Centrality of the umbilical cord insertion in a human placenta influences the placental efficiency. , 2009, Placenta.

[10]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[11]  K. Benirschke,et al.  Pathology of the Human Placenta , 1974, Springer New York.

[12]  Hochschule Emden Leer.  Automated image analysis , 2011 .

[13]  R. Silver.  Abnormal Placentation: Placenta Previa, Vasa Previa, and Placenta Accreta. , 2015, Obstetrics and gynecology.

[14]  Jonathan Tompson,et al.  Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation , 2014, NIPS.

[15]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[16]  D. Roberts.  Placental pathology, a survival guide. , 2009, Archives of pathology & laboratory medicine.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Neil J Sebire,et al.  Sampling and Definitions of Placental Lesions: Amsterdam Placental Workshop Group Consensus Statement. , 2016, Archives of pathology & laboratory medicine.