Automated Segmentation of Epithelial Tissue Using Cycle-Consistent Generative Adversarial Networks

A central problem in biomedical imaging is the automated segmentation of images for further quantitative analysis. Recently, fully convolutional neural networks, such as the U-Net, were applied successfully in a variety of segmentation tasks. A downside of this approach is the requirement for a large amount of well-prepared training samples, consisting of image - ground truth mask pairs. Since training data must be created by hand for each experiment, this task can be very costly and time-consuming. Here, we present a segmentation method based on cycle consistent generative adversarial networks, which can be trained even in absence of prepared image - mask pairs. We show that it successfully performs image segmentation tasks on samples with substantial defects and even generalizes well to different tissue types.

[1]  L. Solnica-Krezel,et al.  Gon4l regulates notochord boundary formation and cell polarity underlying axis extension by repressing adhesion genes , 2018, Nature Communications.

[2]  Jiajun Wu,et al.  Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling , 2016, NIPS.

[3]  Bernt Schiele,et al.  Generative Adversarial Text to Image Synthesis , 2016, ICML.

[4]  Julien Colombelli,et al.  Pulsed Forces Timed by a Ratchet-like Mechanism Drive Directed Tissue Movement during Dorsal Closure , 2009, Cell.

[5]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[6]  Nathalie Harder,et al.  An Objective Comparison of Cell Tracking Algorithms , 2017, Nature Methods.

[7]  Peijun Du,et al.  A review of supervised object-based land-cover image classification , 2017 .

[8]  Daguang Xu,et al.  Automatic Liver Segmentation Using an Adversarial Image-to-Image Network , 2017, MICCAI.

[9]  Lei Ma,et al.  Training set size, scale, and features in Geographic Object-Based Image Analysis of very high resolution unmanned aerial vehicle imagery , 2015 .

[10]  Yoshua Bengio,et al.  Generative Adversarial Networks , 2014, ArXiv.

[11]  S. Eaton,et al.  Segmentation and Quantitative Analysis of Epithelial Tissues. , 2016, Methods in molecular biology.

[12]  Karen G. Hales,et al.  Genetics on the Fly: A Primer on the Drosophila Model System , 2015, Genetics.

[13]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  F. Wolf,et al.  Forces directing germ-band extension in Drosophila embryos , 2017, Mechanisms of Development.

[16]  Tao Xu,et al.  SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation , 2017, Neuroinformatics.

[17]  Antonio Torralba,et al.  Generating Videos with Scene Dynamics , 2016, NIPS.

[18]  A. Jayasinghe,et al.  Apical oscillations in amnioserosa cells: basolateral coupling and mechanical autonomy. , 2013, Biophysical journal.

[19]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Adam C. Sokolow,et al.  Cell ingression and apical shape oscillations during dorsal closure in Drosophila. , 2012, Biophysical journal.

[23]  M. Kelley,et al.  Cell migration, intercalation and growth regulate mammalian cochlear extension , 2017, Development.

[24]  Ulas Bagci,et al.  Multi-Planar Deep Segmentation Networks for Cardiac Substructures from MRI and CT , 2017, STACOM@MICCAI.

[25]  Frank Jülicher,et al.  Cell Flow Reorients the Axis of Planar Polarity in the Wing Epithelium of Drosophila , 2010, Cell.

[26]  N. Greene,et al.  Vangl2 disruption alters the biomechanics of late spinal neurulation leading to spina bifida in mouse embryos , 2018, Disease Models & Mechanisms.

[27]  Ian J. Goodfellow,et al.  NIPS 2016 Tutorial: Generative Adversarial Networks , 2016, ArXiv.