On Generative Modeling of Cell Shape Using 3D GANs

The ongoing advancement of deep-learning generative models, showing great interest of the scientific community since the introduction of the generative adversarial networks (GAN), paved the way for generation of realistic data. The utilization of deep learning for the generation of realistic biomedical images allows one to alleviate the constraints of the parametric models, limited by the employed mathematical approximations. Building further upon the laid foundation, the 3D GAN added another dimension, allowing generation of fully 3D volumetric data. In this paper, we present an approach to generating fully 3D volumetric cell masks using GANs. Presented model is able to generate high-quality cell masks with variability matching the real data. Required modifications of the proposed model are presented along with the training dataset, based on 385 real cells captured using the fluorescence microscope. Furthermore, the statistical validation is also presented, allowing to quantitatively assess the quality of data generated by the proposed model.

[1]  Wei Xiong,et al.  Learning to Generate Time-Lapse Videos Using Multi-stage Dynamic Generative Adversarial Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[4]  Sebastian Nowozin,et al.  Which Training Methods for GANs do actually Converge? , 2018, ICML.

[5]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[6]  Timm Schroeder,et al.  Probing cellular processes by long-term live imaging – historic problems and current solutions , 2013, Journal of Cell Science.

[7]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[8]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[9]  David Svoboda,et al.  Visual and Quantitative Comparison of Real and Simulated Biomedical Image Data , 2018, ECCV Workshops.

[10]  Nathalie Harder,et al.  An Objective Comparison of Cell Tracking Algorithms , 2017, Nature Methods.

[11]  David Svoboda,et al.  MitoGen: A Framework for Generating 3D Synthetic Time-Lapse Sequences of Cell Populations in Fluorescence Microscopy , 2017, IEEE Transactions on Medical Imaging.

[12]  Anne E Carpenter,et al.  CytoGAN: Generative Modeling of Cell Images , 2017, bioRxiv.

[13]  Michal Kozubek,et al.  Generation of digital phantoms of cell nuclei and simulation of image formation in 3D image cytometry , 2009, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[14]  Jiajun Wu,et al.  Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling , 2016, NIPS.

[15]  Pekka Ruusuvuori,et al.  Virtual cell imaging: A review on simulation methods employed in image cytometry , 2016, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[16]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[17]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.