Prediction of Multiple 3D Tissue Structures Based on Single-Marker Images Using Convolutional Neural Networks

A quantitative understanding of complex biological systems such as tissues requires reconstructing the structure of the different components of the system. Fluorescence microscopy provides the means to visualize simultaneously several tissue components. However, it can be time consuming and is limited by the number of fluorescent markers that can be used. In this study, we describe a toolbox of algorithms based on convolutional neural networks for the prediction of 3D tissue structures by learning features embedded within single-marker images. As proof of principle, we aimed to predict the network of bile canaliculi (BC) in liver tissue using images of the cortical actin mesh as input. The actin meshwork has a characteristic organization in specific cellular domains, such as BC. However, the use of manually selected features from images of actin is not sufficient to properly reconstruct BC structure. Our deep learning framework showed a remarkable accuracy for the prediction of BC network and was successfully adapted (i.e. transfer learning) to predict the sinusoidal network. This approach allows for a complete reconstruction of tissue microarchitecture using a single fluorescent marker.

[1]  Samuel J. Yang,et al.  In Silico Labeling: Predicting Fluorescent Labels in Unlabeled Images , 2018, Cell.

[2]  Y. Kalaidzidis,et al.  A versatile pipeline for the multi-scale digital reconstruction and quantitative analysis of 3D tissue architecture , 2015, eLife.

[3]  J. Koenderink Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[4]  Shuiwang Ji,et al.  Deep Learning Segmentation of Optical Microscopy Images Improves 3-D Neuron Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[5]  Fuyong Xing,et al.  Deep Learning in Microscopy Image Analysis: A Survey. , 2018, IEEE transactions on neural networks and learning systems.

[6]  P. Gissen,et al.  Structural and functional hepatocyte polarity and liver disease , 2015, Journal of hepatology.

[7]  Mary M. Maleckar,et al.  Label-free prediction of three-dimensional fluorescence images from transmitted light microscopy , 2018 .

[8]  Emmanuel Beaurepaire,et al.  Neural Cell Segmentation in Large-Scale 3D Color Fluorescence Microscopy Images for Developemental Neuroscience , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[9]  A. Müsch,et al.  Hepatocyte polarity. , 2013, Comprehensive Physiology.

[10]  Hernan Morales-Navarrete,et al.  Automatic recognition and characterization of different non-parenchymal cells in liver tissue , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[11]  Loic A. Royer,et al.  Content-Aware Image Restoration: Pushing the Limits of Fluorescence Microscopy , 2018, bioRxiv.

[12]  Jan G. Hengstler,et al.  TiQuant: Software for tissue analysis, quantification and surface reconstruction , 2014, Bioinform..

[13]  Neena Aloysius,et al.  A review on deep convolutional neural networks , 2017, 2017 International Conference on Communication and Signal Processing (ICCSP).

[14]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[16]  Takeshi Suzuki,et al.  Recent Advances in Fluorescent Labeling Techniques for Fluorescence Microscopy , 2007, Acta histochemica et cytochemica.

[17]  S. J. Wright,et al.  Introduction to confocal microscopy. , 2002, Methods in cell biology.

[18]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.