SegET: Deep Neural Network with Rich Contextual Features for Cellular Structures Segmentation in Electron Tomography Image

Electron tomography (ET) allows high-resolution reconstructions of macromolecular complexes at nearnative state. Cellular structures segmentation in the reconstruction data from electron tomographic images is often required for analyzing and visualizing biological structures, making it a powerful tool for quantitative descriptions of whole cell structures and understanding biological functions. However, these cellular structures are rather difficult to automatically separate or quantify from view owing to complex molecular environment and the limitations of reconstruction data of ET. In this paper, we propose a single end-to-end deep fully-convolutional semantic segmentation network dubbed SegET with rich contextual features which fully exploitsthe multi-scale and multi-level contextual information and reduces the loss of details of cellular structures in ET images. We trained and evaluated our network on the electron tomogram of the CTL Immunological Synapse from Cell Image library. Our results demonstrate that SegET can automatically segment accurately and outperform all other baseline methods on each individual structure in our ET dataset.

[1]  Chandra Kambhamettu,et al.  Three-dimensional segmentation of vesicular networks of fungal hyphae in macroscopic microscopy image stacks , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  J. Frank Electron tomography : methods for three-dimensional visualization of structures in the cell , 2005 .

[4]  Anindya Sarkar,et al.  Structure and Context in Prostatic Gland Segmentation and Classification , 2012, MICCAI.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Ali Selman Aydin,et al.  CNN Based Yeast Cell Segmentation in Multi-modal Fluorescent Microscopy Data , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Wen Jiang,et al.  EMAN2: an extensible image processing suite for electron microscopy. , 2007, Journal of structural biology.

[8]  Mikhail Teverovskiy,et al.  Multifeature Prostate Cancer Diagnosis and Gleason Grading of Histological Images , 2007, IEEE Transactions on Medical Imaging.

[9]  Christophoros Nikou,et al.  Watershed-based segmentation of cell nuclei boundaries in Pap smear images , 2010, Proceedings of the 10th IEEE International Conference on Information Technology and Applications in Biomedicine.

[10]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[11]  Cenk Sokmensuer,et al.  Color Graphs for Automated Cancer Diagnosis and Grading , 2010, IEEE Transactions on Biomedical Engineering.

[12]  Mohammad Ilyas,et al.  A Novel Polar Space Random Field Model for the Detection of Glandular Structures , 2014, IEEE Transactions on Medical Imaging.

[13]  Anant Madabhushi,et al.  A Boosting Cascade for Automated Detection of Prostate Cancer from Digitized Histology , 2006, MICCAI.

[14]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Nasir M. Rajpoot,et al.  A Stochastic Polygons Model for Glandular Structures in Colon Histology Images , 2015, IEEE Transactions on Medical Imaging.

[17]  Nasir M. Rajpoot,et al.  A novel texture descriptor for detection of glandular structures in colon histology images , 2015, Medical Imaging.

[18]  S. Fuller,et al.  Centrosome polarization delivers secretory granules to the immunological synapse , 2006, Nature.

[19]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Cenk Sokmensuer,et al.  Automatic segmentation of colon glands using object-graphs , 2010, Medical Image Anal..

[21]  Min Xu,et al.  A convolutional autoencoder approach for mining features in cellular electron cryo-tomograms and weakly supervised coarse segmentation , 2017, Journal of structural biology.

[22]  Kai Zhang,et al.  Three-dimensional reconstruction using an adaptive simultaneous algebraic reconstruction technique in electron tomography. , 2011, Journal of Structural Biology.