Deep-Learning-Based Segmentation of Small Extracellular Vesicles in Transmission Electron Microscopy Images

Small extracellular vesicles (sEVs) are cell-derived vesicles of nanoscale size (~30–200 nm) that function as conveyors of information between cells, reflecting the cell of their origin and its physiological condition in their content. Valuable information on the shape and even on the composition of individual sEVs can be recorded using transmission electron microscopy (TEM). Unfortunately, sample preparation for TEM image acquisition is a complex procedure, which often leads to noisy images and renders automatic quantification of sEVs an extremely difficult task. We present a completely deep-learning-based pipeline for the segmentation of sEVs in TEM images. Our method applies a residual convolutional neural network to obtain fine masks and use the Radon transform for splitting clustered sEVs. Using three manually annotated datasets that cover a natural variability typical for sEV studies, we show that the proposed method outperforms two different state-of-the-art approaches in terms of detection and segmentation performance. Furthermore, the diameter and roundness of the segmented vesicles are estimated with an error of less than 10%, which supports the high potential of our method in biological applications.

[1]  S. Dwivedi,et al.  Obesity May Be Bad: Compressed Convolutional Networks for Biomedical Image Segmentation , 2020 .

[2]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[3]  J. Lötvall,et al.  Exosomes purified from a single cell type have diverse morphology , 2016, bioRxiv.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  P. Jaccard Distribution de la flore alpine dans le bassin des Dranses et dans quelques régions voisines , 1901 .

[6]  Claudia Mongini,et al.  Emerging Roles of Exosomes in Normal and Pathological Conditions: New Insights for Diagnosis and Therapeutic Applications , 2015, Front. Immunol..

[7]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[8]  Yvan Saeys,et al.  Domain Adaptive Segmentation In Volume Electron Microscopy Imaging , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[9]  Henrik J Johansson,et al.  Cells release subpopulations of exosomes with distinct molecular and biological properties , 2016, Scientific Reports.

[10]  Tao Xu,et al.  A unified deep-learning network to accurately segment insulin granules of different animal models imaged under different electron microscopy methodologies , 2018, Protein & Cell.

[11]  Jing Xu,et al.  Minimal information for studies of extracellular vesicles 2018 (MISEV2018): a position statement of the International Society for Extracellular Vesicles and update of the MISEV2014 guidelines , 2018, Journal of Extracellular Vesicles.

[12]  Filiz Bunyak,et al.  Mitochondria segmentation in electron microscopy volumes using deep convolutional neural network , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[13]  Johan Garssen,et al.  Exosomes and Exosomal miRNA in Respiratory Diseases , 2016, Mediators of inflammation.

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Pavel Matula,et al.  TEM ExosomeAnalyzer: a computer-assisted software tool for quantitative evaluation of extracellular vesicles in transmission electron microscopy images , 2019, Journal of extracellular vesicles.

[16]  Marc Niethammer,et al.  Segmentation with area constraints , 2012, Medical Image Analysis.

[17]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[18]  Andrew F. Hill,et al.  Minimal experimental requirements for definition of extracellular vesicles and their functions: a position statement from the International Society for Extracellular Vesicles , 2014, Journal of extracellular vesicles.

[19]  J. Lötvall,et al.  Distinct RNA profiles in subpopulations of extracellular vesicles: apoptotic bodies, microvesicles and exosomes , 2013, Journal of extracellular vesicles.

[20]  Willem Stoorvogel,et al.  Fluorescent labeling of nano-sized vesicles released by cells and subsequent quantitative and qualitative analysis by high-resolution flow cytometry , 2012, Nature Protocols.

[21]  Bahram Parvin,et al.  3D Segmentation of Mammospheres for Localization Studies , 2006, ISVC.

[22]  Nathalie Harder,et al.  An Objective Comparison of Cell Tracking Algorithms , 2017, Nature Methods.

[23]  Erlend Hodneland,et al.  CellSegm - a MATLAB toolbox for high-throughput 3D cell segmentation , 2013, Source Code for Biology and Medicine.

[24]  I. Sargent,et al.  Particle size distribution of exosomes and microvesicles determined by transmission electron microscopy, flow cytometry, nanoparticle tracking analysis, and resistive pulse sensing , 2014, Journal of thrombosis and haemostasis : JTH.

[25]  C. Melief,et al.  B lymphocytes secrete antigen-presenting vesicles , 1996, The Journal of experimental medicine.

[26]  Bian Wu,et al.  DeepEM3D: approaching human‐level performance on 3D anisotropic EM image segmentation , 2017, Bioinform..

[27]  Hai Su,et al.  Deep Learning in Microscopy Image Analysis: A Survey , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Andrew F. Hill,et al.  Exosomes: Vehicles for the Transfer of Toxic Proteins Associated with Neurodegenerative Diseases? , 2012, Front. Physio..

[29]  David R. Bull,et al.  A Novel Framework for Segmentation of Secretory Granules in Electron Micrographs , 2014, Medical Image Anal..

[30]  P. Robbins,et al.  Regulation of immune responses by extracellular vesicles , 2014, Nature Reviews Immunology.

[31]  Xi Chen,et al.  Deep contextual residual network for electron microscopy image segmentation in connectomics , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[32]  F. Kashanchi,et al.  Interplay between Autophagy, Exosomes and HIV-1 Associated Neurological Disorders: New Insights for Diagnosis and Therapeutic Applications , 2017, Viruses.

[33]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[34]  M. Maška,et al.  Cell Tracking Accuracy Measurement Based on Comparison of Acyclic Oriented Graphs , 2015, PloS one.

[35]  Juan V. Lorenzo-Ginori,et al.  Automated marker identification using the Radon transform for watershed segmentation , 2017, IET Image Process..

[36]  Pavel Matula,et al.  Automatic Detection and Segmentation of Exosomes in Transmission Electron Microscopy , 2016, ECCV Workshops.

[37]  Matt Trau,et al.  Analysis of exosome purification methods using a model liposome system and tunable-resistive pulse sensing , 2015, Scientific Reports.

[38]  Julio Vera,et al.  Exosomal lncRNAs and cancer: connecting the missing links , 2018, Bioinform..

[39]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Hai Su,et al.  Efficient and robust cell detection: A structured regression approach , 2018, Medical Image Anal..

[41]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[42]  Hamid Cheshmi Glioblastoma microvesicles transport RNA and proteins that promote tumour growth and provide diagnostic biomarkers , 2011 .

[43]  Thomas Brox,et al.  U-Net: deep learning for cell counting, detection, and morphometry , 2018, Nature Methods.

[44]  Alessandra Pedrocchi,et al.  Effects of ACL Reconstructive Surgery on Temporal Variations of Cytokine Levels in Synovial Fluid , 2016, Mediators of inflammation.

[45]  J R Kremer,et al.  Computer visualization of three-dimensional image data using IMOD. , 1996, Journal of structural biology.

[46]  M. Lotze,et al.  Good things come in small packages: exosomes, immunity and cancer , 2014, Cancer Gene Therapy.

[47]  Philip Kollmannsberger,et al.  FIJI Macro 3D ART VeSElecT: 3D Automated Reconstruction Tool for Vesicle Structures of Electron Tomograms , 2017, PLoS Comput. Biol..

[48]  Wiro J. Niessen,et al.  Advanced Level-Set-Based Cell Tracking in Time-Lapse Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[49]  Elaine C. Campbell,et al.  Nanoparticle tracking analysis monitors microvesicle and exosome secretion from immune cells , 2012, Immunology.

[50]  Veronica Huber,et al.  Induction of Lymphocyte Apoptosis by Tumor Cell Secretion of FasL-bearing Microvesicles , 2002, The Journal of experimental medicine.

[51]  Thomas Brox,et al.  Author Correction: U-Net: deep learning for cell counting, detection, and morphometry , 2019, Nature Methods.

[52]  Vasyl Pihur,et al.  MmPalateMiRNA, an R package compendium illustrating analysis of miRNA microarray data , 2013, Source Code for Biology and Medicine.

[53]  Yi-Zeng Liang,et al.  Monte Carlo cross validation , 2001 .

[54]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[55]  Artur Lichtenberg,et al.  An Innovative Method for Exosome Quantification and Size Measurement , 2015, Journal of visualized experiments : JoVE.

[56]  Jina Ko,et al.  Detection and isolation of circulating exosomes and microvesicles for cancer monitoring and diagnostics using micro-/nano-based devices. , 2016, The Analyst.

[57]  Pascal Fua,et al.  A domain-adaptive two-stream U-Net for electron microscopy image segmentation , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[58]  Thomas Brox,et al.  Discriminative Unsupervised Feature Learning with Convolutional Neural Networks , 2014, NIPS.