CytoCensus: mapping cell identity and division in tissues and organs using machine learning

A major challenge in cell and developmental biology is the automated identification and quantitation of cells in complex multilayered tissues. We developed CytoCensus: an easily deployed implementation of supervised machine learning that extends convenient 2D “point- and-click” user training to 3D detection of cells in challenging datasets with ill-defined cell boundaries. In tests on these datasets, CytoCensus outperforms other freely available image analysis software in accuracy and speed of cell detection. We used CytoCensus to count stem cells and their progeny, and to quantify individual cell divisions from time-lapse movies of explanted Drosophila larval brains, comparing wild-type and mutant phenotypes. We further illustrate the general utility and future potential of CytoCensus by analysing the 3D organisation of multiple cell classes in Zebrafish retinal organoids and cell distributions in mouse embryos. CytoCensus opens the possibility of straightforward and robust automated analysis of developmental phenotypes in complex tissues. Summary Hailstone et al. develop CytoCensus, a “point-and-click” supervised machine-learning image analysis software to quantitatively identify defined cell classes and divisions from large multidimensional data sets of complex tissues. They demonstrate its utility in analysing challenging developmental phenotypes in living explanted Drosophila larval brains, mammalian embryos and zebrafish organoids. They further show, in comparative tests, a significant improvement in performance over existing easy-to-use image analysis software. Highlights CytoCensus: machine learning quantitation of cell types in complex 3D tissues Single cell analysis of division rates from movies of living Drosophila brains in 3D Diverse applications in the analysis of developing vertebrate tissues and organoids Outperforms other image analysis software on challenging, low SNR datasets tested

[1]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[2]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[3]  J. Knoblich,et al.  Drosophila neuroblasts: a model for stem cell biology , 2012, Development.

[4]  Lawrence Carin,et al.  An Active Learning Approach for Rapid Characterization of Endothelial Cells in Human Tumors , 2014, PloS one.

[5]  Chris Q Doe,et al.  Live imaging of neuroblast lineages within intact larval brains in Drosophila. , 2013, Cold Spring Harbor protocols.

[6]  Aljoscha Nern,et al.  Stem Cell-Intrinsic, Seven-up-Triggered Temporal Factor Gradients Diversify Intermediate Neural Progenitors , 2017, Current Biology.

[7]  Jelena Telenius,et al.  Functional characterisation of cis-regulatory elements governing dynamic Eomes expression in the early mouse embryo , 2017, Development.

[8]  Andrew P. French,et al.  SuRVoS: Super-Region Volume Segmentation workbench , 2017, Journal of structural biology.

[9]  Frank Hirth,et al.  The brain tumor gene negatively regulates neural progenitor cell proliferation in the larval central brain of Drosophila , 2006, Development.

[10]  J. Rittscher Characterization of biological processes through automated image analysis. , 2010, Annual review of biomedical engineering.

[11]  Philipp J. Keller,et al.  Real-Time Three-Dimensional Cell Segmentation in Large-Scale Microscopy Data of Developing Embryos. , 2016, Developmental cell.

[12]  Johannes Schindelin,et al.  TrackMate: An open and extensible platform for single-particle tracking. , 2017, Methods.

[13]  H. Richardson,et al.  An in vivo large-scale chemical screening platform using Drosophila for anti-cancer drug discovery , 2012, Disease Models & Mechanisms.

[14]  Jack R Glaser,et al.  Current automated 3D cell detection methods are not a suitable replacement for manual stereologic cell counting , 2014, Front. Neuroanat..

[15]  Ellie Graeden,et al.  Live Imaging of the Zebrafish Embryonic Brain by Confocal Microscopy , 2009, Journal of visualized experiments : JoVE.

[16]  Erik Meijering,et al.  Methods for cell and particle tracking. , 2012, Methods in enzymology.

[17]  Mark M. Davis,et al.  The zinc finger transcriptional repressor Blimp1/Prdm1 is dispensable for early axis formation but is required for specification of primordial germ cells in the mouse , 2005, Development.

[18]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[19]  C. Rieder,et al.  Mitosis in primary cultures of Drosophila melanogaster larval neuroblasts. , 2002, Journal of cell science.

[20]  J. Cerón,et al.  A primary cell culture of Drosophila postembryonic larval neuroblasts to study cell cycle and asymmetric division. , 2006, European journal of cell biology.

[21]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[22]  Juergen A. Knoblich,et al.  Long-Term Live Cell Imaging and Automated 4D Analysis of Drosophila Neuroblast Lineages , 2013, PloS one.

[23]  Gene Myers,et al.  Why bioimage informatics matters , 2012, Nature Methods.

[24]  Erik H. W. Meijering,et al.  Cell Segmentation: 50 Years Down the Road [Life Sciences] , 2012, IEEE Signal Processing Magazine.

[25]  Ilan Davis,et al.  Syncrip/hnRNP Q influences synaptic transmission and regulates BMP signaling at the Drosophila neuromuscular synapse , 2014, Biology Open.

[26]  Thomas R. Burkard,et al.  Ecdysone and Mediator Change Energy Metabolism to Terminate Proliferation in Drosophila Neural Stem Cells , 2014, Cell.

[27]  Christian Eggeling,et al.  3-D Density Kernel Estimation for Counting in Microscopy Image Volumes Using 3-D Image Filters and Random Decision Trees , 2016, ECCV Workshops.

[28]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[29]  Ranjini Prithviraj,et al.  Ex vivo culturing of whole, developing Drosophila brains. , 2012, Journal of visualized experiments : JoVE.

[30]  A. Mahowald,et al.  Cell division cycle of cultured neural precursor cells from Drosophila. , 1985, Developmental biology.

[31]  Christoph Sommer,et al.  Machine learning in cell biology – teaching computers to recognize phenotypes , 2013, Journal of Cell Science.

[32]  Ilan Davis,et al.  Drosophila Syncrip modulates the expression of mRNAs encoding key synaptic proteins required for morphology at the neuromuscular junction , 2014, RNA.

[33]  William A. Harris,et al.  Spectrum of Fates: a new approach to the study of the developing zebrafish retina , 2014, Development.

[34]  Omer Ali Bayraktar,et al.  Drosophila type II neuroblast lineages keep Prospero levels low to generate large clones that contribute to the adult brain central complex , 2010, Neural Development.

[35]  Anne E Carpenter,et al.  Quantifying co-cultured cell phenotypes in high-throughput using pixel-based classification. , 2015, Methods.

[36]  Elizabeth J. Robertson,et al.  Making a commitment: cell lineage allocation and axis patterning in the early mouse embryo , 2009, Nature Reviews Molecular Cell Biology.

[37]  Juergen A. Knoblich,et al.  Genome-Wide Analysis of Self-Renewal in Drosophila Neural Stem Cells by Transgenic RNAi , 2011, Cell stem cell.

[38]  Ying Chen,et al.  The FARSIGHT Project: Associative 4D/5D Image Analysis Methods for Quantifying Complex and Dynamic Biological Microenvironments , 2008, Microscopy and Microanalysis.

[39]  E. Meijering Cell Segmentation : 50 Years Down the Road , 2012 .

[40]  S. Bowman,et al.  The tumor suppressors Brat and Numb regulate transit-amplifying neuroblast lineages in Drosophila. , 2008, Developmental cell.

[41]  Florence Besse,et al.  Live imaging of axonal transport in Drosophila pupal brain explants , 2015, Nature Protocols.

[42]  Mitinori Saitou,et al.  A comprehensive, non-invasive visualization of primordial germ cell development in mice by the Prdm1-mVenus and Dppa3-ECFP double transgenic reporter. , 2008, Reproduction.

[43]  Jens C. Otte,et al.  Fast Segmentation of Stained Nuclei in Terabyte-Scale, Time Resolved 3D Microscopy Image Stacks , 2014, PloS one.

[44]  P. Walker The Mitotic Index and Interphase Processes , 1954 .

[45]  Yongxiang Gao,et al.  Accurate detection and complete tracking of large populations of features in three dimensions. , 2009, Optics express.

[46]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[47]  Simon G Sprecher,et al.  Analysis of cell identity, morphology, apoptosis and mitotic activity in a primary neural cell culture system in Drosophila , 2011, Neural Development.

[48]  Michal Kozubek,et al.  Generation of digital phantoms of cell nuclei and simulation of image formation in 3D image cytometry , 2009, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[49]  C. Rueden,et al.  Metadata matters: access to image data in the real world , 2010, The Journal of cell biology.

[50]  Vincent Lepetit,et al.  You Should Use Regression to Detect Cells , 2015, MICCAI.

[51]  Gaudenz Danuser,et al.  In vivo cell cycle profiling in xenograft tumors by quantitative intravital microscopy , 2015, Nature Methods.

[52]  C. Doe,et al.  Steroid hormone induction of temporal gene expression in Drosophila brain neuroblasts generates neuronal and glial diversity , 2017, bioRxiv.

[53]  Arkadiusz Gertych,et al.  Rapid 3-D delineation of cell nuclei for high-content screening platforms , 2016, Comput. Biol. Medicine.

[54]  William A. Harris,et al.  Self-organising aggregates of zebrafish retinal cells for investigating mechanisms of neural lamination , 2017, Development.

[55]  J. Grabarek,et al.  Cell fate in animal and human blastocysts and the determination of viability. , 2016, Molecular human reproduction.

[56]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[57]  O. Schuldiner,et al.  Long term ex vivo culturing of Drosophila brain as a method to live image pupal brains: insights into the cellular mechanisms of neuronal remodeling , 2015, Front. Cell. Neurosci..

[58]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.