NesSys: a novel method for accurate nuclear segmentation in 3D

Methods for measuring the properties of individual cells within their native 3D environment will enable a deeper understanding of embryonic development, tissue regeneration, and tumorigenesis. However current methods for segmenting nuclei in 3D tissues are not designed for situations where nuclei are densely packed, non-spherical, heterogeneous in shape, size, or texture, all of which are true of many embryonic and adult tissue types as well as in many cases for cells differentiating in culture. Here we overcome this bottleneck by devising a novel method based on labelling the nuclear envelope (NE) and automatically distinguishing individual nuclei using a tree structured ridge tracing method followed by shape ranking according to a trained classifier. The method is fast and makes it possible to process images that are larger than the computer’s memory. We consistently obtain accurate segmentation rates of >90% even for challenging images such as mid-gestation embryos or 3D cultures. We provide a 3D editor and inspector for the manual curation of the segmentation results as well as a program to assess the accuracy of the segmentation. We have also generated a live reporter of the NE that can be used to track live cells in three dimensions over time. We use this to monitor the history of cell interactions and occurrences of neighbour exchange within cultures of pluripotent cells during differentiation. We provide these tools in an open-access user-friendly format.

[1]  William D. Richardson,et al.  A short amino acid sequence able to specify nuclear location , 1984, Cell.

[2]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[3]  Mark R. Winter,et al.  Computational Image Analysis Reveals Intrinsic Multigenerational Differences between Anterior and Posterior Cerebral Cortex Neural Progenitor Cells , 2015, Stem Cell Reports.

[4]  Peter Horvath,et al.  Environmental properties of cells improve machine learning-based phenotype recognition accuracy , 2018, Scientific Reports.

[5]  P. Koumoutsakos,et al.  MorphoGraphX: A platform for quantifying morphogenesis in 4D , 2015, eLife.

[6]  Anselm F. L. Schneider,et al.  Nanobodies: Chemical Functionalization Strategies and Intracellular Applications , 2018, Angewandte Chemie.

[7]  Pavel Tomancak,et al.  Current challenges in open-source bioimage informatics , 2012, Nature Methods.

[8]  Nathalie Harder,et al.  A benchmark for comparison of cell tracking algorithms , 2014, Bioinform..

[9]  David Svoboda,et al.  MitoGen: A Framework for Generating 3D Synthetic Time-Lapse Sequences of Cell Populations in Fluorescence Microscopy , 2017, IEEE Transactions on Medical Imaging.

[10]  Philipp J. Keller,et al.  Real-Time Three-Dimensional Cell Segmentation in Large-Scale Microscopy Data of Developing Embryos. , 2016, Developmental cell.

[11]  R. Foisner,et al.  Lamins: nuclear intermediate filament proteins with fundamental functions in nuclear mechanics and genome regulation. , 2015, Annual review of biochemistry.

[12]  Kristin L. Hazelwood,et al.  Far-red fluorescent tags for protein imaging in living tissues. , 2009, The Biochemical journal.

[13]  Jordi Garcia-Ojalvo,et al.  A competitive protein interaction network buffers Oct4-mediated differentiation to promote pluripotency in embryonic stem cells , 2013, Molecular systems biology.

[14]  Jens Rittscher,et al.  Analysis of live cell images: Methods, tools and opportunities. , 2017, Methods.

[15]  C. Rueden,et al.  Metadata matters: access to image data in the real world , 2010, The Journal of cell biology.

[16]  Kaoru Sugimura,et al.  Unified quantitative characterization of epithelial tissue development , 2015, eLife.

[17]  Loic A. Royer,et al.  Content-aware image restoration: pushing the limits of fluorescence microscopy , 2018, Nature Methods.

[18]  Andrey Kan,et al.  Machine learning applications in cell image analysis , 2017, Immunology and cell biology.

[19]  J. Couchman,et al.  The CMV early enhancer/chicken β actin (CAG) promoter can be used to drive transgene expression during the differentiation of murine embryonic stem cells into vascular progenitors , 2008, BMC Cell Biology.

[20]  E. Meijering.  Cell Segmentation : 50 Years Down the Road , 2012 .

[21]  G. Blin,et al.  Distinct Wnt-driven primitive streak-like populations reflect in vivo lineage precursors , 2014, Development.

[22]  Carsten Marr,et al.  Software tools for single-cell tracking and quantification of cellular and molecular properties , 2016, Nature Biotechnology.

[23]  Allon M. Klein,et al.  Epidermal stem cells self-renew upon neighboring differentiation , 2017, bioRxiv.

[24]  R. Malladi,et al.  Segmentation of nuclei and cells using membrane related protein markers , 2001, Journal of microscopy.

[25]  Alexander Schmitz,et al.  Multiscale image analysis reveals structural heterogeneity of the cell microenvironment in homotypic spheroids , 2017, Scientific Reports.

[26]  Kevin W. Eliceiri,et al.  SCIFIO: an extensible framework to support scientific image formats , 2016, BMC Bioinformatics.

[27]  Nathalie Harder,et al.  An Objective Comparison of Cell Tracking Algorithms , 2017, Nature Methods.

[28]  H. Ohta,et al.  Reconstitution of the Mouse Germ Cell Specification Pathway in Culture by Pluripotent Stem Cells , 2011, Cell.

[29]  Erik Meijering,et al.  Imagining the future of bioimage analysis , 2016, Nature Biotechnology.

[30]  Ian A. Swinburne,et al.  Interplay of Cell Shape and Division Orientation Promotes Robust Morphogenesis of Developing Epithelia , 2014, Cell.

[31]  Philipp J. Keller,et al.  Imaging Morphogenesis: Technological Advances and Biological Insights , 2013, Science.

[32]  O. Troyanskaya,et al.  Geometrical confinement controls the asymmetric patterning of brachyury in cultures of pluripotent cells , 2018, Development.

[33]  P. Bourgine,et al.  A workflow to process 3D+time microscopy images of developing organisms and reconstruct their cell lineage , 2016, Nature Communications.

[34]  Zoltan Kato,et al.  Accurate Morphology Preserving Segmentation of Overlapping Cells based on Active Contours , 2016, Scientific Reports.

[35]  Johannes E. Schindelin,et al.  The ImageJ ecosystem: An open platform for biomedical image analysis , 2015, Molecular reproduction and development.

[36]  Andrew R. Cohen,et al.  Computational prediction of neural progenitor cell fates , 2010, Nature Methods.

[37]  Jens Rittscher,et al.  Towards quantifying the impact of cell boundary estimation on morphometric analysis for phenotypic screening , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[38]  G. Blin,et al.  Bone morphogenic protein signalling suppresses differentiation of pluripotent cells by maintaining expression of E-Cadherin , 2013, eLife.

[39]  Jason P. Wray,et al.  Inhibition of glycogen synthase kinase-3 alleviates Tcf 3 repression of the pluripotency network and increases embryonic stem cell resistance to differentiation , 2011 .

[40]  Austin G Smith,et al.  Conversion of embryonic stem cells into neuroectodermal precursors in adherent monoculture , 2003, Nature Biotechnology.

[41]  Rafael Yuste,et al.  Fluorescence microscopy today , 2005, Nature Methods.

[42]  Allan Bradley,et al.  Requirement of the paraxis gene for somite formation and musculoskeletal patterning , 1996, Nature.

[43]  A. Schierloh,et al.  Ultramicroscopy: three-dimensional visualization of neuronal networks in the whole mouse brain , 2007, Nature Methods.

[44]  L. Ramakrishnan,et al.  Evaluation of the pathogenesis and treatment of Mycobacterium marinum infection in zebrafish , 2013, Nature Protocols.

[45]  Ravi A. Desai,et al.  Cell-cell contact area affects Notch signaling and Notch-dependent patterning , 2017, Developmental cell.

[46]  Pedro M. Domingos.  A few useful things to know about machine learning , 2012, Commun. ACM.

[47]  Lassi Paavolainen,et al.  Data-analysis strategies for image-based cell profiling , 2017, Nature Methods.

[48]  Michael T. Veeman,et al.  Quantitative and in toto imaging in ascidians: Working toward an image‐centric systems biology of chordate morphogenesis , 2015, Genesis.

[49]  Sarah Machado,et al.  LimeSeg: A coarsed-grained lipid membrane simulation for 3D image segmentation , 2018 .

[50]  T. Kanda,et al.  Histone–GFP fusion protein enables sensitive analysis of chromosome dynamics in living mammalian cells , 1998, Current Biology.

[51]  Nicolas Chenouard,et al.  Icy: an open bioimage informatics platform for extended reproducible research , 2012, Nature Methods.

[52]  K. Wilson,et al.  Multiple and surprising new functions for emerin, a nuclear membrane protein. , 2004, Current opinion in cell biology.

[53]  G. Blin,et al.  Position-dependent plasticity of distinct progenitor types in the primitive streak , 2016, eLife.

[54]  Minjung Kang,et al.  Stem Cell Reports , Volume 2 Supplemental Information A Rapid and Efficient 2 D / 3 D Nuclear Segmentation Method for Analysis of Early Mouse Embryo and Stem Cell Image Data , 2014 .

[55]  Satwik Rajaram,et al.  SimuCell: a flexible framework for creating synthetic microscopy images , 2012, Nature Methods.

[56]  Qian Liu,et al.  Citation for Published Item: Use Policy Coupling of the Nucleus and Cytoplasm: Role of the Linc Complex , 2022 .

[57]  Felipe Ortega,et al.  Continuous live imaging of adult neural stem cell division and lineage progression in vitro , 2011, Development.

[58]  D. Schmitter,et al.  Predicting stem cell fate changes by differential cell cycle progression patterns , 2013, Development.

[59]  Frank Jülicher,et al.  TissueMiner: A multiscale analysis toolkit to quantify how cellular processes create tissue dynamics , 2016, eLife.

[60]  R. Dobarzić,et al.  [Fluorescence microscopy]. , 1975, Plucne bolesti i tuberkuloza.

[61]  Austin G Smith,et al.  A genome-wide screen in EpiSCs identifies Nr5a nuclear receptors as potent inducers of ground state pluripotency , 2010, Development.

[62]  Tom Misteli,et al.  The lamin protein family , 2011, Genome Biology.

[63]  Guillaume Blin,et al.  Hes1 Desynchronizes Differentiation of Pluripotent Cells by Modulating STAT3 Activity , 2013, Stem cells.

[64]  Erik H. W. Meijering,et al.  Cell Segmentation: 50 Years Down the Road [Life Sciences] , 2012, IEEE Signal Processing Magazine.

[65]  Anne E Carpenter,et al.  A call for bioimaging software usability , 2012, Nature Methods.

[66]  Alexa Kiss,et al.  CellTracker (not only) for dummies , 2016, Bioinform..

[67]  Léo Guignard,et al.  Multi-view light-sheet imaging and tracking with the MaMuT software reveals the cell lineage of a direct developing arthropod limb , 2018, eLife.

[68]  J. Olivo-Marin,et al.  Deciphering tissue morphodynamics using bioimage informatics , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[69]  Mathews Jacob,et al.  Design of steerable filters for feature detection using canny-like criteria , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Srinivas C. Turaga,et al.  In Toto Imaging and Reconstruction of Post-Implantation Mouse Development at the Single-Cell Level , 2018, Cell.

[71]  Thomas Wittenberg,et al.  Using simulated fluorescence cell micrographs for the evaluation of cell image segmentation algorithms , 2017, BMC Bioinformatics.

[72]  Robert F. Murphy,et al.  Nuclear segmentation in microscope cell images: A hand-segmented dataset and comparison of algorithms , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[73]  Tobias Pietzsch,et al.  ImgLib2 - generic image processing in Java , 2012, Bioinform..

[74]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[75]  Guillaume Blin,et al.  Tcf15 Primes Pluripotent Cells for Differentiation , 2013, Cell reports.

[76]  Philipp J. Keller,et al.  Fast, accurate reconstruction of cell lineages from large-scale fluorescence microscopy data , 2014, Nature Methods.

[77]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[78]  Alan R. Lowe,et al.  Local cellular neighborhood controls proliferation in cell competition , 2017, Molecular biology of the cell.

[79]  Dennis E. Discher,et al.  Nuclear Lamin-A Scales with Tissue Stiffness and Enhances Matrix-Directed Differentiation , 2013, Science.