Visualization and correction of automated segmentation, tracking and lineaging from 5-D stem cell image sequences

BackgroundNeural stem cells are motile and proliferative cells that undergo mitosis, dividing to produce daughter cells and ultimately generating differentiated neurons and glia. Understanding the mechanisms controlling neural stem cell proliferation and differentiation will play a key role in the emerging fields of regenerative medicine and cancer therapeutics. Stem cell studies in vitro from 2-D image data are well established. Visualizing and analyzing large three dimensional images of intact tissue is a challenging task. It becomes more difficult as the dimensionality of the image data increases to include time and additional fluorescence channels. There is a pressing need for 5-D image analysis and visualization tools to study cellular dynamics in the intact niche and to quantify the role that environmental factors play in determining cell fate.ResultsWe present an application that integrates visualization and quantitative analysis of 5-D (x,y,z,t,channel) and large montage confocal fluorescence microscopy images. The image sequences show stem cells together with blood vessels, enabling quantification of the dynamic behaviors of stem cells in relation to their vascular niche, with applications in developmental and cancer biology. Our application automatically segments, tracks, and lineages the image sequence data and then allows the user to view and edit the results of automated algorithms in a stereoscopic 3-D window while simultaneously viewing the stem cell lineage tree in a 2-D window. Using the GPU to store and render the image sequence data enables a hybrid computational approach. An inference-based approach utilizing user-provided edits to automatically correct related mistakes executes interactively on the system CPU while the GPU handles 3-D visualization tasks.ConclusionsBy exploiting commodity computer gaming hardware, we have developed an application that can be run in the laboratory to facilitate rapid iteration through biological experiments. We combine unsupervised image analysis algorithms with an interactive visualization of the results. Our validation interface allows for each data set to be corrected to 100% accuracy, ensuring that downstream data analysis is accurate and verifiable. Our tool is the first to combine all of these aspects, leveraging the synergies obtained by utilizing validation information from stereo visualization to improve the low level image processing tasks.

[1]  Philipp J. Keller,et al.  Towards comprehensive cell lineage reconstructions in complex organisms using light‐sheet microscopy , 2013, Development, growth & differentiation.

[2]  John Isaac Murray,et al.  The lineaging of fluorescently-labeled Caenorhabditis elegans embryos with StarryNite and AceTree , 2006, Nature Protocols.

[3]  Benjamin Schmid,et al.  A high-level 3D visualization API for Java and ImageJ , 2010, BMC Bioinformatics.

[4]  Anne E Carpenter,et al.  Visualization of image data from cells to , 2010 .

[5]  Cheng Fang,et al.  Axonal transport analysis using Multitemporal Association Tracking , 2012, Int. J. Comput. Biol. Drug Des..

[6]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[7]  Anne E Carpenter,et al.  Visualization of image data from cells to organisms , 2010, Nature Methods.

[8]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[9]  Andrew R. Cohen,et al.  Vertebrate neural stem cell segmentation, tracking and lineaging with validation and editing , 2011, Nature Protocols.

[10]  Michele Ceccarelli A Finite Markov Random Field approach to fast edge-preserving image recovery , 2007, Image Vis. Comput..

[11]  Hanchuan Peng,et al.  Extensible visualization and analysis for multidimensional images using Vaa3D , 2014, Nature Protocols.

[12]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[13]  William J. Schroeder,et al.  The Visualization Toolkit , 2005, The Visualization Handbook.

[14]  Barbara Cutler,et al.  Robust Adaptive 3-D Segmentation of Vessel Laminae From Fluorescence Confocal Microscope Images and Parallel GPU Implementation , 2010, IEEE Transactions on Medical Imaging.

[15]  Andrew R. Cohen,et al.  Segmentation of occluded hematopoietic stem cells from tracking , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Charles D. Hansen,et al.  An interactive visualization tool for multi-channel confocal microscopy data in neurobiology research , 2009, IEEE Transactions on Visualization and Computer Graphics.

[17]  Zafer Aydin,et al.  Using machine learning to speed up manual image annotation: application to a 3D imaging protocol for measuring single cell gene expression in the developing C. elegans embryo , 2010, BMC Bioinformatics.

[18]  Florian Jug,et al.  Bioimage Informatics in the context of Drosophila research. , 2014, Methods.

[19]  Andrew R. Cohen,et al.  Computational prediction of neural progenitor cell fates , 2010, Nature Methods.

[20]  M. R. Costa,et al.  Using an adherent cell culture of the mouse subependymal zone to study the behavior of adult neural stem cells on a single-cell level , 2011, Nature Protocols.

[21]  B. Roysam,et al.  Adult SVZ lineage cells home to and leave the vascular niche via differential responses to SDF1/CXCR4 signaling. , 2010, Cell stem cell.

[22]  B. Roysam,et al.  Adult SVZ stem cells lie in a vascular niche: a quantitative analysis of niche cell-cell interactions. , 2008, Cell stem cell.

[23]  B. Roysam,et al.  Automated Cell Lineage Construction: A Rapid Method to Analyze Clonal Development Established with Murine Neural Progenitor Cells , 2006, Cell cycle.

[24]  Sally Temple,et al.  Automatic Summarization of Changes in Biological Image Sequences Using Algorithmic Information Theory , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  G. Harms,et al.  A new detection algorithm for image analysis of single, fluorescence‐labeled proteins in living cells , 2007, Microscopy research and technique.

[26]  J. García-Verdugo,et al.  A specialized vascular niche for adult neural stem cells. , 2008, Cell stem cell.

[27]  R. J. Clements,et al.  High resolution stereoscopic volume visualization of the mouse arginine vasopressin system , 2010, Journal of Neuroscience Methods.

[28]  Jean-Christophe Olivo-Marin,et al.  ICY: A new open-source community image processing software , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[29]  Daniel A. Lim,et al.  Subventricular Zone Astrocytes Are Neural Stem Cells in the Adult Mammalian Brain , 1999, Cell.

[30]  William E. Lorensen,et al.  The visualization toolkit (2nd ed.): an object-oriented approach to 3D graphics , 1998 .