A Survey of Visualization for Live Cell Imaging

Live cell imaging is an important biomedical research paradigm for studying dynamic cellular behaviour. Although phenotypic data derived from images are difficult to explore and analyse, some researchers have successfully addressed this with visualization. Nonetheless, visualization methods for live cell imaging data have been reported in an ad hoc and fragmented fashion. This leads to a knowledge gap where it is difficult for biologists and visualization developers to evaluate the advantages and disadvantages of different visualization methods, and for visualization researchers to gain an overview of existing work to identify research priorities. To address this gap, we survey existing visualization methods for live cell imaging from a visualization research perspective for the first time. Based on recent visualization theory, we perform a structured qualitative analysis of visualization methods that includes characterizing the domain and data, abstracting tasks, and describing visual encoding and interaction design. Based on our survey, we identify and discuss research gaps that future work should address: the broad analytical context of live cell imaging; the importance of behavioural comparisons; links with dynamic data visualization; the consequences of different data modalities; shortcomings in interactive support; and, in addition to analysis, the value of the presentation of phenotypic data and insights to other stakeholders.

[1]  Polina Golland,et al.  CellProfiler Analyst: data exploration and analysis software for complex image-based screens , 2008, BMC Bioinformatics.

[2]  Dorit Merhof,et al.  HiTSEE: A visualization tool for hit selection and analysis in high-throughput screening experiments , 2011, 2011 IEEE Symposium on Biological Data Visualization (BioVis)..

[3]  M. Schuldiner,et al.  A novel single-cell screening platform reveals proteome plasticity during yeast stress responses , 2013, The Journal of cell biology.

[4]  Nico Scherf,et al.  Imaging, quantification and visualization of spatio-temporal patterning in mESC colonies under different culture conditions , 2012, Bioinform..

[5]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[6]  I K Fodor,et al.  A Survey of Dimension Reduction Techniques , 2002 .

[7]  Anne E Carpenter.  Image-based chemical screening. , 2007, Nature chemical biology.

[8]  Colin Ware.  Designing with a 2 1/2-D Attitude , 2001 .

[9]  Joachim Wittbrodt,et al.  Similarity analysis of cell movements in video microscopy , 2012, 2012 IEEE Symposium on Biological Data Visualization (BioVis).

[10]  Andrew R. Cohen,et al.  Vertebrate neural stem cell segmentation, tracking and lineaging with validation and editing , 2011, Nature Protocols.

[11]  Michael G. Madden,et al.  Revealing the Origin and Nature of Drug Resistance of Dynamic Tumour Systems , 2010, Int. J. Knowl. Discov. Bioinform..

[12]  Paolo Ubezio,et al.  Interoperability of time series cytometric data: A cross platform approach for modeling tumor heterogeneity , 2011, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[13]  Roland Eils,et al.  Visualizing telomere dynamics in living mammalian cells using PNA probes , 2003, The EMBO journal.

[14]  Georgeta Crivat,et al.  Imaging proteins inside cells with fluorescent tags. , 2012, Trends in biotechnology.

[15]  Ellen C. Jensen*,et al.  Overview of Live‐Cell Imaging: Requirements and Methods Used , 2013, Anatomical record.

[16]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[17]  Gilles Charvin,et al.  Two routes to senescence revealed by real-time analysis of telomerase-negative single lineages , 2015, Nature Communications.

[18]  W Tvaruskó,et al.  Time-resolved analysis and visualization of dynamic processes in living cells. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Kwan-Liu Ma,et al.  Scientific Storytelling Using Visualization , 2012, IEEE Computer Graphics and Applications.

[20]  John T. Stasko,et al.  Knowledge precepts for design and evaluation of information visualizations , 2005, IEEE Transactions on Visualization and Computer Graphics.

[21]  S. Kung,et al.  Visualizing and quantifying the differential cleavages of the eukaryotic translation initiation factors eIF4GI and eIF4GII in the enterovirus‐infected cell , 2009, Biotechnology and bioengineering.

[22]  Gennady L. Andrienko,et al.  Visual analytics of movement: An overview of methods, tools and procedures , 2013, Inf. Vis..

[23]  Dorit Merhof,et al.  HiTSEE KNIME: a visualization tool for hit selection and analysis in high-throughput screening experiments for the KNIME platform , 2012, BMC Bioinformatics.

[24]  R. Wollman,et al.  High throughput microscopy: from raw images to discoveries , 2007, Journal of Cell Science.

[25]  Rachel J. Errington,et al.  Cell lineage visualisation , 2015, Comput. Graph. Forum.

[26]  Bongshin Lee,et al.  Revealing Uncertainty for Information Visualization , 2010, Inf. Vis..

[27]  Jan Ellenberg,et al.  Automatic identification and clustering of chromosome phenotypes in a genome wide RNAi screen by time-lapse imaging. , 2010, Journal of structural biology.

[28]  Tamara Munzner,et al.  A Multi-Level Typology of Abstract Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[29]  Ben Shneiderman,et al.  Interactive Dynamics for Visual Analysis , 2012 .

[30]  K. Jaqaman,et al.  Robust single particle tracking in live cell time-lapse sequences , 2008, Nature Methods.

[31]  Christopher P Austin,et al.  High-throughput screening assays for the identification of chemical probes. , 2007, Nature chemical biology.

[32]  Anne E Carpenter,et al.  Visualization of image data from cells to organisms , 2010, Nature Methods.

[33]  M. Sheelagh T. Carpendale,et al.  A Review of Temporal Data Visualizations Based on Space-Time Cube Operations , 2014, EuroVis.

[34]  Jeffrey S. Buguliskis,et al.  Actin‐like protein 1 (ALP1) is a component of dynamic, high molecular weight complexes in Toxoplasma gondii , 2009, Cytoskeleton.

[35]  E. Meijering,et al.  Tracking in molecular bioimaging , 2006, IEEE Signal Processing Magazine.

[36]  Jock D. Mackinlay,et al.  Storytelling: The Next Step for Visualization , 2013, Computer.

[37]  Heidrun Schumann,et al.  Visualizing time-oriented data - A systematic view , 2007, Comput. Graph..

[38]  Yue Wang,et al.  Visualization and correction of automated segmentation, tracking and lineaging from 5-D stem cell image sequences , 2014, BMC Bioinformatics.

[39]  D Hasenclever,et al.  A novel view on stem cell development: analysing the shape of cellular genealogies , 2009, Cell proliferation.

[40]  Miriah Meyer,et al.  Designing Visualizations For Biological Data , 2013, Leonardo.

[41]  R. Durbin,et al.  Phenotypic profiling of the human genome by time-lapse microscopy reveals cell division genes , 2010, Nature.

[42]  Tamara Munzner,et al.  A Nested Model for Visualization Design and Validation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[43]  Alfred Inselberg,et al.  The plane with parallel coordinates , 1985, The Visual Computer.

[44]  Robert E. Roth,et al.  An Empirically-Derived Taxonomy of Interaction Primitives for Interactive Cartography and Geovisualization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[45]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[46]  Yogesh L. Simmhan,et al.  A survey of data provenance in e-science , 2005, SGMD.

[47]  Jonathan Bard,et al.  Ontologies: Formalising biological knowledge for bioinformatics. , 2003, BioEssays : news and reviews in molecular, cellular and developmental biology.

[48]  M. Sheelagh T. Carpendale,et al.  Grounded evaluation of information visualizations , 2008, BELIV.

[49]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[50]  B. Roysam,et al.  Automated Cell Lineage Construction: A Rapid Method to Analyze Clonal Development Established with Murine Neural Progenitor Cells , 2006, Cell cycle.

[51]  Jonathan C. Roberts,et al.  Visual comparison for information visualization , 2011, Inf. Vis..

[52]  R. Eils,et al.  Quantitative motion analysis and visualization of cellular structures. , 2003, Methods.

[53]  Heidrun Schumann,et al.  A Design Space of Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[54]  John T. Stasko,et al.  Effectiveness of Animation in Trend Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[55]  S. Omholt,et al.  Phenomics: the next challenge , 2010, Nature Reviews Genetics.

[56]  Pierre Poulin,et al.  Interactive Procedural Modelling of Coherent Waterfall Scenes , 2015, Comput. Graph. Forum.

[57]  Rafael Yuste,et al.  Fluorescence microscopy today , 2005, Nature Methods.

[58]  Tamara Munzner,et al.  The nested blocks and guidelines model , 2015, Inf. Vis..

[59]  John T. Stasko,et al.  Mental Models, Visual Reasoning and Interaction in Information Visualization: A Top-down Perspective , 2010, IEEE Transactions on Visualization and Computer Graphics.

[60]  Anne E. Trefethen,et al.  Glyph-Based Video Visualization for Semen Analysis , 2015, IEEE Transactions on Visualization and Computer Graphics.

[61]  Philipp J. Keller,et al.  Reconstruction of Zebrafish Early Embryonic Development by Scanned Light Sheet Microscopy , 2008, Science.

[62]  Daniel A. Keim,et al.  Mastering the Information Age - Solving Problems with Visual Analytics , 2010 .

[63]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[64]  R. Dobarzić,et al.  [Fluorescence microscopy]. , 1975, Plucne bolesti i tuberkuloza.

[65]  Chris North,et al.  Toward measuring visualization insight , 2006, IEEE Computer Graphics and Applications.

[66]  Nicholas A. Hamilton,et al.  BMC Bioinformatics BioMed Central Methodology article Statistical and visual differentiation of subcellular imaging , 2008 .

[67]  B. Keon,et al.  An infrastructure for high-throughput microscopy: instrumentation, informatics, and integration. , 2006, Methods in enzymology.

[68]  Anne E Carpenter,et al.  Dynamic proteomics in individual human cells uncovers widespread cell-cycle dependence of nuclear proteins , 2006, Nature Methods.

[69]  M. Ashburner,et al.  Gene Ontology: tool for the unification of biology , 2000, Nature Genetics.

[70]  Luis Ibáñez,et al.  Integration of information and volume visualization for analysis of cell lineage and gene expression during embryogenesis , 2008, Electronic Imaging.

[71]  Bernd Fischer,et al.  CellCognition: time-resolved phenotype annotation in high-throughput live cell imaging , 2010, Nature Methods.

[72]  Lee Campbell,et al.  ProgeniDB: A Novel Cell Lineage Database for Generation Associated Phenotypic Behavior in Cell-based Assays , 2007, Cell cycle.

[73]  Chris North,et al.  Visualizing Biological Pathways: Requirements Analysis, Systems Evaluation and Research Agenda , 2005, Inf. Vis..

[74]  Anne E Carpenter,et al.  Workflow and Metrics for Image Quality Control in Large-Scale High-Content Screens , 2012, Journal of biomolecular screening.

[75]  Tamara Munzner,et al.  Design Study Methodology: Reflections from the Trenches and the Stacks , 2012, IEEE Transactions on Visualization and Computer Graphics.

[76]  Shin-Ichi Nishikawa,et al.  Continuous single-cell imaging of blood generation from haemogenic endothelium , 2009, Nature.

[77]  Jarke J. van Wijk,et al.  What Does the User Want to See? What do the Data Want to Be? , 2009, Inf. Vis..

[78]  Heidrun Schumann,et al.  Visualization of Time-Oriented Data , 2011, Human-Computer Interaction Series.

[79]  D. Montell,et al.  Cellular and molecular mechanisms of border cell migration analyzed using time-lapse live-cell imaging. , 2007, Developmental cell.

[80]  James R. Eagan,et al.  Low-level components of analytic activity in information visualization , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..