Visualization Multi-Pipeline for Communicating Biology

We propose a system to facilitate biology communication by developing a pipeline to support the instructional visualization of heterogeneous biological data on heterogeneous user-devices. Discoveries and concepts in biology are typically summarized with illustrations assembled manually from the interpretation and application of heterogenous data. The creation of such illustrations is time consuming, which makes it incompatible with frequent updates to the measured data as new discoveries are made. Illustrations are typically non-interactive, and when an illustration is updated, it still has to reach the user. Our system is designed to overcome these three obstacles. It supports the integration of heterogeneous datasets, reflecting the knowledge that is gained from different data sources in biology. After pre-processing the datasets, the system transforms them into visual representations as inspired by scientific illustrations. As opposed to traditional scientific illustration these representations are generated in real-time - they are interactive. The code generating the visualizations can be embedded in various software environments. To demonstrate this, we implemented both a desktop application and a remote-rendering server in which the pipeline is embedded. The remote-rendering server supports multi-threaded rendering and it is able to handle multiple users simultaneously. This scalability to different hardware environments, including multi-GPU setups, makes our system useful for efficient public dissemination of biological discoveries.

[1]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[2]  Nicholas Woolridge,et al.  In Silico: 3D Animation and Simulation of Cell Biology with Maya and MEL , 2008 .

[3]  Osman Ratib,et al.  OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images , 2004, Journal of Digital Imaging.

[4]  Kwan-Liu Ma,et al.  High Performance Visualization of Time-Varying Volume Data over a Wide-Area Network , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[5]  D. Goodsell,et al.  cellPACK: A Virtual Mesoscope to Model and Visualize Structural Systems Biology , 2014, Nature Methods.

[6]  David S. Goodsell,et al.  3D molecular models of whole HIV-1 virions generated with cellPACK , 2014, Faraday discussions.

[7]  James F. Blinn,et al.  A Generalization of Algebraic Surface Drawing , 1982, TOGS.

[8]  Elmar Eisemann,et al.  The Online Anatomical Human: Web-based Anatomy Education , 2016, Eurographics.

[9]  William E. Lorensen,et al.  The visualization toolkit (2nd ed.): an object-oriented approach to 3D graphics , 1998 .

[10]  Andrea Sanna,et al.  A Streaming-Based Solution for Remote Visualization of 3D Graphics on Mobile Devices , 2007, IEEE Transactions on Visualization and Computer Graphics.

[11]  Thomas Ertl,et al.  Combining local and remote visualization techniques for interactive volume rendering in medical applications , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[12]  Conrad C. Huang,et al.  UCSF Chimera—A visualization system for exploratory research and analysis , 2004, J. Comput. Chem..

[13]  Ivan Viola,et al.  cellVIEW: a Tool for Illustrative and Multi-Scale Rendering of Large Biomolecular Datasets , 2015, VCBM.

[14]  Ioana M. Boier Martin Adaptive rendering of 3D models over net-works using multiple modalities , 2000 .

[15]  Marc Levoy,et al.  Protected interactive 3D graphics via remote rendering , 2004, ACM Trans. Graph..

[16]  Ivan Viola,et al.  VolumeShop: interactive direct volume illustration , 2005, SIGGRAPH '05.

[17]  J. Iwasa Animating the model figure. , 2010, Trends in cell biology.

[18]  S. Rafelski,et al.  Quantifying mitochondrial content in living cells. , 2015, Methods in cell biology.

[19]  IJsbrand M. Kramer,et al.  Education Catching Up with Science: Preparing Students for Three-Dimensional Literacy in Cell Biology , 2012, CBE life sciences education.

[20]  Thomas Ertl,et al.  MegaMol—A Prototyping Framework for Particle-Based Visualization , 2015, IEEE Transactions on Visualization and Computer Graphics.

[21]  Charles Marion,et al.  Remote visualization of large datasets with MIDAS and ParaViewWeb , 2011, Web3D '11.

[22]  Daniel Baum,et al.  Interactive Rendering of Materials and Biological Structures on Atomic and Nanoscopic Scale , 2012, Comput. Graph. Forum.

[23]  Mathias Schott,et al.  A Directional Occlusion Shading Model for Interactive Direct Volume Rendering , 2009, Comput. Graph. Forum.

[24]  Anne E Carpenter,et al.  Visualization of image data from cells to organisms , 2010, Nature Methods.

[25]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[26]  Ivan Viola,et al.  Illustrative Visualization of Molecular Reactions using Omniscient Intelligence and Passive Agents , 2014, Comput. Graph. Forum.

[27]  C. C. Law,et al.  ParaView: An End-User Tool for Large-Data Visualization , 2005, The Visualization Handbook.

[28]  Timo Ropinski,et al.  Inviwo - An extensible, multi-purpose visualization framework , 2015, 2015 IEEE Scientific Visualization Conference (SciVis).

[29]  Thomas Ertl,et al.  Remote Rendering and User Interaction on Mobile Devices for Scientific Visualization , 2015, VINCI.

[30]  Johannes E. Schindelin,et al.  The ImageJ ecosystem: An open platform for biomedical image analysis , 2015, Molecular reproduction and development.

[31]  Carolina Wählby,et al.  Seeded Watersheds for Combined Segmentation and Tracking of Cells , 2005, ICIAP.

[32]  Ken Shoemake,et al.  ARCBALL: a user interface for specifying three-dimensional orientation using a mouse , 1992 .