Visualization of Large Volumetric Multi-Channel Microscopy Data Streams on Standard PCs

Background: Visualization of multi-channel microscopy data plays a vital role in biological research. With the ever-increasing resolution of modern microscopes the data set size of the scanned specimen grows steadily. On commodity hardware this size easily exceeds the available main memory and the even more limited GPU memory. Common volume rendering techniques require the entire data set to be present in the GPU memory. Existing out-of-core rendering approaches for large volume data sets either are limited to single-channel volumes, or require a computer cluster, or have long preprocessing times. Results: We introduce a ray-casting technique for rendering large volumetric multi-channel microscopy data streams on commodity hardware. The volumetric data is managed at different levels of detail by an octree structure. In contrast to previous octree-based techniques, the octree is built incrementally and therefore supports streamed microscopy data as well as data set sizes exceeding the available main memory. Furthermore, our approach allows the user to interact with the partially rendered data set at all stages of the octree construction. After a detailed description of our method, we present performance results for different multi-channel data sets with a size of up to 24 GB on a standard desktop PC. Conclusions: Our rendering technique allows biologists to visualize their scanned specimen on their standard desktop computers without high-end hardware requirements. Furthermore, the user can interact with the data set during the initial loading to explore the already loaded parts, change rendering parameters like color maps or adjust clipping planes. Thus, the time of biologists being idle is reduced. Also, streamed data can be visualized to detect and stop flawed scans early during the scan process.

[1]  Markus Hadwiger,et al.  Exploring the Connectome: Petascale Volume Visualization of Microscopy Data Streams , 2013, IEEE Computer Graphics and Applications.

[2]  Markus Hadwiger,et al.  Interactive Volume Exploration of Petascale Microscopy Data Streams Using a Visualization-Driven Virtual Memory Approach , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  Charles D. Hansen,et al.  Interactive extraction of neural structures with user-guided morphological diffusion , 2012, 2012 IEEE Symposium on Biological Data Visualization (BioVis).

[4]  Charles D. Hansen,et al.  FluoRender: An application of 2D image space methods for 3D and 4D confocal microscopy data visualization in neurobiology research , 2012, 2012 IEEE Pacific Visualization Symposium.

[5]  Klaus Engel,et al.  CERA-TVR: A framework for interactive high-quality teravoxel volume visualization on standard PCs , 2011, 2011 IEEE Symposium on Large Data Analysis and Visualization.

[6]  Arthur W. Wetzel,et al.  Network anatomy and in vivo physiology of visual cortical neurons , 2011, Nature.

[7]  Ingrid Scholl,et al.  Comparing GPU-based multi-volume ray casting techniques , 2010, Computer Science - Research and Development.

[8]  Uncertainty-Aware Guided Volume Segmentation , 2010, IEEE Transactions on Visualization and Computer Graphics.

[9]  Jens H. Krüger,et al.  Large data visualization on distributed memory multi-GPU clusters , 2010, HPG '10.

[10]  Jens H. Krüger,et al.  Tuvok, an Architecture for Large Scale Volume Rendering , 2010, VMV.

[11]  Timo Ropinski,et al.  Voreen: A Rapid-Prototyping Environment for Ray-Casting-Based Volume Visualizations , 2009, IEEE Computer Graphics and Applications.

[12]  Charles D. Hansen,et al.  An interactive visualization tool for multi-channel confocal microscopy data in neurobiology research , 2009, IEEE Transactions on Visualization and Computer Graphics.

[13]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[14]  Sylvain Lefebvre,et al.  GigaVoxels: ray-guided streaming for efficient and detailed voxel rendering , 2009, I3D '09.

[15]  Markus Hadwiger,et al.  Smooth Mixed-Resolution GPU Volume Rendering , 2008, VG/PBG@SIGGRAPH.

[16]  Enrico Gobbetti,et al.  A single-pass GPU ray casting framework for interactive out-of-core rendering of massive volumetric datasets , 2008, The Visual Computer.

[17]  F. Del Bene,et al.  Optical Sectioning Deep Inside Live Embryos by Selective Plane Illumination Microscopy , 2004, Science.

[18]  Wolfgang Straßer,et al.  Advanced techniques for high-quality multi-resolution volume rendering , 2004, Comput. Graph..

[19]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[20]  Dietmar Saupe,et al.  Rapid High Quality Compression of Volume Data for Visualization , 2001, Comput. Graph. Forum.

[21]  Roberto Scopigno,et al.  Multiresolution volume visualization with a texture-based octree , 2001, The Visual Computer.

[22]  Daniel Cohen-Or,et al.  Proceedings of the 2000 IEEE symposium on Volume visualization , 2000 .

[23]  Thomas Ertl,et al.  Level-of-Detail Volume Rendering via 3D Textures , 2000, 2000 IEEE Symposium on Volume Visualization (VV 2000).

[24]  Bernd Hamann,et al.  Multiresolution techniques for interactive texture-based volume visualization , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[25]  D H Burns,et al.  Orthogonal‐plane fluorescence optical sectioning: Three‐dimensional imaging of macroscopic biological specimens , 1993, Journal of microscopy.

[26]  D. L. Misell,et al.  An estimate of the effect of chromatic aberration in electron microscopy , 1971 .