Volume visualization in serial electron microscopy using local variance

High-throughput microscopy allows researchers to produce large volumetric images of biological tissue at sub-micrometer resolution. Serial electron microscopy (EM) has the ability to improve three-dimensional imaging dramatically by providing nanometer-scale resolution. Serial EM data sets of brain tissue can potentially be used to reconstruct the complex structure of biological neural networks. These data sets consist of gigabytes of volumetric data densely packed with anatomical information. This makes three-dimensional EM data sets difficult to visualize. In this paper, we present new methods for visualizing EM data sets using a novel transfer function based on the local variance of volumetric features. We first construct a tensor field that describes the local shape and orientation of structures. These tensors are then used to visualize anatomical features such as cell bodies, membranes, and fibers. We do this by using the tensor shape and orientation to design transfer functions that allow selective visualization of features in dense EM image stacks.

[1]  Christopher Nimsky,et al.  Hybrid Visualization for White Matter Tracts using Triangle Strips and Point Sprites , 2006, IEEE Transactions on Visualization and Computer Graphics.

[2]  N. Makris,et al.  High angular resolution diffusion imaging reveals intravoxel white matter fiber heterogeneity , 2002, Magnetic resonance in medicine.

[3]  D. Tuch.  Q‐ball imaging , 2004, Magnetic resonance in medicine.

[4]  Vid Petrovic,et al.  Visualizing Whole-Brain DTI Tractography with GPU-based Tuboids and LoD Management , 2007, IEEE Transactions on Visualization and Computer Graphics.

[5]  Joseph F. Murray,et al.  Supervised Learning of Image Restoration with Convolutional Networks , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Carl-Fredrik Westin,et al.  Diffusion Tensor Visualization with Glyph Packing , 2006, IEEE Transactions on Visualization and Computer Graphics.

[7]  H. Sebastian Seung,et al.  Boundary Learning by Optimization with Topological Constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[9]  Kristen M. Harris,et al.  Synthesis of Research: Extending Unbiased Stereology of Brain Ultrastructure to Three-dimensional Volumes , 2001, J. Am. Medical Informatics Assoc..

[10]  Daniel B Ennis,et al.  Visualization of tensor fields using superquadric glyphs , 2005, Magnetic resonance in medicine.

[11]  W. Denk,et al.  Serial Block-Face Scanning Electron Microscopy to Reconstruct Three-Dimensional Tissue Nanostructure , 2004, PLoS biology.

[12]  Ross T. Whitaker,et al.  Detection of neuron membranes in electron microscopy images using a serial neural network architecture , 2010, Medical Image Anal..

[13]  Ross T. Whitaker,et al.  Enhancement of cell boundaries in transmission electron microscopy images , 2005, IEEE International Conference on Image Processing 2005.

[14]  James T. Kajiya,et al.  Rendering fur with three dimensional textures , 1989, SIGGRAPH.

[15]  Cem Yuksel,et al.  Visualization of Fibrous and Thread-like Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[16]  Ullrich Köthe,et al.  Segmentation of SBFSEM Volume Data of Neural Tissue by Hierarchical Classification , 2008, DAGM-Symposium.

[17]  G. Knott,et al.  Serial Section Scanning Electron Microscopy of Adult Brain Tissue Using Focused Ion Beam Milling , 2008, The Journal of Neuroscience.

[18]  N. Kasthuri,et al.  New Technique for Ultra-thin Serial Brain Section Imaging Using Scanning Electron Microscopy , 2007, Microscopy and Microanalysis.

[19]  Won-Ki Jeong,et al.  Interactive Histology of Large-Scale Biomedical Image Stacks , 2010, IEEE Transactions on Visualization and Computer Graphics.

[20]  G. Kindlmann,et al.  Superquadric Glyphs for Symmetric Second-Order Tensors , 2010, IEEE Transactions on Visualization and Computer Graphics.

[21]  Moritz Helmstaedter,et al.  High-accuracy neurite reconstruction for high-throughput neuroanatomy , 2011, Nature Neuroscience.

[22]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[23]  John Keyser,et al.  Hardware Accelerated Segmentation of Complex Volumetric Filament Networks , 2009, IEEE Transactions on Visualization and Computer Graphics.

[24]  Ross T. Whitaker,et al.  Axon tracking in serial block-face scanning electron microscopy , 2009, Medical Image Anal..

[25]  J. Bigun,et al.  Optimal Orientation Detection of Linear Symmetry , 1987, ICCV 1987.

[26]  Joe Michael Kniss,et al.  Interactive volume rendering using multi-dimensional transfer functions and direct manipulation widgets , 2001, Proceedings Visualization, 2001. VIS '01..

[27]  Gordon Kindlmann,et al.  Superquadric tensor glyphs , 2004, VISSYM'04.

[28]  Achilleas S. Frangakis,et al.  Nonlinear Anisotropic Diffusion in Three-Dimensional Electron Microscopy , 1999, Scale-Space.

[29]  Lucas J. van Vliet,et al.  A Crossing Detector Based on the Structure Tensor , 2007, ACIVS.

[30]  Kwan-Liu Ma,et al.  Size-based Transfer Functions: A New Volume Exploration Technique , 2008, IEEE Transactions on Visualization and Computer Graphics.

[31]  Ross T. Whitaker,et al.  Curvature-based transfer functions for direct volume rendering: methods and applications , 2003, IEEE Visualization, 2003. VIS 2003..

[32]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..