Interactive Volumetric Visual Analysis of Glycogen‐derived Energy Absorption in Nanometric Brain Structures

Digital acquisition and processing techniques are changing the way neuroscience investigation is carried out. Emerging applications range from statistical analysis on image stacks to complex connectomics visual analysis tools targeted to develop and test hypotheses of brain development and activity. In this work, we focus on neuroenergetics, a field where neuroscientists analyze nanoscale brain morphology and relate energy consumption to glucose storage in form of glycogen granules. In order to facilitate the understanding of neuroenergetic mechanisms, we propose a novel customized pipeline for the visual analysis of nanometric‐level reconstructions based on electron microscopy image data. Our framework supports analysis tasks by combining i) a scalable volume visualization architecture able to selectively render image stacks and corresponding labelled data, ii) a method for highlighting distance‐based energy absorption probabilities in form of glow maps, and iii) a hybrid connectivitybased and absorption‐based interactive layout representation able to support queries for selective analysis of areas of interest and potential activity within the segmented datasets. This working pipeline is currently used in a variety of studies in the neuroenergetics domain. Here, we discuss a test case in which the framework was successfully used by domain scientists for the analysis of aging effects on glycogen metabolism, extracting knowledge from a series of nanoscale brain stacks of rodents somatosensory cortex.

[1]  Quan Liu,et al.  Review of Monte Carlo modeling of light transport in tissues , 2013, Journal of biomedical optics.

[2]  Markus Hadwiger,et al.  GLAM: Glycogen-derived Lactate Absorption Map for visual analysis of dense and sparse surface reconstructions of rodent brain structures on desktop systems and virtual environments , 2018, Comput. Graph..

[3]  Pierre J. Magistretti,et al.  A Cellular Perspective on Brain Energy Metabolism and Functional Imaging , 2015, Neuron.

[4]  Jörg-Stefan Praßni,et al.  Visualization of Large Volumetric Multi-Channel Microscopy Data Streams on Standard PCs , 2014, ArXiv.

[5]  Cynthia A. Brewer,et al.  ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps , 2003 .

[6]  Timo Ropinski,et al.  A Survey of Perceptually Motivated 3D Visualization of Medical Image Data , 2016, Comput. Graph. Forum.

[7]  Markus Hadwiger,et al.  A Process for Digitizing and Simulating Biologically Realistic Oligocellular Networks Demonstrated for the Neuro-Glio-Vascular Ensemble , 2018, Front. Neurosci..

[8]  Markus Hadwiger,et al.  Abstractocyte: A Visual Tool for Exploring Nanoscale Astroglial Cells , 2018, IEEE Transactions on Visualization and Computer Graphics.

[9]  Heikki Lehväslaiho,et al.  Three‐dimensional immersive virtual reality for studying cellular compartments in 3D models from EM preparations of neural tissues , 2015, The Journal of comparative neurology.

[10]  Eric T. Trautman,et al.  A Complete Electron Microscopy Volume of the Brain of Adult Drosophila melanogaster , 2017, Cell.

[11]  Markus Hadwiger,et al.  ConnectomeExplorer: Query-Guided Visual Analysis of Large Volumetric Neuroscience Data , 2013, IEEE Transactions on Visualization and Computer Graphics.

[12]  Carlos Portera-Cailliau,et al.  Altered Synaptic Dynamics during Normal Brain Aging , 2013, The Journal of Neuroscience.

[13]  Henrik Ohlsson,et al.  Concurrent Volume Visualization of Real-Time fMRI , 2010, VG@Eurographics.

[14]  Dan F. M. Goodman,et al.  Graph Drawing by Stochastic Gradient Descent , 2017, IEEE Transactions on Visualization and Computer Graphics.

[15]  Nir Shavit,et al.  The big data challenges of connectomics , 2014, Nature Neuroscience.

[16]  Timo Ropinski,et al.  An experimental study on the effects of shading in 3D perception of volumetric models , 2015, The Visual Computer.

[17]  Stefan Bruckner,et al.  BrainGazer - Visual Queries for Neurobiology Research , 2009, IEEE Transactions on Visualization and Computer Graphics.

[18]  Huamin Qu,et al.  Evaluating the Readability of Force Directed Graph Layouts: A Deep Learning Approach , 2018, IEEE Computer Graphics and Applications.

[19]  Renato Pajarola,et al.  State‐of‐the‐Art in Compressed GPU‐Based Direct Volume Rendering , 2014, Comput. Graph. Forum.

[20]  Stefan Bruckner,et al.  Visualization and Quantification for Interactive Analysis of Neural Connectivity in Drosophila , 2017, Comput. Graph. Forum.

[21]  C. Genoud,et al.  Volume scanning electron microscopy for imaging biological ultrastructure , 2016, Biology of the cell.

[22]  Pierre Magistretti,et al.  The Strategic Location of Glycogen and Lactate: From Body Energy Reserve to Brain Plasticity , 2019, Front. Cell. Neurosci..

[23]  Arie E. Kaufman,et al.  Visualization of Neuronal Structures in Wide-Field Microscopy Brain Images , 2019, IEEE Transactions on Visualization and Computer Graphics.

[24]  Nancy Argüelles,et al.  Author ' s , 2008 .

[25]  Wei Ouyang,et al.  The imaging tsunami: Computational opportunities and challenges , 2017 .

[26]  Markus Hadwiger,et al.  NeuroBlocks – Visual Tracking of Segmentation and Proofreading for Large Connectomics Projects , 2016, IEEE Transactions on Visualization and Computer Graphics.

[27]  Virginia Gao,et al.  Astrocyte glycogen and lactate: New insights into learning and memory mechanisms , 2018, Glia.

[28]  Bernhard Preim,et al.  Illustrative PET/CT Visualisation of SIRT-Treated Lung Metastases , 2016, VCBM/MedViz.

[29]  Timo Ropinski,et al.  Interactive Volume Rendering with Volumetric Illumination , 2012, Eurographics.

[30]  Pascal Fua,et al.  The effects of aging on neuropil structure in mouse somatosensory cortex—A 3D electron microscopy analysis of layer 1 , 2018, PloS one.

[31]  Markus Hadwiger,et al.  State‐of‐the‐Art in GPU‐Based Large‐Scale Volume Visualization , 2015, Comput. Graph. Forum.

[32]  Giulio Tononi,et al.  Sleep and Wake Affect Glycogen Content and Turnover at Perisynaptic Astrocytic Processes , 2018, Front. Cell. Neurosci..

[33]  Markus Hadwiger,et al.  SparseLeap: Efficient Empty Space Skipping for Large-Scale Volume Rendering , 2018, IEEE Transactions on Visualization and Computer Graphics.

[34]  Markus Hadwiger,et al.  NeuroLines: A Subway Map Metaphor for Visualizing Nanoscale Neuronal Connectivity , 2014, IEEE Transactions on Visualization and Computer Graphics.

[35]  Florian Schulze,et al.  neuroMAP — Interactive graph-visualization of the fruit fly's neural circuit , 2013, 2013 IEEE Symposium on Biological Data Visualization (BioVis).

[36]  EUROGRAPHICS The European Association for Computer Graphics , 1983 .

[37]  Hajime Hirase,et al.  Glycogen distribution in the microwave‐fixed mouse brain reveals heterogeneous astrocytic patterns , 2016, Glia.

[38]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[39]  Won-Ki Jeong,et al.  Whole-brain serial-section electron microscopy in larval zebrafish , 2017, Nature.

[40]  David Harel,et al.  Drawing graphs nicely using simulated annealing , 1996, TOGS.

[41]  Chandan Singh,et al.  Large Scale Image Segmentation with Structured Loss Based Deep Learning for Connectome Reconstruction , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Laurent Lucas,et al.  Towards an interactive navigation in large virtual microscopy images on 3D displays , 2016, 2016 International Conference on 3D Imaging (IC3D).

[43]  Markus Hadwiger,et al.  Culling for Extreme-Scale Segmentation Volumes: A Hybrid Deterministic and Probabilistic Approach , 2019, IEEE Transactions on Visualization and Computer Graphics.

[44]  Larry Lindsey,et al.  High-precision automated reconstruction of neurons with flood-filling networks , 2017, Nature Methods.

[45]  Christina M. Weaver,et al.  Dendritic spine changes associated with normal aging , 2013, Neuroscience.

[46]  A. Peters,et al.  Synapses are lost during aging in the primate prefrontal cortex , 2008, Neuroscience.

[47]  Kai Lawonn,et al.  Illustrative Multi-volume Rendering for PET/CT Scans , 2015, VCBM.

[48]  Markus Hadwiger,et al.  Interactive Volume Exploration of Petascale Microscopy Data Streams Using a Visualization-Driven Virtual Memory Approach , 2012, IEEE Transactions on Visualization and Computer Graphics.

[49]  Johannes E. Schindelin,et al.  TrakEM2 Software for Neural Circuit Reconstruction , 2012, PloS one.

[50]  Corrado Calì Astroglial anatomy in the times of connectomics , 2018 .