Integrated Visualization of Human Brain Connectome Data

Visualization plays a vital role in the analysis of multi-modal neuroimaging data. A major challenge in neuroimaging visualization is how to integrate structural, functional and connectivity data to form a comprehensive visual context for data exploration, quality control, and hypothesis discovery. We develop a new integrated visualization solution for brain imaging data by combining scientific and information visualization techniques within the context of the same anatomic structure. New surface texture techniques are developed to map non-spatial attributes onto the brain surfaces from MRI scans. Two types of non-spatial information are represented: (1) time-series data from resting-state functional MRI measuring brain activation; (2) network properties derived from structural connectivity data for different groups of subjects, which may help guide the detection of differentiation features. Through visual exploration, this integrated solution can help identify brain regions with highly correlated functional activations as well as their activation patterns. Visual detection of differentiation features can also potentially discover image based phenotypic biomarkers for brain diseases.

[1]  Adam J. Schwarz,et al.  Negative edges and soft thresholding in complex network analysis of resting state functional connectivity data , 2011, NeuroImage.

[2]  Andrew J. Saykin,et al.  Optimization of seed density in DTI tractography for structural networks , 2012, Journal of Neuroscience Methods.

[3]  Azriel Rosenfeld,et al.  Digital Picture Processing , 1976 .

[4]  Anna Vilanova,et al.  Visualization of DTI fibers using hair-rendering techniques , 2006 .

[5]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[6]  Nicola Abate,et al.  Role of ENPP1 on Adipocyte Maturation , 2007, PloS one.

[7]  Baoquan Chen,et al.  Paint Inspired Color Mixing and Compositing for Visualization , 2004 .

[8]  Geoffrey J M Parker,et al.  A framework for a streamline‐based probabilistic index of connectivity (PICo) using a structural interpretation of MRI diffusion measurements , 2003, Journal of magnetic resonance imaging : JMRI.

[9]  Gerik Scheuermann,et al.  LineAO - Improved Three-Dimensional Line Rendering , 2013, IEEE Trans. Vis. Comput. Graph..

[10]  E. Bullmore,et al.  A Resilient, Low-Frequency, Small-World Human Brain Functional Network with Highly Connected Association Cortical Hubs , 2006, The Journal of Neuroscience.

[11]  Hans-Peter Seidel,et al.  Visualization with stylized line primitives , 2005, VIS 05. IEEE Visualization, 2005..

[12]  P. Thiran,et al.  Mapping Human Whole-Brain Structural Networks with Diffusion MRI , 2007, PloS one.

[13]  Daniel S. Margulies,et al.  Visualizing the human connectome , 2013, NeuroImage.

[14]  Timothy E. J. Behrens,et al.  Human connectomics , 2012, Current Opinion in Neurobiology.

[15]  Simon B. Eickhoff,et al.  Evaluating a visualization of uncertainty in probabilistic tractography , 2010, Medical Imaging.

[16]  Tobias Isenberg,et al.  DTI in Context: Illustrating Brain Fiber Tracts In Situ , 2010, Comput. Graph. Forum.

[17]  Timothy O. Laumann,et al.  Methods to detect, characterize, and remove motion artifact in resting state fMRI , 2014, NeuroImage.

[18]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[19]  Vid Petrovic,et al.  Visualizing Whole-Brain DTI Tractography with GPU-based Tuboids and LoD Management , 2007, IEEE Transactions on Visualization and Computer Graphics.

[20]  Bharat B. Biswal,et al.  Resting state fMRI: A personal history , 2012, NeuroImage.

[21]  A. Toga,et al.  Mapping Connectivity Damage in the Case of Phineas Gage , 2012, PloS one.

[22]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[23]  E. Bullmore,et al.  Undirected graphs of frequency-dependent functional connectivity in whole brain networks , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[24]  Christopher Nimsky,et al.  Hybrid Visualization for White Matter Tracts using Triangle Strips and Point Sprites , 2006, IEEE Transactions on Visualization and Computer Graphics.

[25]  Bernd Hamann,et al.  Visualizing White Matter Fiber Tracts with Optimally Fitted Curved Dissection Surfaces , 2010, VCBM.