Challenges for Brain Data Analysis in VR Environments

Analysing and understanding brain function and disorder is the main focus of neuroscience. Due to the high complexity of the brain, directionality of the signal and changing activity over time, visual exploration and data analysis are difficult. For this reason, a vast amount of research challenges are still unsolved. We explored different challenges of the visual analysis of brain data and the design of corresponding immersive environments in collaboration with experts from the biomedical domain. We built a prototype of an immersive virtual reality environment to explore the design space and to investigate how brain data analysis can be supported by a variety of design choices. Our environment can be used to study the effect of different visualisations and combinations of brain data representation, as for example network layouts, anatomical mapping or time series. As a long-term goal, we aim to aid neuro-scientists in a better understanding of brain function and disorder.

[1]  M. V. D. Heuvel,et al.  Exploring the brain network: A review on resting-state fMRI functional connectivity , 2010, European Neuropsychopharmacology.

[2]  Nikos K. Logothetis,et al.  fMRI at High Spatial Resolution: Implications for BOLD-Models , 2016, Front. Comput. Neurosci..

[3]  Philippe Castagliola,et al.  On the Readability of Graphs Using Node-Link and Matrix-Based Representations: A Controlled Experiment and Statistical Analysis , 2005, Inf. Vis..

[4]  Alex D. Leow,et al.  NeuroCave: A web-based immersive visualization platform for exploring connectome datasets , 2018, Network Neuroscience.

[5]  Natasha M. Maurits,et al.  Data-driven visualization of multichannel EEG coherence networks based on community structure analysis , 2018, Applied Network Science.

[6]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[7]  Mara Cercignani,et al.  Network functional connectivity and whole-brain functional connectomics to investigate cognitive decline in neurodegenerative conditions. , 2016, Functional neurology.

[8]  Baining Guo,et al.  Let It Flow: A Static Method for Exploring Dynamic Graphs , 2014, 2014 IEEE Pacific Visualization Symposium.

[9]  Daniel S. Margulies,et al.  Connexel visualization: a software implementation of glyphs and edge-bundling for dense connectivity data using brainGL , 2014, Front. Neurosci..

[10]  Ivan Viola,et al.  Visualization of Biomolecular Structures: State of the Art Revisited , 2017, Comput. Graph. Forum.

[11]  Yi Pan,et al.  Complex Brain Network Analysis and Its Applications to Brain Disorders: A Survey , 2017, Complex..

[12]  Karsten Klein,et al.  Temporaltracks: visual analytics for exploration of 4D fMRI time-series coactivation , 2017, CGI.

[13]  Karsten Klein,et al.  CereVA - Visual Analysis of Functional Brain Connectivity , 2015, IVAPP.

[14]  Arthur W. Toga,et al.  Using Virtual Reality to Improve Performance and User Experience in Manual Correction of MRI Segmentation Errors by Non-experts , 2018, Journal of Digital Imaging.

[15]  Paul M. Thompson,et al.  Blockwise Human Brain Network Visual Comparison Using NodeTrix Representation , 2017, IEEE Transactions on Visualization and Computer Graphics.

[16]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[17]  Edward T. Bullmore,et al.  Fundamentals of Brain Network Analysis , 2016 .

[18]  Jean-Daniel Fekete,et al.  Small MultiPiles: Piling Time to Explore Temporal Patterns in Dynamic Networks , 2015, Comput. Graph. Forum.

[20]  O. Sporns Contributions and challenges for network models in cognitive neuroscience , 2014, Nature Neuroscience.

[21]  Valerio Pascucci,et al.  A Virtual Reality Visualization Tool for Neuron Tracing , 2018, IEEE Transactions on Visualization and Computer Graphics.

[22]  Daniel Rueckert,et al.  Human brain mapping: A systematic comparison of parcellation methods for the human cerebral cortex , 2017, NeuroImage.

[23]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[24]  Tobias Isenberg,et al.  Weighted graph comparison techniques for brain connectivity analysis , 2013, CHI.

[25]  Karsten Klein,et al.  An Uncertainty Visual Analytics Framework for fMRI Functional Connectivity , 2018, Neuroinformatics.

[26]  Natasha M. Maurits,et al.  Data-Driven Visualization and Group Analysis of Multichannel EEG Coherence with Functional Units , 2008, IEEE Transactions on Visualization and Computer Graphics.

[27]  Steven D. Beyea,et al.  Thresholds in fMRI studies: Reliable for single subjects? , 2013, Journal of Neuroscience Methods.

[28]  Danielle S. Bassett,et al.  Multi-scale brain networks , 2016, NeuroImage.

[29]  Vince D. Calhoun,et al.  Fused Estimation of Sparse Connectivity Patterns From Rest fMRI—Application to Comparison of Children and Adult Brains , 2018, IEEE Transactions on Medical Imaging.

[30]  Christopher R. Madan,et al.  Creating 3D visualizations of MRI data: A brief guide , 2015, F1000Research.

[31]  Lutz Jäncke,et al.  The Problem of Thresholding in Small-World Network Analysis , 2013, PloS one.

[32]  John D. Van Horn,et al.  Circular representation of human cortical networks for subject and population-level connectomic visualization , 2012, NeuroImage.

[33]  Jonas Richiardi,et al.  Graph analysis of functional brain networks: practical issues in translational neuroscience , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[34]  Tobias Isenberg,et al.  Immersive Analytics: An Introduction , 2018, Immersive Analytics.

[35]  Karsten Klein,et al.  A review and outlook on visual analytics for uncertainties in functional magnetic resonance imaging , 2018, Brain Informatics.

[36]  Daniel S. Margulies,et al.  Visualizing the human connectome , 2013, NeuroImage.

[37]  Gustavo Deco,et al.  Can sliding-window correlations reveal dynamic functional connectivity in resting-state fMRI? , 2016, NeuroImage.

[38]  Benjamin Weyers,et al.  Remain seated: towards fully-immersive desktop VR , 2017, 2017 IEEE 3rd Workshop on Everyday Virtual Reality (WEVR).

[39]  Michael Burch,et al.  A Taxonomy and Survey of Dynamic Graph Visualization , 2017, Comput. Graph. Forum.