Temporaltracks: visual analytics for exploration of 4D fMRI time-series coactivation

Functional magnetic resonance imaging (fMRI) is a 4D medical imaging modality that depicts a proxy of neuronal activity in a series of temporal scans. Statistical processing of the modality shows promise in uncovering insights about the functioning of the brain, such as the default mode network, and characteristics of mental disorders. Current statistical processing generally summarises the temporal signals between brain regions into a single data point to represent the 'coactivation' of the regions. That is, how similar are their temporal patterns over the scans. However, the potential of such processing is limited by issues of possible data misrepresentation due to uncertainties, e.g. noise in the data. Moreover, it has been shown that brain signals are characterised by brief traces of coactivation, which are lost in the single value representations. To alleviate the issues, alternate statistical processes have been used, however creating effective techniques has proven difficult due to problems, e.g. issues with noise, which often require user input to uncover. Visual analytics, therefore, through its ability to interactively exploit human expertise, presents itself as an interesting approach of benefit to the domain. In this work, we present the conceptual design behind TemporalTracks, our visual analytics system for exploration of 4D fMRI time-series coactivation data, utilising a visual metaphor to effectively present coactivation data for easier understanding. We describe our design with a case study visually analysing Human Connectome Project data, demonstrating that TemporalTracks can uncover temporal events that would otherwise be hidden in standard analysis.

[1]  Jean-Daniel Fekete,et al.  Small MultiPiles: Piling Time to Explore Temporal Patterns in Dynamic Networks , 2015, Comput. Graph. Forum.

[2]  O. Sporns Contributions and challenges for network models in cognitive neuroscience , 2014, Nature Neuroscience.

[3]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[4]  Joshua Carp,et al.  On the Plurality of (Methodological) Worlds: Estimating the Analytic Flexibility of fMRI Experiments , 2012, Front. Neurosci..

[5]  David Gotz,et al.  DecisionFlow: Visual Analytics for High-Dimensional Temporal Event Sequence Data , 2014, IEEE Transactions on Visualization and Computer Graphics.

[6]  Steven Franconeri,et al.  The Connected Scatterplot for Presenting Paired Time Series , 2016, IEEE Transactions on Visualization and Computer Graphics.

[7]  Robert S. Laramee,et al.  TimeClassifier: a visual analytic system for the classification of multi-dimensional time series data , 2015, The Visual Computer.

[8]  Li Wei,et al.  Intelligent Icons: Integrating Lite-Weight Data Mining and Visualization into GUI Operating Systems , 2006, Sixth International Conference on Data Mining (ICDM'06).

[9]  Yingcai Wu,et al.  A Survey of Visual Analytics Techniques and Applications: State-of-the-Art Research and Future Challenges , 2013, Journal of Computer Science and Technology.

[10]  Jarke J. van Wijk,et al.  Reducing Snapshots to Points: A Visual Analytics Approach to Dynamic Network Exploration , 2016, IEEE Transactions on Visualization and Computer Graphics.

[11]  Hans Knutsson,et al.  Does Parametric Fmri Analysis with Spm Yield Valid Results? -an Empirical Study of 1484 Rest Datasets Does Parametric Fmri Analysis with Spm Yield Valid Results? - an Empirical Study of 1484 Rest Datasets , 2022 .

[12]  M. Greicius,et al.  Default-mode network activity distinguishes Alzheimer's disease from healthy aging: Evidence from functional MRI , 2004, Proc. Natl. Acad. Sci. USA.

[13]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[14]  Thomas E. Nichols,et al.  Can parametric statistical methods be trusted for fMRI based group studies? , 2015, 1511.01863.

[15]  Mengchen Liu,et al.  StoryFlow: Tracking the Evolution of Stories , 2013, IEEE Transactions on Visualization and Computer Graphics.

[16]  D. Long Networks of the Brain , 2011 .

[17]  Kwan-Liu Ma,et al.  Temporal Summary Images: An Approach to Narrative Visualization via Interactive Annotation Generation and Placement , 2017, IEEE Transactions on Visualization and Computer Graphics.

[18]  Rafael Yuste,et al.  Temporal dynamics in fMRI resting-state activity , 2015, Proceedings of the National Academy of Sciences.

[19]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[20]  Mark W. Woolrich,et al.  Resting-state fMRI in the Human Connectome Project , 2013, NeuroImage.

[21]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[22]  M. Lindquist The Statistical Analysis of fMRI Data. , 2008, 0906.3662.

[23]  Denis Lalanne,et al.  Flowstrates: An Approach for Visual Exploration of Temporal Origin‐Destination Data , 2011, Comput. Graph. Forum.

[24]  Yingli Lu,et al.  Regional homogeneity approach to fMRI data analysis , 2004, NeuroImage.

[25]  J. Duyn,et al.  Time-varying functional network information extracted from brief instances of spontaneous brain activity , 2013, Proceedings of the National Academy of Sciences.

[26]  Zeeshan Syed,et al.  Using Adaptive Downsampling to Compare Time Series with Warping , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[27]  Pierre Dragicevic,et al.  Time Curves: Folding Time to Visualize Patterns of Temporal Evolution in Data , 2016, IEEE Transactions on Visualization and Computer Graphics.

[28]  Eamonn J. Keogh,et al.  A symbolic representation of time series, with implications for streaming algorithms , 2003, DMKD '03.

[29]  Daniel S. Margulies,et al.  Visualizing the human connectome , 2013, NeuroImage.

[30]  Markus Hadwiger,et al.  NeuroLines: A Subway Map Metaphor for Visualizing Nanoscale Neuronal Connectivity , 2014, IEEE Transactions on Visualization and Computer Graphics.

[31]  D. Berman,et al.  ECG and navigator‐free four‐dimensional whole‐heart coronary MRA for simultaneous visualization of cardiac anatomy and function , 2014, Magnetic resonance in medicine.