V-NeuroStack: 3D Time Stacks for Identifying Patterns in Calcium Imaging Data

Background Understanding functional correlations between the activities of neuron populations is vital for the analysis of neuronal networks. Analyzing large-scale neuroimaging data obtained from hundreds of neurons simultaneously poses significant visualization challenges. We developed V-NeuroStack, a novel network visualization tool to visualize data obtained using calcium imaging of spontaneous activity of cortical neurons in a mouse brain slice. New Method V-NeuroStack creates 3D time stacks by stacking 2D time frames for a period of 600 seconds. It provides a web interface that enables exploration and analysis of data using a combination of 3D and 2D visualization techniques. Comparison with existing Methods Previous attempts to analyze such data have been limited by the tools available to visualize large numbers of correlated activity traces. V-NeuroStack can scale data sets with at least a few thousand temporal snapshots. Results V-NeuroStack’s 3D view is used to explore patterns in the dynamic large-scale correlations between neurons over time. The 2D view is used to examine any timestep of interest in greater detail. Furthermore, a dual-line graph provides the ability to explore the raw and first-derivative values of a single neuron or a functional cluster of neurons. Conclusions V-NeuroStack enables easy exploration and analysis of large spatio-temporal datasets using two visualization paradigms: (a) Space-Time cube (b)Two-dimensional networks, via web interface. It will support future advancements in in vitro and in vivo data capturing techniques and can bring forth novel hypotheses by permitting unambiguous visualization of large-scale patterns in the neuronal activity data.

[1]  Tanya Y. Berger-Wolf,et al.  Visualizing Dynamic Brain Networks Using an Animated Dual-Representation , 2015, EuroVis.

[2]  Tony J Collins,et al.  ImageJ for microscopy. , 2007, BioTechniques.

[3]  V. Mountcastle The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[4]  Linda Douw,et al.  The Connectome Visualization Utility: Software for Visualization of Human Brain Networks , 2014, PloS one.

[5]  Giulio Rossetti,et al.  Community Discovery in Dynamic Networks , 2017, ACM Comput. Surv..

[6]  G. Elisabeta Marai,et al.  RemBrain: Exploring Dynamic Biospatial Networks with Mosaic Matrices and Mirror Glyphs , 2017, Visualization and Data Analysis.

[7]  Christine Grienberger,et al.  Imaging Calcium in Neurons , 2012, Neuron.

[8]  Yufeng Zang,et al.  DynamicBC: A MATLAB Toolbox for Dynamic Brain Connectome Analysis , 2014, Brain Connect..

[9]  Keisuke Ota,et al.  Low computational-cost cell detection method for calcium imaging data , 2018, Neuroscience Research.

[10]  Yong He,et al.  Chronnectome fingerprinting: Identifying individuals and predicting higher cognitive functions using dynamic brain connectivity patterns , 2018, Human brain mapping.

[11]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[12]  Jean-Daniel Fekete,et al.  Small MultiPiles: Piling Time to Explore Temporal Patterns in Dynamic Networks , 2015, Comput. Graph. Forum.

[13]  C. Stosiek,et al.  In vivo two-photon calcium imaging of neuronal networks , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[14]  David J. Margolis,et al.  Probing the dynamics of spontaneous cortical activities via widefield Ca+2 imaging in GCaMP6 transgenic mice , 2017 .

[15]  D. Llano,et al.  Effect of temperature on FAD and NADH-derived signals and neurometabolic coupling in the mouse auditory and motor cortex , 2017, Pflügers Archiv - European Journal of Physiology.

[16]  Michael Burch,et al.  A Taxonomy and Survey of Dynamic Graph Visualization , 2017, Comput. Graph. Forum.

[17]  Ben Shneiderman,et al.  Temporal Visualization of Social Network Dynamics: Prototypes for Nation of Neighbors , 2011, SBP.

[18]  Jarke J. van Wijk,et al.  Reducing Snapshots to Points: A Visual Analytics Approach to Dynamic Network Exploration , 2016, IEEE Transactions on Visualization and Computer Graphics.

[19]  Masaru Kitsuregawa,et al.  Analysis and visualization of temporal changes in bloggers' activities and interests , 2012, 2012 IEEE Pacific Visualization Symposium.

[20]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[21]  Kwan-Liu Ma,et al.  A visual analytics system for brain functional connectivity comparison across individuals, groups, and time points , 2017, 2017 IEEE Pacific Visualization Symposium (PacificVis).

[22]  Cynthia A. Brewer,et al.  ColorBrewer in Print: A Catalog of Color Schemes for Maps , 2003 .

[23]  Masaru Kitsuregawa,et al.  3D Visualization of temporal changes in bloggers' activities and interests , 2011, 2011 IEEE Conference on Visual Analytics Science and Technology (VAST).

[24]  A. Herz,et al.  Comparison of in vivo and in vitro parameters of opiate receptor binding in naive and tolerant dependent rodents. , 1975, Life sciences.

[25]  Silvia Miksch,et al.  Vertigo zoom: combining relational and temporal perspectives on dynamic networks , 2012, AVI.

[26]  Tanya Y. Berger-Wolf,et al.  SwordPlots: Exploring neuron behavior within dynamic communities of brain networks , 2016 .

[27]  A. Cariboni,et al.  In Vitro, Ex Vivo and In Vivo Techniques to Study Neuronal Migration in the Developing Cerebral Cortex , 2017, Brain sciences.

[28]  Jean-Daniel Fekete,et al.  Visualizing dynamic networks with matrix cubes , 2014, CHI.

[29]  Michael Francis,et al.  Automated region of interest analysis of dynamic Ca²+ signals in image sequences. , 2012, American journal of physiology. Cell physiology.

[30]  Markus Hadwiger,et al.  NeuroLines: A Subway Map Metaphor for Visualizing Nanoscale Neuronal Connectivity , 2014, IEEE Transactions on Visualization and Computer Graphics.

[31]  Andrew E. Johnson,et al.  Visualizing the Evolution of Community Structures in Dynamic Social Networks , 2011, Comput. Graph. Forum.

[32]  Falk Schreiber,et al.  VANTED: A system for advanced data analysis and visualization in the context of biological networks , 2006, BMC Bioinformatics.

[33]  Ramasamy Vijayalakshmi,et al.  Change Detection and Visualization of Functional Brain Networks using EEG Data , 2014, ICCS.

[34]  Mahmoud Hassan,et al.  EEGNET: An Open Source Tool for Analyzing and Visualizing M/EEG Connectome , 2015, PloS one.

[35]  D. Pfaff,et al.  Recovery of consciousness is mediated by a network of discrete metastable activity states , 2014, Proceedings of the National Academy of Sciences.

[36]  Juan Zhou,et al.  Spontaneous eyelid closures link vigilance fluctuation with fMRI dynamic connectivity states , 2016, Proceedings of the National Academy of Sciences.

[37]  Tanya Y. Berger-Wolf,et al.  Finding Communities in Dynamic Social Networks , 2011, 2011 IEEE 11th International Conference on Data Mining.

[38]  Gustavo Deco,et al.  Network dynamics with BrainX3: a large-scale simulation of the human brain network with real-time interaction , 2015, Front. Neuroinform..

[39]  Weifeng Chen,et al.  A Survey of Macroscopic Brain Network Visualization Technology , 2018, Chinese Journal of Electronics.

[40]  Alberto Betella,et al.  Understanding large network datasets through embodied interaction in virtual reality , 2014, VRIC.

[41]  Alipasha Vaziri,et al.  A Guide to Emerging Technologies for Large-Scale and Whole-Brain Optical Imaging of Neuronal Activity. , 2018, Annual review of neuroscience.

[42]  Laura Astolfi,et al.  Connectome : A MATLAB toolbox for mapping and imaging of brain , 2010 .

[43]  M. Sheelagh T. Carpendale,et al.  A Review of Temporal Data Visualizations Based on Space-Time Cube Operations , 2014, EuroVis.

[44]  Daniel A. McFarland,et al.  The Art and Science of Dynamic Network Visualization , 2006, J. Soc. Struct..

[45]  D. Llano,et al.  A novel dynamic network imaging analysis method reveals aging-related fragmentation of cortical networks in mouse , 2019, bioRxiv.

[46]  Wolfgang Stuerzlinger,et al.  Evaluating an Immersive Space-Time Cube Geovisualization for Intuitive Trajectory Data Exploration , 2019, IEEE Transactions on Visualization and Computer Graphics.

[47]  Manuel Tanzi,et al.  Visualization of Neurophysiological Dynamic Communities within the Mouse Brain , 2017 .

[48]  A. Colman,et al.  Comparing Rating Scales of Different Lengths: Equivalence of Scores from 5-Point and 7-Point Scales , 1997 .

[49]  Seok-Hee Hong,et al.  Visualization and analysis of email networks , 2007, 2007 6th International Asia-Pacific Symposium on Visualization.