Mapping brain activity at scale with cluster computing

Understanding brain function requires monitoring and interpreting the activity of large networks of neurons during behavior. Advances in recording technology are greatly increasing the size and complexity of neural data. Analyzing such data will pose a fundamental bottleneck for neuroscience. We present a library of analytical tools called Thunder built on the open-source Apache Spark platform for large-scale distributed computing. The library implements a variety of univariate and multivariate analyses with a modular, extendable structure well-suited to interactive exploration and analysis development. We demonstrate how these analyses find structure in large-scale neural data, including whole-brain light-sheet imaging data from fictively behaving larval zebrafish, and two-photon imaging data from behaving mouse. The analyses relate neuronal responses to sensory input and behavior, run in minutes or less and can be used on a private cluster or in the cloud. Our open-source framework thus holds promise for turning brain activity mapping efforts into biological insights.

[1]  Nicholas I. Fisher,et al.  Statistical Analysis of Circular Data , 1993 .

[2]  Sam T. Roweis,et al.  EM Algorithms for PCA and SPCA , 1997, NIPS.

[3]  T. Kanda,et al.  Histone–GFP fusion protein enables sensitive analysis of chromosome dynamics in living mammalian cells , 1998, Current Biology.

[4]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[5]  Stephen L. Johnson,et al.  nacre encodes a zebrafish microphthalmia-related protein that regulates neural-crest-derived pigment cell fate. , 1999, Development.

[6]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[7]  Hae-Chul Park,et al.  Structural comparison of zebrafish Elav/Hu and their differential expressions during neurogenesis , 2000, Neuroscience Letters.

[8]  Karel Svoboda,et al.  ScanImage: Flexible software for operating laser scanning microscopes , 2003, Biomedical engineering online.

[9]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[10]  Kevin L. Briggman,et al.  Optical Imaging of Neuronal Populations During Decision-Making , 2005, Science.

[11]  C. Niell,et al.  Functional Imaging Reveals Rapid Development of Visual Response Properties in the Zebrafish Tectum , 2005, Neuron.

[12]  Tomomi Sato,et al.  HuC:Kaede, a useful tool to label neural morphologies in networks in vivo , 2006, Genesis.

[13]  Akihiro Urasaki,et al.  Functional Dissection of the Tol2 Transposable Element Identified the Minimal cis-Sequence and a Highly Repetitive Sequence in the Subterminal Region Essential for Transposition , 2006, Genetics.

[14]  S. Fisher,et al.  Evaluating the biological relevance of putative enhancers using Tol2 transposon-mediated transgenesis in zebrafish , 2006, Nature Protocols.

[15]  Thomas Hofmann,et al.  Map-Reduce for Machine Learning on Multicore , 2007 .

[16]  M. Fox,et al.  Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging , 2007, Nature Reviews Neuroscience.

[17]  Byron M. Yu,et al.  Techniques for extracting single-trial activity patterns from large-scale neural recordings , 2007, Current Opinion in Neurobiology.

[18]  Yuan Yu,et al.  Dryad: distributed data-parallel programs from sequential building blocks , 2007, EuroSys '07.

[19]  W. M. Keck,et al.  Highly Selective Receptive Fields in Mouse Visual Cortex , 2008, The Journal of Neuroscience.

[20]  T. Holy,et al.  Fast Three-Dimensional Fluorescence Imaging of Activity in Neural Populations by Objective-Coupled Planar Illumination Microscopy , 2008, Neuron.

[21]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[22]  L. Zon,et al.  Transparent adult zebrafish as a tool for in vivo transplantation analysis. , 2008, Cell stem cell.

[23]  B. Sakmann,et al.  Journal of Neuroscience Methods Automated Three-dimensional Detection and Counting of Neuron Somata , 2022 .

[24]  Mark J. Schnitzer,et al.  Automated Analysis of Cellular Signals from Large-Scale Calcium Imaging Data , 2009, Neuron.

[25]  Wei Wu,et al.  A new look at state-space models for neural data , 2010, Journal of Computational Neuroscience.

[26]  Y. Freund,et al.  Automatic identification of fluorescently labeled brain cells for rapid functional imaging. , 2010, Journal of neurophysiology.

[27]  M. Stryker,et al.  Modulation of Visual Responses by Behavioral State in Mouse Visual Cortex , 2010, Neuron.

[28]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[29]  A. Borst,et al.  Fly motion vision. , 2010, Annual review of neuroscience.

[30]  Eva A Naumann,et al.  Monitoring Neural Activity with Bioluminescence during Natural Behavior , 2010, Nature Neuroscience.

[31]  Ethan K. Scott,et al.  Filtering of Visual Information in the Tectum by an Identified Neural Circuit , 2010, Science.

[32]  Benjamin F. Grewe,et al.  High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision , 2010, Nature Methods.

[33]  Kevin L. Briggman,et al.  Wiring specificity in the direction-selectivity circuit of the retina , 2011, Nature.

[34]  Arthur W. Wetzel,et al.  Network anatomy and in vivo physiology of visual cortical neurons , 2011, Nature.

[35]  A. Kinkhabwala,et al.  A structural and functional ground plan for neurons in the hindbrain of zebrafish , 2011, Proceedings of the National Academy of Sciences.

[36]  A. Cheng,et al.  simultaneous two-photon calcium imaging at different depths with spatiotemporal multiplexing , 2011 .

[37]  Johann H. Bollmann,et al.  Layer-Specific Targeting of Direction-Selective Neurons in the Zebrafish Optic Tectum , 2012, Neuron.

[38]  Georg B. Keller,et al.  Sensorimotor Mismatch Signals in Primary Visual Cortex of the Behaving Mouse , 2012, Neuron.

[39]  Jasper Akerboom,et al.  Optimization of a GCaMP Calcium Indicator for Neural Activity Imaging , 2012, The Journal of Neuroscience.

[40]  J. Simon Wiegert,et al.  Multiple dynamic representations in the motor cortex during sensorimotor learning , 2012, Nature.

[41]  Alison S. Walker,et al.  Parametric Functional Maps of Visual Inputs to the Tectum , 2012, Neuron.

[42]  F. Engert,et al.  Direction selectivity in the larval zebrafish tectum is mediated by asymmetric inhibition , 2012, Front. Neural Circuits.

[43]  Michael J. Franklin,et al.  Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing , 2012, NSDI.

[44]  Drew N. Robson,et al.  Brain-wide neuronal dynamics during motor adaptation in zebrafish , 2012, Nature.

[45]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[46]  Philipp J. Keller,et al.  Whole-brain functional imaging at cellular resolution using light-sheet microscopy , 2013, Nature Methods.

[47]  Chie Satou,et al.  Transgenic tools to characterize neuronal properties of discrete populations of zebrafish neurons , 2013, Development.

[48]  Aaron S. Andalman,et al.  Wave optics theory and 3-D deconvolution for the light field microscope. , 2013, Optics express.

[49]  F. Engert,et al.  Two-photon calcium imaging during fictive navigation in virtual environments , 2013, Front. Neural Circuits.

[50]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[51]  R. Yuste,et al.  Instantaneous three-dimensional sensing using spatial light modulator illumination with extended depth of field imaging. , 2013, Optics express.

[52]  Paul S. Weiss,et al.  The Brain Activity Map , 2013, Science.

[53]  Thomas Panier,et al.  Fast functional imaging of multiple brain regions in intact zebrafish larvae using Selective Plane Illumination Microscopy , 2013, BMC Neuroscience.

[54]  Chie Satou,et al.  Hindbrain V2a Neurons in the Excitation of Spinal Locomotor Circuits during Zebrafish Swimming , 2013, Current Biology.

[55]  Karel Svoboda,et al.  Natural Whisker-Guided Behavior by Head-Fixed Mice in Tactile Virtual Reality , 2014, The Journal of Neuroscience.

[56]  E. Boyden,et al.  Simultaneous whole-animal 3D-imaging of neuronal activity using light-field microscopy , 2014, Nature Methods.

[57]  Aristides B. Arrenberg,et al.  Functional Architecture of an Optic Flow-Responsive Area that Drives Horizontal Eye Movements in Zebrafish , 2014, Neuron.

[58]  Stephen W. Wilson,et al.  Left-Right Asymmetry Is Required for the Habenulae to Respond to Both Visual and Olfactory Stimuli , 2014, Current Biology.

[59]  Philipp J. Keller,et al.  Light-sheet functional imaging in fictively behaving zebrafish , 2014, Nature Methods.

[60]  M. Orger,et al.  Whole-Brain Activity Maps Reveal Stereotyped, Distributed Networks for Visuomotor Behavior , 2014, Neuron.