Machine Learning of Spatiotemporal Bursting Behavior in Developing Neural Networks

As with other modern sciences (and their computational counterparts), neuroscience experiments can now produce data that, in terms of both quantity and complexity, challenge our interpretative abilities. It is relatively common to be faced with datasets containing many millions of neural spikes collected from tens of thousands of neurons. Traditional data analysis methods can, in a relatively straightforward manner, identify large-scale features in such data (e.g., on the scale of entire networks). What these approaches often cannot do is to connect macroscopic activity to the relevant small-scale behaviors of individual cells, especially in the face of ongoing background activity that is not relevant. This communication presents an application of machine learning techniques to bridge the gap between microscopic and macroscopic behaviors and identify the small-scale activity that leads to large-scale behavior, reducing data complexity to a level that can be amenable to further analysis. A small number of spatiotemporal spikes (among many millions) were found to provide reliable information about if and where a burst will occur.

[1]  Shinichi Tamura,et al.  Simulation of Spike Wave Propagation and Two-to-one Communication with Dynamic Time Warping , 2016 .

[2]  Mark M. Churchland,et al.  DataHigh: Graphical user interface for visualizing and interacting with high-dimensional neural activity , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  U. Egert,et al.  Mesoscale Architecture Shapes Initiation and Richness of Spontaneous Network Activity , 2017, The Journal of Neuroscience.

[4]  Peter Ford Dominey,et al.  Comparison of Classifiers for Decoding Sensory and Cognitive Information from Prefrontal Neuronal Populations , 2014, PloS one.

[5]  John M. Beggs,et al.  Behavioral / Systems / Cognitive Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004 .

[6]  David R. Brillinger,et al.  Nerve Cell Spike Train Data Analysis: A Progression of Technique , 1992 .

[7]  Yasuhiko Jimbo,et al.  Continuous monitoring of developmental activity changes in cultured cortical networks , 2002 .

[8]  Alessandro Vato,et al.  Burst detection algorithms for the analysis of spatio-temporal patterns in cortical networks of neurons , 2005, Neurocomputing.

[9]  M S Lewicki,et al.  A review of methods for spike sorting: the detection and classification of neural action potentials. , 1998, Network.

[10]  Nikil D. Dutt,et al.  A configurable simulation environment for the efficient simulation of large-scale spiking neural networks on graphics processors , 2009, Neural Networks.

[11]  Yuko Mizuno-Matsumoto,et al.  VARIANCE OF SPATIOTEMPORAL SPIKING PATTERNS BY DIFFERENT STIMULATED NEURONS IN CULTURED NEURONAL NETWORKS , 2016 .

[12]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[13]  R. Kanzaki,et al.  Development of neural population activity toward self-organized criticality , 2017, Neuroscience.

[14]  D. Brillinger Maximum likelihood analysis of spike trains of interacting nerve cells , 2004, Biological Cybernetics.

[15]  Jan Stegenga,et al.  Analysis of Cultured Neuronal Networks Using Intraburst Firing Characteristics , 2008, IEEE Transactions on Biomedical Engineering.

[16]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.

[17]  N. Hatsopoulos,et al.  Propagating Waves in Human Motor Cortex , 2011, Front. Hum. Neurosci..

[18]  Daryl R Kipke,et al.  Fast wave propagation in auditory cortex of an awake cat using a chronic microelectrode array , 2007, Journal of neural engineering.

[19]  J. Pine Recording action potentials from cultured neurons with extracellular microcircuit electrodes , 1980, Journal of Neuroscience Methods.

[20]  Konrad P Kording,et al.  How advances in neural recording affect data analysis , 2011, Nature Neuroscience.

[21]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.

[22]  Hazeline U. Asuncion,et al.  BrainGrid+Workbench: High-performance/high-quality neural simulation , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[23]  G. P. Moore,et al.  Statistical analysis and functional interpretation of neuronal spike data. , 1966, Annual review of physiology.

[24]  Tatsuo K Sato,et al.  Traveling Waves in Visual Cortex , 2012, Neuron.

[25]  G. Loeb,et al.  A miniature microelectrode array to monitor the bioelectric activity of cultured cells. , 1972, Experimental cell research.

[26]  R. Quian Quiroga,et al.  Unsupervised Spike Detection and Sorting with Wavelets and Superparamagnetic Clustering , 2004, Neural Computation.

[27]  E. S. Chornoboy,et al.  Maximum likelihood identification of neural point process systems , 1988, Biological Cybernetics.

[28]  H. Robinson,et al.  The mechanisms of generation and propagation of synchronized bursting in developing networks of cortical neurons , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  Barry J. Richmond,et al.  Decoding cortical neuronal signals: Network models, information estimation and spatial tuning , 1994, Journal of Computational Neuroscience.

[30]  Fredric M. Wolf,et al.  Frontiers in Computational Neuroscience Materials and Methods Measures of Correlation , 2022 .

[31]  S. Chakrabartty,et al.  Spike sorting with support vector machines , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Steve M. Potter,et al.  An extremely rich repertoire of bursting patterns during the development of cortical cultures , 2006, BMC Neuroscience.

[33]  E Mjolsness,et al.  Machine learning for science: state of the art and future prospects. , 2001, Science.

[34]  Igor V. Tetko,et al.  Pattern grouping algorithm and de-convolution filtering of non-stationary correlated Poisson processes , 2001, Neurocomputing.

[35]  Frank C. Hoppensteadt,et al.  Bursts as a unit of neural information: selective communication via resonance , 2003, Trends in Neurosciences.

[36]  Pedro Larrañaga,et al.  Machine learning: an indispensable tool in bioinformatics. , 2010, Methods in molecular biology.

[37]  David C. Tam A spike train analysis for correlating burst firings in neurons , 2001, Neurocomputing.

[38]  Joost le Feber,et al.  Growth Dynamics Explain the Development of Spatiotemporal Burst Activity of Young Cultured Neuronal Networks in Detail , 2012, PloS one.

[39]  L. Abbott,et al.  A simple growth model constructs critical avalanche networks. , 2007, Progress in brain research.

[40]  John M. Beggs,et al.  A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro , 2008, The Journal of Neuroscience.

[41]  D. Turcotte,et al.  Self-organized criticality , 1999 .

[42]  Tang,et al.  Self-Organized Criticality: An Explanation of 1/f Noise , 2011 .

[43]  M. Nicolelis,et al.  Principal component analysis of neuronal ensemble activity reveals multidimensional somatosensory representations , 1999, Journal of Neuroscience Methods.

[44]  Konrad P. Körding,et al.  Machine Learning for Neural Decoding , 2017, eNeuro.

[45]  Romain Brette,et al.  Simulating spiking neural networks on GPU , 2012, Network.

[46]  Carl E. Rasmussen,et al.  Prediction on Spike Data Using Kernel Algorithms , 2003, NIPS.

[47]  Michael Stiber,et al.  A simple model of cortical culture growth: burst property dependence on network composition and activity , 2014, Biological Cybernetics.

[48]  B J Richmond,et al.  Concurrent processing and complexity of temporally encoded neuronal messages in visual perception. , 1991, Science.

[49]  G. Gross Simultaneous Single Unit Recording in vitro with a Photoetched Laser Deinsulated Gold Multimicroelectrode Surface , 1979, IEEE Transactions on Biomedical Engineering.

[50]  Donna L. Hudson,et al.  Neural networks and artificial intelligence for biomedical engineering , 1999 .

[51]  G L Gerstein,et al.  Detecting spatiotemporal firing patterns among simultaneously recorded single neurons. , 1988, Journal of neurophysiology.

[52]  Eisaku Maeda,et al.  Experimental analysis of neuronal dynamics in cultured cortical networks and transitions between different patterns of activity , 1997, Biological Cybernetics.

[53]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[54]  Kevin A. Brown,et al.  Large-scale spatiotemporal spike patterning consistent with wave propagation in motor cortex , 2015, Nature Communications.

[55]  Sonja Grün,et al.  Detection and Evaluation of Spatio-Temporal Spike Patterns in Massively Parallel Spike Train Data with SPADE , 2017, Front. Comput. Neurosci..

[56]  J. Lisman Bursts as a unit of neural information: making unreliable synapses reliable , 1997, Trends in Neurosciences.

[57]  Shinichi Tamura,et al.  Classification of Spike Wave Propagations in a Cultured Neuronal Network: Investigating a Brain Communication Mechanism , 2016 .

[58]  Robert A. Frazor,et al.  Standing Waves and Traveling Waves Distinguish Two Circuits in Visual Cortex , 2007, Neuron.

[59]  D. Plenz,et al.  The organizing principles of neuronal avalanches: cell assemblies in the cortex? , 2007, Trends in Neurosciences.

[60]  Uta Priss,et al.  An application of formal concept analysis to semantic neural decoding , 2009, Annals of Mathematics and Artificial Intelligence.

[61]  Florentin Wörgötter,et al.  Self-Organized Criticality in Developing Neuronal Networks , 2010, PLoS Comput. Biol..

[62]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[63]  Wim L. C. Rutten,et al.  Long-term characterization of firing dynamics of spontaneous bursts in cultured neural networks , 2004, IEEE Transactions on Biomedical Engineering.

[64]  Emery N. Brown,et al.  Computational Neuroscience: A Comprehensive Approach , 2022 .

[65]  L. F Abbott,et al.  Lapicque’s introduction of the integrate-and-fire model neuron (1907) , 1999, Brain Research Bulletin.

[66]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[67]  R. Segev,et al.  Long term behavior of lithographically prepared in vitro neuronal networks. , 2002, Physical review letters.

[68]  Christian Borgelt,et al.  Finding neural assemblies with frequent item set mining , 2013, Front. Neuroinform..

[69]  Liam Paninski,et al.  Model-Based Decoding, Information Estimation, and Change-Point Detection Techniques for Multineuron Spike Trains , 2011, Neural Computation.

[70]  Kathryn B. Laskey,et al.  Neural Coding: Higher-Order Temporal Patterns in the Neurostatistics of Cell Assemblies , 2000, Neural Computation.

[71]  P. M. Horton,et al.  Spike sorting based upon machine learning algorithms (SOMA) , 2007, Journal of Neuroscience Methods.