Discovering Precise Temporal Patterns in Large-Scale Neural Recordings through Robust and Interpretable Time Warping

Though the temporal precision of neural computation has been studied intensively, a data-driven determination of this precision remains a fundamental challenge. Reproducible spike time patterns may be obscured on single trials by uncontrolled temporal variability in behavior and cognition, or may not even be time locked to measurable signatures in either behavior or local field potentials (LFP). To overcome these challenges, we describe a general-purpose time warping framework that reveals precise spike-time patterns in an unsupervised manner, even when spiking is decoupled from behavior or is temporally stretched across single trials. We demonstrate this method across diverse systems: cued reaching in nonhuman primates, motor sequence production in rats, and olfaction in mice. This approach flexibly uncovers diverse dynamical firing patterns, including pulsatile responses to behavioral events, LFP-aligned oscillatory spiking, and even unanticipated patterns, like 7 Hz oscillations in rat motor cortex that are not time-locked to measured behaviors or LFP.

[1]  E. Fetz,et al.  Coherent 25- to 35-Hz oscillations in the sensorimotor cortex of awake behaving monkeys. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Risa Kawai,et al.  A Fully Automated High-Throughput Training System for Rodents , 2013, PloS one.

[3]  Andreas Draguhn,et al.  Parallel detection of theta and respiration-coupled oscillations throughout the mouse brain , 2018, Scientific Reports.

[4]  Zachary F Mainen,et al.  Neural antecedents of self-initiated actions in secondary motor cortex , 2014, Nature Neuroscience.

[5]  Eamonn J. Keogh,et al.  Extracting Optimal Performance from Dynamic Time Warping , 2016, KDD.

[6]  Hans-Georg Müller,et al.  Functional Data Analysis , 2016 .

[7]  Surya Ganguli,et al.  Inferring hidden structure in multilayered neural circuits , 2017, bioRxiv.

[8]  Mark S. Goldman,et al.  Unsupervised discovery of temporal sequences in high-dimensional datasets, with applications to neuroscience , 2018, bioRxiv.

[9]  J. S. Marron,et al.  Functional Data Analysis of Amplitude and Phase Variation , 2015, 1512.03216.

[10]  Jose M Carmena,et al.  Beta band oscillations in motor cortex reflect neural population signals that delay movement onset , 2017, eLife.

[11]  R Bro,et al.  Cross-validation of component models: A critical look at current methods , 2008, Analytical and bioanalytical chemistry.

[12]  Konrad P Kording,et al.  How advances in neural recording affect data analysis , 2011, Nature Neuroscience.

[13]  Matthew C Smear,et al.  Precise olfactory responses tile the sniff cycle , 2011, Nature Neuroscience.

[14]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[15]  Naoshige Uchida,et al.  Demixed principal component analysis of neural population data , 2016, eLife.

[16]  W. Singer,et al.  Synchronization of oscillatory responses in visual cortex correlates with perception in interocular rivalry. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Surya Ganguli,et al.  Discovering Precise Temporal Patterns in Large-Scale Neural Recordings through Robust and Interpretable Time Warping , 2020, Neuron.

[18]  Maneesh Sahani,et al.  Temporal alignment and latent Gaussian process factor inference in population spike trains , 2018, bioRxiv.

[19]  Robert E. Kass,et al.  Trial time warping to discriminate stimulus-related from movement-related neural activity , 2013, Journal of Neuroscience Methods.

[20]  Pierre Yger,et al.  A spike sorting toolbox for up to thousands of electrodes validated with ground truth recordings in vitro and in vivo , 2018, eLife.

[21]  Yuhong Yang,et al.  Nonparametric Regression with Correlated Errors , 2001 .

[22]  Dmitriy Aronov,et al.  Mapping of a non-spatial dimension by the hippocampal/entorhinal circuit , 2017, Nature.

[23]  Krishna V. Shenoy,et al.  Brittleness in model selection analysis of single neuron firing rates , 2018, bioRxiv.

[24]  Siu Kwan Lam,et al.  Numba: a LLVM-based Python JIT compiler , 2015, LLVM '15.

[25]  Michael N. Shadlen,et al.  A Neural Mechanism for Sensing and Reproducing a Time Interval , 2015, Current Biology.

[26]  Marco Cuturi,et al.  Soft-DTW: a Differentiable Loss Function for Time-Series , 2017, ICML.

[27]  Daniel N. Hill,et al.  Primary Motor Cortex Reports Efferent Control of Vibrissa Motion on Multiple Timescales , 2011, Neuron.

[28]  Patrick O. Perry,et al.  Bi-cross-validation of the SVD and the nonnegative matrix factorization , 2009, 0908.2062.

[29]  Yevgeniy B. Sirotin,et al.  Sniff Invariant Odor Coding , 2017, eNeuro.

[30]  N. Hatsopoulos,et al.  Periodicity and Evoked Responses in Motor Cortex , 2010, The Journal of Neuroscience.

[31]  E. Pnevmatikakis,et al.  NoRMCorre: An online algorithm for piecewise rigid motion correction of calcium imaging data , 2017, Journal of Neuroscience Methods.

[32]  Christian K. Machens,et al.  Efficient codes and balanced networks , 2016, Nature Neuroscience.

[33]  Konrad P. Körding,et al.  Linear-nonlinear-time-warp-poisson models of neural activity , 2018, Journal of Computational Neuroscience.

[34]  Stephen I. Ryu,et al.  Neural Dynamics of Reaching following Incorrect or Absent Motor Preparation , 2014, Neuron.

[35]  Karl J. Friston,et al.  Mechanisms of evoked and induced responses in MEG/EEG , 2006, NeuroImage.

[36]  J. Donoghue,et al.  Oscillations in local field potentials of the primate motor cortex during voluntary movement. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[37]  M. London,et al.  Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex , 2010, Nature.

[38]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[39]  George L. Gerstein,et al.  Determination of Response Latency and Its Application to Normalization of Cross-Correlation Measures , 2001, Neural Computation.

[40]  Lee M. Miller,et al.  Measuring temporal dynamics of functional networks using phase spectrum of fMRI data , 2005, NeuroImage.

[41]  Jun Wang,et al.  On the Non-Trivial Generalization of Dynamic Time Warping to the Multi-Dimensional Case , 2015, SDM.

[42]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[43]  Devika Narain,et al.  Flexible timing by temporal scaling of cortical responses , 2017, Nature Neuroscience.

[44]  Rajesh Poddar,et al.  Automated long-term recording and analysis of neural activity in behaving animals , 2016 .

[45]  L. Paninski Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[46]  Surya Ganguli,et al.  On simplicity and complexity in the brave new world of large-scale neuroscience , 2015, Current Opinion in Neurobiology.

[47]  Partha P. Mitra,et al.  Sampling Properties of the Spectrum and Coherency of Sequences of Action Potentials , 2000, Neural Computation.

[48]  Ezequiel M. Arneodo,et al.  Stimulus dependent diversity and stereotypy in the output of an olfactory functional unit , 2017 .

[49]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[50]  Matthew T. Kaufman,et al.  The Largest Response Component in the Motor Cortex Reflects Movement Timing but Not Movement Type , 2016, eNeuro.

[51]  Naoshige Uchida,et al.  Robust Odor Coding via Inhalation-Coupled Transient Activity in the Mammalian Olfactory Bulb , 2010, Neuron.

[52]  Jose M Carmena,et al.  Neural oscillations: beta band activity across motor networks , 2015, Current Opinion in Neurobiology.

[53]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[54]  Jonathan E. Taylor,et al.  Interpretable whole-brain prediction analysis with GraphNet , 2013, NeuroImage.

[55]  Michael N. Shadlen,et al.  Comparison of decision-related signals in sensory and motor preparatory responses of neurons in Area LIP , 2017 .

[56]  Krishna V. Shenoy,et al.  Frequency Shifts and Depth Dependence of Premotor Beta Band Activity during Perceptual Decision-Making , 2018, The Journal of Neuroscience.

[57]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[58]  Romain Brette,et al.  Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain , 2015, Front. Syst. Neurosci..

[59]  A. Leonardo,et al.  Ensemble Coding of Vocal Control in Birdsong , 2005, The Journal of Neuroscience.

[60]  Zhe Chen,et al.  Advanced state space methods for neural and clinical data , 2015 .

[61]  M. A. MacIver,et al.  Neuroscience Needs Behavior: Correcting a Reductionist Bias , 2017, Neuron.

[62]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[63]  Lars Buesing,et al.  Estimating state and Parameters in state space Models of Spike trains , 2015 .

[64]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[65]  Mark A. Kramer,et al.  Rate-adjusted spike–LFP coherence comparisons from spike-train statistics , 2015, Journal of Neuroscience Methods.

[66]  M. Quirk,et al.  Representation of Spatial Goals in Rat Orbitofrontal Cortex , 2006, Neuron.

[67]  Liam Paninski,et al.  Computing Loss of Efficiency in Optimal Bayesian Decoders given Noisy or Incomplete Spike Trains , 2013 .

[68]  Valérie Ventura,et al.  Testing for and Estimating Latency Effects for Poisson and Non-Poisson Spike Trains , 2004, Neural Computation.

[69]  Supratim Ray Challenges in the quantification and interpretation of spike-LFP relationships , 2015, Current Opinion in Neurobiology.

[70]  Alexei A. Koulakov,et al.  A primacy code for odor identity , 2017, Nature Communications.

[71]  Tomás Gedeon,et al.  Dejittered Spike-Conditioned Stimulus Waveforms Yield Improved Estimates of Neuronal Feature Selectivity and Spike-Timing Precision of Sensory Interneurons , 2005, The Journal of Neuroscience.

[72]  Randy M Bruno,et al.  Synchrony in sensation , 2011, Current Opinion in Neurobiology.

[73]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[74]  Mingzhou Ding,et al.  Trial-by-trial estimation of amplitude and latency variability in neuronal spike trains , 2007, Journal of Neuroscience Methods.

[75]  Chethan Pandarinath,et al.  Inferring single-trial neural population dynamics using sequential auto-encoders , 2017 .

[76]  Ashesh K Dhawale,et al.  Motor Cortex Is Required for Learning but Not for Executing a Motor Skill , 2015, Neuron.

[77]  Surya Ganguli,et al.  Time-warped PCA : simultaneous alignment and dimensionality reduction of neural data , 2016 .

[78]  Zheng Zhang,et al.  Dynamic Time Warping under limited warping path length , 2017, Inf. Sci..

[79]  T. Gollisch Estimating receptive fields in the presence of spike-time jitter , 2006, Network.

[80]  S. Gershman,et al.  Dopamine reward prediction errors reflect hidden state inference across time , 2017, Nature Neuroscience.

[81]  Patrick O. Perry Cross -validation for unsupervised learning , 2009, 0909.3052.

[82]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[83]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[84]  Surya Ganguli,et al.  Unsupervised Discovery of Demixed, Low-Dimensional Neural Dynamics across Multiple Timescales through Tensor Component Analysis , 2017, Neuron.

[85]  Stephen J. Wright Coordinate descent algorithms , 2015, Mathematical Programming.

[86]  John P. Cunningham,et al.  Dynamical segmentation of single trials from population neural data , 2011, NIPS.