Linear-Nonlinear-Time-Warp-Poisson models of neural activity

Prominent models of spike trains assume only one source of variability – stochastic (Poisson) spiking – when stimuli and behavior are fixed. However, spike trains may also reflect variability due to internal processes such as planning. For example, we can plan a movement at one point in time and execute it at some arbitrary later time. Neurons involved in planning may thus share an underlying time-course that is not precisely locked to the actual movement. Here we combine the standard Linear-Nonlinear-Poisson (LNP) model with Dynamic Time Warping (DTW) to account for shared temporal variability. When applied to recordings from macaque premotor cortex, we find that time warping considerably improves predictions of neural activity. We suggest that such temporal variability is a widespread phenomenon in the brain which should be modeled.

[1]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[2]  Joshua I Glaser,et al.  Feature-based attention and spatial selection in frontal eye fields during natural scene search. , 2016, Journal of neurophysiology.

[3]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[4]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[5]  G. Gerstein,et al.  Trial-to-Trial Variability and State-Dependent Modulation of Auditory-Evoked Responses in Cortex , 1999, The Journal of Neuroscience.

[6]  J. Victor,et al.  Nature and precision of temporal coding in visual cortex: a metric-space analysis. , 1996, Journal of neurophysiology.

[7]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[8]  T. Gollisch.  Estimating receptive fields in the presence of spike-time jitter , 2006, Network.

[9]  Liam Paninski,et al.  Population decoding of motor cortical activity using a generalized linear model with hidden states , 2010, Journal of Neuroscience Methods.

[10]  Nicholas A. Steinmetz,et al.  Diverse coupling of neurons to populations in sensory cortex , 2015, Nature.

[11]  M. Carandini,et al.  The Nature of Shared Cortical Variability , 2015, Neuron.

[12]  Robert E. Kass,et al.  Trial time warping to discriminate stimulus-related from movement-related neural activity , 2013, Journal of Neuroscience Methods.

[13]  Eero P. Simoncelli,et al.  Attention stabilizes the shared gain of V4 populations , 2015, eLife.

[14]  J. Kalaska,et al.  Prior information in motor and premotor cortex: activity during the delay period and effect on pre-movement activity. , 2000, Journal of neurophysiology.

[15]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[16]  J. Sweatt,et al.  Memory-Associated Dynamic Regulation of the “Stable” Core of the Chromatin Particle , 2015, Neuron.

[17]  Robert E Kass,et al.  Trial-to-trial variability and its effect on time-varying dependency between two neurons. , 2005, Journal of neurophysiology.

[18]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[19]  Ian H. Stevenson,et al.  Saliency and saccade encoding in the frontal eye field during natural scene search. , 2014, Cerebral cortex.

[20]  Tomás Gedeon,et al.  Temporal Encoding in a Nervous System , 2011, PLoS Comput. Biol..

[21]  David Pfau,et al.  Robust learning of low-dimensional dynamics from large neural ensembles , 2013, NIPS.

[22]  B. Knight,et al.  Response variability and timing precision of neuronal spike trains in vivo. , 1997, Journal of neurophysiology.

[23]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[24]  G D Lewen,et al.  Reproducibility and Variability in Neural Spike Trains , 1997, Science.

[25]  A. Haith,et al.  Independence of Movement Preparation and Movement Initiation , 2016, The Journal of Neuroscience.

[26]  Jonathan W. Pillow,et al.  Single-trial spike trains in parietal cortex reveal discrete steps during decision-making , 2015, Science.

[27]  A J Fuglevand,et al.  Estimating the strength of common input to human motoneurons from the cross‐correlogram. , 1992, The Journal of physiology.

[28]  R. Wurtz.  Visual receptive fields of striate cortex neurons in awake monkeys. , 1969, Journal of neurophysiology.

[29]  Konrad P. Körding,et al.  Functional Connectivity and Tuning Curves in Populations of Simultaneously Recorded Neurons , 2012, PLoS Comput. Biol..

[30]  Eero P. Simoncelli,et al.  Modeling the Impact of Common Noise Inputs on the Network Activity of Retinal Ganglion Cells Action Editor: Brent Doiron , 2022 .

[31]  Robert E Kass,et al.  Latent Inputs Improve Estimates of Neural Encoding in Motor Cortex , 2010, The Journal of Neuroscience.

[32]  Jonathan D Victor,et al.  Spike train metrics , 2005, Current Opinion in Neurobiology.

[33]  Zengcai V. Guo,et al.  Maintenance of persistent activity in a frontal thalamocortical loop , 2017, Nature.

[34]  R H Wurtz,et al.  Comparison of effects of eye movements and stimulus movements on striate cortex neurons of the monkey. , 1969, Journal of neurophysiology.

[35]  Tomás Gedeon,et al.  Dejittered Spike-Conditioned Stimulus Waveforms Yield Improved Estimates of Neuronal Feature Selectivity and Spike-Timing Precision of Sensory Interneurons , 2005, The Journal of Neuroscience.

[36]  Byron M. Yu,et al.  Extracting Low-Dimensional Latent Structure from Time Series in the Presence of Delays , 2015, Neural Computation.

[37]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[38]  Maneesh Sahani,et al.  Learning stable, regularised latent models of neural population dynamics , 2012, Network.

[39]  Jude F. Mitchell,et al.  Spatial Attention Decorrelates Intrinsic Activity Fluctuations in Macaque Area V4 , 2009, Neuron.

[40]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[41]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[42]  Lee E Miller,et al.  Inferring functional connections between neurons , 2008, Current Opinion in Neurobiology.

[43]  John F. Kalaska,et al.  Neural correlates of mental rehearsal in dorsal premotor cortex , 2004, Nature.

[44]  M. Sahani,et al.  Cortical control of arm movements: a dynamical systems perspective. , 2013, Annual review of neuroscience.

[45]  Sepp Kollmorgen,et al.  Dynamic Alignment Models for Neural Coding , 2014, PLoS Comput. Biol..

[46]  K. Shenoy,et al.  Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. , 2007, Journal of neurophysiology.

[47]  S. Wise,et al.  A neurophysiological study of the premotor cortex in the rhesus monkey. , 1984, Brain : a journal of neurology.

[48]  M. Carandini.  Amplification of Trial-to-Trial Response Variability by Neurons in Visual Cortex , 2004, PLoS biology.

[49]  Markus Siegel,et al.  Cortical information flow during flexible sensorimotor decisions , 2015, Science.

[50]  C. Legay,et al.  ColQ Controls Postsynaptic Differentiation at the Neuromuscular Junction , 2010, The Journal of Neuroscience.

[51]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.