Trial time warping to discriminate stimulus-related from movement-related neural activity

In tasks where different sensory, cognitive, and motor events are mixed in a sequence it is difficult to determine whether neural activity is related to any behavioral parameter. Here, we consider the case in which two alternative trial-alignment schemes correspond to two different neural representations, one stimulus-related and the other movement-related, using both simulations of neural activity and real recordings in the medial premotor areas during a multiple-interval tapping task called synchronization-continuation task (SCT). To discover whether neural responses are better aligned to sensory or motor events we introduce a family of trial-alignment time-warping functions indexed by a single parameter such that when the parameter takes the value 0 the trials are aligned to the stimulus and when the parameter takes the value 1 they are aligned to the movement. We then characterize neurons by the best-fitting alignment scheme (in the sense of maximum likelihood) under the assumption that the correct alignment would produce homogeneous trials without excess trial-to-trial variation. We use Bayes factors to determine the evidence in favor of sensory or motor neural alignments. The simulations revealed that the variability in neural responses and sequential motor outputs are key parameters to obtain appropriate warping results. In addition, the analysis on the activity of 500 neurons in the medial premotor areas of monkeys executing the SCT showed that most of the neural responses (54.2%) were aligned to the tapping movements instead of the stimuli used to drive the temporal behavior.

[1]  Hugo Merchant,et al.  Do we have a common mechanism for measuring time in the hundreds of millisecond range? Evidence from multiple-interval timing tasks. , 2008, Journal of neurophysiology.

[2]  R. Romo,et al.  Frequency discrimination in the sense of flutter: psychophysical measurements correlated with postcentral events in behaving monkeys , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Tom Lodewyckx,et al.  A tutorial on Bayes factor estimation with the product space method , 2011 .

[4]  Mriganka Sur,et al.  Hierarchical Bayesian modeling and Markov chain Monte Carlo sampling for tuning-curve analysis. , 2010, Journal of neurophysiology.

[5]  Daeyeol Lee,et al.  Activity in prefrontal cortex during dynamic selection of action sequences , 2006, Nature Neuroscience.

[6]  J. Tanji.  Sequential organization of multiple movements: involvement of cortical motor areas. , 2001, Annual review of neuroscience.

[7]  A P Georgopoulos,et al.  Effects of optic flow in motor cortex and area 7a. , 2001, Journal of neurophysiology.

[8]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Arthur C. Sanderson,et al.  Adaptive Filtering of Neuronal Spike Train Data , 1980, IEEE Transactions on Biomedical Engineering.

[10]  G E Alexander,et al.  Movement-related neuronal activity selectively coding either direction or muscle pattern in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[11]  Kae Nakamura,et al.  Neuronal activity in medial frontal cortex during learning of sequential procedures. , 1998, Journal of neurophysiology.

[12]  P H Ellaway,et al.  Cumulative sum technique and its application to the analysis of peristimulus time histograms. , 1978, Electroencephalography and clinical neurophysiology.

[13]  Karl J. Friston,et al.  Comparing dynamic causal models , 2004, NeuroImage.

[14]  Timothy E. J. Behrens,et al.  Neural Mechanisms of Foraging , 2012, Science.

[15]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[16]  V. Mountcastle,et al.  Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space. , 1975, Journal of neurophysiology.

[17]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[18]  B. Repp.  Sensorimotor synchronization: A review of the tapping literature , 2005, Psychonomic bulletin & review.

[19]  R. Romo,et al.  Categorization of somaesthetic stimuli: sensorimotor performance and neuronal activity in primary somatic sensory cortex of awake monkeys. , 1996, Neuroreport.

[20]  S Bestmann,et al.  Bayesian Model Selection Maps for Group Studies , 2009, NeuroImage.

[21]  A. Kristofferson,et al.  Response delays and the timing of discrete motor responses , 1973 .

[22]  Stefan Rotter,et al.  Elimination of response latency variability in neuronal spike trains , 2003, Biological Cybernetics.

[23]  Daeyeol Lee,et al.  Activity in the supplementary motor area related to learning and performance during a sequential visuomotor task. , 2003, Journal of neurophysiology.

[24]  Hugo Merchant,et al.  Measuring time with different neural chronometers during a synchronization-continuation task , 2011, Proceedings of the National Academy of Sciences.

[25]  Wei Wu,et al.  Coupling time decoding and trajectory decoding using a target-included model in the motor cortex , 2012, Neurocomputing.

[26]  George L. Gerstein,et al.  Determination of Response Latency and Its Application to Normalization of Cross-Correlation Measures , 2001, Neural Computation.

[27]  J. Bullier,et al.  Visual latencies in areas V1 and V2 of the macaque monkey , 1995, Visual Neuroscience.

[28]  Roger Salamon,et al.  A statistical method for the estimation of neuronal response latency and its functional interpretation , 1983, Brain Research.

[29]  A. P. Georgopoulos,et al.  Variability and Correlated Noise in the Discharge of Neurons in Motor and Parietal Areas of the Primate Cortex , 1998, The Journal of Neuroscience.

[30]  Xiaoqin Wang,et al.  Neural representations of sinusoidal amplitude and frequency modulations in the primary auditory cortex of awake primates. , 2002, Journal of neurophysiology.

[31]  A. Georgopoulos,et al.  Neural responses during interception of real and apparent circularly moving stimuli in motor cortex and area 7a. , 2004, Cerebral cortex.

[32]  Hugo Merchant,et al.  Subsecond timing in primates: comparison of interval production between human subjects and rhesus monkeys. , 2009, Journal of neurophysiology.

[33]  Valérie Ventura,et al.  Testing for and Estimating Latency Effects for Poisson and Non-Poisson Spike Trains , 2004, Neural Computation.

[34]  C. J. Stone,et al.  Optimal Global Rates of Convergence for Nonparametric Regression , 1982 .

[35]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[36]  C. Gallistel,et al.  The Importance of Proving the Null , 2022 .

[37]  Nicholas G Hatsopoulos,et al.  Template-based spike pattern identification with linear convolution and dynamic time warping. , 2007, Journal of neurophysiology.

[38]  T. Gasser,et al.  Synchronizing sample curves nonparametrically , 1999 .

[39]  Sarah M N Woolley,et al.  Early experience shapes vocal neural coding and perception in songbirds. , 2012, Developmental psychobiology.

[40]  Bruno B Averbeck,et al.  Representing spatial relationships in posterior parietal cortex: single neurons code object-referenced position. , 2007, Cerebral cortex.

[41]  R. Stein,et al.  Statistical limits for detecting change in the cumulative sum derivative of the peristimulus time histogram , 1986, Journal of Neuroscience Methods.