A point-process matched filter for event detection and decoding from population spike trains

OBJECTIVE Information encoding in neurons can be described through their response fields. The spatial response field (SRF) of a neuron is the region of space in which a sensory stimulus or a behavioral event causes that neuron to fire. Neurons can also exhibit temporal response fields (TRFs), which characterize a transient response to stimulus or behavioral event onsets. These neurons can thus be described by a spatio-temporal response field (STRF). The activity of neurons with STRFs can be well-described with point process models that characterize binary spike trains with an instantaneous firing rate that is a function of both time and space. However, developing decoders for point process models of neurons that exhibit TRFs is challenging because it requires prior knowledge of event onset times, which are unknown. Indeed, point process filters (PPF) to date have largely focused on decoding neuronal activity without considering TRFs. Also, neural classifiers have required data to be behavior- or stimulus-aligned, i.e., event times to be known, which is often not possible in real-world applications. Our objective in this work is to develop a viable decoder for neurons with STRFs when event times are unknown. METHOD To enable decoding of neurons with STRFs, we develop a novel point-process matched filter (PPMF) that can detect events and estimate their onset times from population spike trains. We also devise a PPF for neurons with transient responses as characterized by STRFs. When neurons exhibit STRFs and event times are unknown, the PPMF can be combined with the PPF or with discrete classifiers for continuous and discrete brain state decoding, respectively. MAIN RESULTS We validate our algorithm on two datasets: simulated spikes from neurons that encode visual saliency in response to stimuli, and prefrontal spikes recorded in a monkey performing a delayed-saccade task. We show that the PPMF can estimate the stimulus times and saccade times accurately. Further, the PPMF combined with the PPF can decode visual saliency maps without knowing the stimulus times. Similarly, the PPMF combined with a point process classifier can decode the saccade direction without knowing the saccade times. SIGNIFICANCE These event detection and decoding algorithms can help develop neurotechnologies to decode cognitive states from neural responses that exhibit STRFs.

[1]  Wei Xian,et al.  Social Calls Predict Foraging Success in Big Brown Bats , 2014, Current Biology.

[2]  J T McIlwain,et al.  Visual receptive fields and their images in superior colliculus of the cat. , 1975, Journal of neurophysiology.

[3]  A. Bhardwaj,et al.  In situ click chemistry generation of cyclooxygenase-2 inhibitors , 2017, Nature Communications.

[4]  Maryam M Shanechi,et al.  Brain-Machine Interface Control Algorithms. , 2017, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  Nitish V. Thakor,et al.  Task-Independent Cognitive State Transition Detection From Cortical Neurons During 3-D Reach-to-Grasp Movements , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Yuxiao Yang,et al.  Dynamic network modeling and dimensionality reduction for human ECoG activity , 2019, Journal of neural engineering.

[7]  Emery N. Brown,et al.  Neural population partitioning and a concurrent brain-machine interface for sequential motor function , 2012, Nature Neuroscience.

[8]  Yuxiao Yang,et al.  Mood variations decoded from multi-site intracranial human brain activity , 2018, Nature Biotechnology.

[9]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[10]  Bijan Pesaran,et al.  Temporal structure in neuronal activity during working memory in macaque parietal cortex , 2000, Nature Neuroscience.

[11]  J. Rodgers,et al.  Thirteen ways to look at the correlation coefficient , 1988 .

[12]  N. Hatsopoulos,et al.  Sensing with the Motor Cortex , 2011, Neuron.

[13]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[14]  Krishna V. Shenoy,et al.  Combining Decoder Design and Neural Adaptation in Brain-Machine Interfaces , 2014, Neuron.

[15]  R. Wurtz,et al.  Activity of superior colliculus in behaving monkey. I. Visual receptive fields of single neurons. , 1972, Journal of neurophysiology.

[16]  Leigh R. Hochberg,et al.  Review: Human Intracortical Recording and Neural Decoding for Brain–Computer Interfaces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Richard A. Andersen,et al.  Toward More Versatile and Intuitive Cortical Brain–Machine Interfaces , 2014, Current Biology.

[18]  Matthew A. Wilson,et al.  A Novel Nonparametric Approach for Neural Encoding and Decoding Models of Multimodal Receptive Fields , 2016, Neural Computation.

[19]  Ian H. Stevenson,et al.  Saliency and saccade encoding in the frontal eye field during natural scene search. , 2014, Cerebral cortex.

[20]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[21]  Jose M. Carmena,et al.  Robust Brain-Machine Interface Design Using Optimal Feedback Control Modeling and Adaptive Point Process Filtering , 2016, PLoS Comput. Biol..

[22]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[23]  A. Aertsen,et al.  The Spectro-Temporal Receptive Field , 1981, Biological Cybernetics.

[24]  S. Treue Visual attention: the where, what, how and why of saliency , 2003, Current Opinion in Neurobiology.

[25]  P. Sajda,et al.  Spatiotemporal Linear Decoding of Brain State , 2008, IEEE Signal Processing Magazine.

[26]  John P. Donoghue,et al.  Contribution of LFP dynamics to single-neuron spiking variability in motor cortex during movement execution , 2015, Front. Syst. Neurosci..

[27]  Martin D. Levine,et al.  Visual Saliency Based on Scale-Space Analysis in the Frequency Domain , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  L. Paninski,et al.  Inferring input nonlinearities in neural encoding models , 2008, Network.

[29]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[30]  S A Shamma,et al.  Spectro-temporal response field characterization with dynamic ripples in ferret primary auditory cortex. , 2001, Journal of neurophysiology.

[31]  Robert E. Kass,et al.  A Spike-Train Probability Model , 2001, Neural Computation.

[32]  C. Curtis,et al.  Multiple component networks support working memory in prefrontal cortex , 2015, Proceedings of the National Academy of Sciences.

[33]  Jose M. Carmena,et al.  Rapid control and feedback rates enhance neuroprosthetic control , 2017, Nature Communications.

[34]  N. V. Thakor,et al.  Translating the Brain-Machine Interface , 2013, Science Translational Medicine.

[35]  Stephen I. Ryu,et al.  A High-Performance Neural Prosthesis Incorporating Discrete State Selection With Hidden Markov Models , 2017, IEEE Transactions on Biomedical Engineering.

[36]  Bijan Pesaran,et al.  Multiscale modeling and decoding algorithms for spike-field activity , 2018, Journal of neural engineering.

[37]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[38]  Esko Valkeila,et al.  An Introduction to the Theory of Point Processes, Volume II: General Theory and Structure, 2nd Edition by Daryl J. Daley, David Vere‐Jones , 2008 .

[39]  Bijan Pesaran,et al.  A Method for Detection and Classification of Events in Neural Activity , 2006, IEEE Transactions on Biomedical Engineering.

[40]  Emery N. Brown,et al.  A parallel point-process filter for estimation of goal-directed movements from neural signals , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[41]  Maryam M Shanechi,et al.  A Multiscale Dynamical Modeling and Identification Framework for Spike-Field Activity , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  Michael E. Hasselmo,et al.  Decoding Movement Trajectories Through a T-Maze Using Point Process Filters Applied to Place Field Data from Rat Hippocampal Region CA1 , 2009, Neural Computation.

[43]  R. Marrocco,et al.  Monkey superior colliculus: properties of single cells and their afferent inputs. , 1977, Journal of neurophysiology.

[44]  Allison T. Connolly,et al.  A control-theoretic system identification framework and a real-time closed-loop clinical simulation testbed for electrical brain stimulation , 2018, Journal of neural engineering.

[45]  J. Donoghue,et al.  Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes , 2009, Nature Neuroscience.

[46]  J. Si,et al.  Closed-loop cortical control of direction using support vector machines , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  Emery N. Brown,et al.  Estimating a State-space Model from Point Process Observations Emery N. Brown , 2022 .

[48]  Laurent Itti,et al.  Linking visual response properties in the superior colliculus to saccade behavior , 2012, The European journal of neuroscience.

[49]  Paul Sajda,et al.  Brain-Computer Interfaces [from the guest editors] , 2008 .

[50]  C. Mehring,et al.  Inference of hand movements from local field potentials in monkey motor cortex , 2003, Nature Neuroscience.

[51]  R. Reid,et al.  Temporal Coding of Visual Information in the Thalamus , 2000, The Journal of Neuroscience.

[52]  Christof Koch,et al.  Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey , 1999, Neural Computation.

[53]  Han-Lin Hsieh,et al.  Optimizing the learning rate for adaptive estimation of neural encoding models , 2018, PLoS Comput. Biol..

[54]  Byron M. Yu,et al.  Neural constraints on learning , 2014, Nature.

[55]  Israel Bar-David,et al.  Communication under the Poisson regime , 1969, IEEE Trans. Inf. Theory.

[56]  Emery N. Brown,et al.  Dynamic Analysis of Neural Encoding by Point Process Adaptive Filtering , 2004, Neural Computation.

[57]  Luca Citi,et al.  Likelihood Methods for Point Processes with Refractoriness , 2014, Neural Computation.

[58]  Andrew B. Schwartz,et al.  Brain-Controlled Interfaces: Movement Restoration with Neural Prosthetics , 2006, Neuron.

[59]  M. R. Mehta,et al.  Role of experience and oscillations in transforming a rate code into a temporal code , 2002, Nature.

[60]  Christoph E Schreiner,et al.  Spectrotemporal structure of receptive fields in areas AI and AAF of mouse auditory cortex. , 2003, Journal of neurophysiology.

[61]  Ziv M. Williams,et al.  A Real-Time Brain-Machine Interface Combining Motor Target and Trajectory Intent Using an Optimal Feedback Control Design , 2013, PloS one.

[62]  Daniel Moran,et al.  Evolution of brain–computer interface: action potentials, local field potentials and electrocorticograms , 2010, Current Opinion in Neurobiology.

[63]  Vahid Tarokh,et al.  Classification of Local Field Potentials using Gaussian Sequence Model , 2018, 2018 IEEE Statistical Signal Processing Workshop (SSP).

[64]  John P. Donoghue,et al.  Bridging the Brain to the World: A Perspective on Neural Interface Systems , 2008, Neuron.

[65]  R. Ptak The Frontoparietal Attention Network of the Human Brain , 2012, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[66]  Maryam M. Shanechi,et al.  Estimating Multiscale Direct Causality Graphs in Neural Spike-Field Networks , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[67]  Chun-I Yeh,et al.  Temporal precision in the neural code and the timescales of natural vision , 2007, Nature.

[68]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[69]  Yuxiao Yang,et al.  An adaptive and generalizable closed-loop system for control of medically induced coma and other states of anesthesia , 2016, Journal of neural engineering.

[70]  Paul Nuyujukian,et al.  A high performing brain–machine interface driven by low-frequency local field potentials alone and together with spikes , 2015, bioRxiv.

[71]  G. H. Do¨rrscheidt The statistical significance of the peristimulus time histogram (PSTH) , 1981, Brain Research.

[72]  Jillian H. Fecteau,et al.  Correlates of Capture of Attention and Inhibition of Return across Stages of Visual Processing , 2005, Journal of Cognitive Neuroscience.

[73]  Arjun K. Bansal,et al.  Decoding 3D reach and grasp from hybrid signals in motor and premotor cortices: spikes, multiunit activity, and local field potentials. , 2012, Journal of neurophysiology.

[74]  G B Stanley,et al.  Design strategies for dynamic closed-loop optogenetic neurocontrol in vivo , 2018, Journal of neural engineering.

[75]  Byron M. Yu,et al.  Detecting neural-state transitions using hidden Markov models for motor cortical prostheses. , 2008, Journal of neurophysiology.

[76]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[77]  Jennifer M. Groh,et al.  Distribution of visual and saccade related information in the monkey inferior colliculus , 2012, Front. Neural Circuits.

[78]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[79]  Emery N. Brown,et al.  The Time-Rescaling Theorem and Its Application to Neural Spike Train Data Analysis , 2002, Neural Computation.

[80]  Bijan Pesaran,et al.  Sparse model-based estimation of functional dependence in high-dimensional field and spike multiscale networks , 2019, Journal of neural engineering.

[81]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[82]  Laurent Itti,et al.  Superior colliculus neurons encode a visual saliency map during free viewing of natural dynamic video , 2017, Nature Communications.

[83]  Bijan Pesaran,et al.  Investigating large-scale brain dynamics using field potential recordings: analysis and interpretation , 2018, Nature Neuroscience.

[84]  M. Cynader,et al.  Receptive-field organization of monkey superior colliculus. , 1972, Journal of neurophysiology.

[85]  I. Ohzawa,et al.  Receptive-field dynamics in the central visual pathways , 1995, Trends in Neurosciences.

[86]  Liam Paninski,et al.  Population decoding of motor cortical activity using a generalized linear model with hidden states , 2010, Journal of Neuroscience Methods.