Dynamic network modeling and dimensionality reduction for human ECoG activity

OBJECTIVE Developing dynamic network models for multisite electrocorticogram (ECoG) activity can help study neural representations and design neurotechnologies in humans given the clinical promise of ECoG. However, dynamic network models have so far largely focused on spike recordings rather than ECoG. A dynamic network model for ECoG recordings, which constitute a network, should describe their temporal dynamics while also achieving dimensionality reduction given the inherent spatial and temporal correlations. APPROACH We devise both linear and nonlinear dynamic models for ECoG power features and comprehensively evaluate their accuracy in predicting feature dynamics. Linear state-space models (LSSMs) provide a general linear dynamic network model and can simultaneously achieve dimensionality reduction by describing high-dimensional signals in terms of a low-dimensional latent state. We thus study whether and how well LSSMs can predict ECoG dynamics and achieve dimensionality reduction. Further, we fit a general family of nonlinear dynamic models termed radial basis function (RBF) auto-regressive (AR) models for ECoG to study how the linear form of LSSMs affects the prediction of ECoG dynamics. Finally, we study the differences in dynamics and predictability of ECoG power features across different frequency bands. We use both numerical simulations and large-scale ECoG activity recorded from 10 human epilepsy subjects to evaluate the models. RESULTS First, we find that LSSMs can significantly predict the dynamics of ECoG power features using latent states with a much lower dimension compared to the number of features. Second, compared with LSSMs, nonlinear RBF-AR models do not improve the prediction of human ECoG power features, thus suggesting the usefulness of the linear assumption in describing ECoG dynamics. Finally, compared with other frequency bands, the dynamics of ECoG power features in 1-8 Hz (delta+theta) can be predicted significantly better and is more dominated by slow dynamics. SIGNIFICANCE Our results suggest that LSSMs with low-dimensional latent states can capture important dynamics in human large-scale ECoG power features, thus achieving dynamic modeling and dimensionality reduction. These results have significant implications for studying human brain function and dysfunction and for future design of closed-loop neurotechnologies for decoding and stimulation.

[1]  Min Gan,et al.  A locally linear RBF network-based state-dependent AR model for nonlinear time series modeling , 2010, Inf. Sci..

[2]  N. V. Thakor,et al.  Translating the Brain-Machine Interface , 2013, Science Translational Medicine.

[3]  H. Yokoi,et al.  Electrocorticographic control of a prosthetic arm in paralyzed patients , 2012, Annals of neurology.

[4]  Maryam M Shanechi,et al.  A Multiscale Dynamical Modeling and Identification Framework for Spike-Field Activity , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  John P. Cunningham,et al.  Dynamical segmentation of single trials from population neural data , 2011, NIPS.

[6]  T. Harmony The functional significance of delta oscillations in cognitive processing , 2013, Front. Integr. Neurosci..

[7]  A. Engel,et al.  Invasive recordings from the human brain: clinical insights and beyond , 2005, Nature Reviews Neuroscience.

[8]  E. Basar,et al.  Gamma, alpha, delta, and theta oscillations govern cognitive processes. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  E. Bizzi,et al.  Motor Learning with Unstable Neural Representations , 2007, Neuron.

[10]  Krishna V. Shenoy,et al.  Combining Decoder Design and Neural Adaptation in Brain-Machine Interfaces , 2014, Neuron.

[11]  Edward F. Chang,et al.  Towards Large-Scale, Human-Based, Mesoscopic Neurotechnologies , 2015, Neuron.

[12]  M. Priestley STATE‐DEPENDENT MODELS: A GENERAL APPROACH TO NON‐LINEAR TIME SERIES ANALYSIS , 1980 .

[13]  Andrew B. Schwartz,et al.  Brain-Controlled Interfaces: Movement Restoration with Neural Prosthetics , 2006, Neuron.

[14]  E. Halgren,et al.  Superficial Slow Rhythms Integrate Cortical Processing in Humans , 2017, Scientific Reports.

[15]  John P. Cunningham,et al.  Single-trial dynamics of motor cortex and their applications to brain-machine interfaces , 2015, Nature Communications.

[16]  Allison T. Connolly,et al.  A control-theoretic system identification framework and a real-time closed-loop clinical simulation testbed for electrical brain stimulation , 2018, Journal of neural engineering.

[17]  C. Koch,et al.  The origin of extracellular fields and currents — EEG, ECoG, LFP and spikes , 2012, Nature Reviews Neuroscience.

[18]  M. Breakspear Dynamic models of large-scale brain activity , 2017, Nature Neuroscience.

[19]  J. Donoghue,et al.  Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes , 2009, Nature Neuroscience.

[20]  Mikhail A. Lebedev,et al.  Chronic, Wireless Recordings of Large Scale Brain Activity in Freely Moving Rhesus Monkeys , 2014, Nature Methods.

[21]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[22]  G. Schalk,et al.  Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans , 2011, Journal of neural engineering.

[23]  Yuxiao Yang,et al.  Mood variations decoded from multi-site intracranial human brain activity , 2018, Nature Biotechnology.

[24]  Annamaria Bianchi,et al.  Basal ganglia local field potentials: applications in the development of new deep brain stimulation devices for movement disorders , 2007, Expert review of medical devices.

[25]  John P. Cunningham,et al.  Empirical models of spiking in neural populations , 2011, NIPS.

[26]  M. Morrell Responsive cortical stimulation for the treatment of medically intractable partial epilepsy , 2011, Neurology.

[27]  P. Sajda,et al.  Spatiotemporal Linear Decoding of Brain State , 2008, IEEE Signal Processing Magazine.

[28]  D. Dougherty,et al.  Closing the Loop on Deep Brain Stimulation for Treatment-Resistant Depression , 2018, Front. Neurosci..

[29]  Jose M. Carmena,et al.  Rapid control and feedback rates enhance neuroprosthetic control , 2017, Nature Communications.

[30]  N. Mesgarani,et al.  Selective cortical representation of attended speaker in multi-talker speech perception , 2012, Nature.

[31]  Y. Benjamini,et al.  Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics , 1999 .

[32]  Tohru Ozaki,et al.  Reconstructing the Nonlinear Dynamics of Epilepsy Data Using Nonlinear Time series Analysis , 1999 .

[33]  B. Anderson,et al.  Model reduction for control system design , 1984 .

[34]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[35]  Emery N. Brown,et al.  Neural population partitioning and a concurrent brain-machine interface for sequential motor function , 2012, Nature Neuroscience.

[36]  A. Priori,et al.  Adaptive deep brain stimulation (aDBS) controlled by local field potential oscillations , 2013, Experimental Neurology.

[37]  Maryam M Shanechi,et al.  Brain-Machine Interface Control Algorithms. , 2017, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[38]  Andreas Schulze-Bonhage,et al.  Decoding natural grasp types from human ECoG , 2012, NeuroImage.

[39]  Gerwin Schalk,et al.  ECoG-Based BCIs , 2018 .

[40]  N. Thakor,et al.  Electrocorticographic amplitude predicts finger positions during slow grasping motions of the hand , 2010, Journal of neural engineering.

[41]  Yuxiao Yang,et al.  Dynamic tracking of non-stationarity in human ECoG activity , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[42]  B. Moor,et al.  Subspace identification for linear systems , 1996 .

[43]  Robert E. Hampson,et al.  Sparse Large-Scale Nonlinear Dynamical Modeling of Human Hippocampus for Memory Prostheses , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Katsuhiko Ogata,et al.  Modern Control Engineering , 1970 .

[45]  Ronald G. García,et al.  Complexity Variability Assessment of Nonlinear Time-Varying Cardiovascular Control , 2017, Scientific Reports.

[46]  Bijan Pesaran,et al.  Multiscale modeling and decoding algorithms for spike-field activity , 2018, Journal of neural engineering.

[47]  J. A. Wilson,et al.  Two-dimensional movement control using electrocorticographic signals in humans , 2008, Journal of neural engineering.

[48]  Byron M. Yu,et al.  Single-Trial Neural Correlates of Arm Movement Preparation , 2011, Neuron.

[49]  N. Hatsopoulos,et al.  Sensing with the Motor Cortex , 2011, Neuron.

[50]  Robert D Flint,et al.  Direct classification of all American English phonemes using signals from functional speech motor cortex , 2014, Journal of neural engineering.

[51]  Zhaoyun Shi,et al.  Nonlinear time series modelling with the radial basis function-based state-dependent autoregressive model , 1999, Int. J. Syst. Sci..

[52]  Jose M. Carmena,et al.  Robust Brain-Machine Interface Design Using Optimal Feedback Control Modeling and Adaptive Point Process Filtering , 2016, PLoS Comput. Biol..

[53]  Yuan Zhao,et al.  Variational Latent Gaussian Process for Recovering Single-Trial Dynamics from Population Spike Trains , 2016, Neural Computation.

[54]  W. Singer,et al.  Modulation of Neuronal Interactions Through Neuronal Synchronization , 2007, Science.

[55]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[56]  Kapil D. Katyal,et al.  Individual finger control of a modular prosthetic limb using high-density electrocorticography in a human subject , 2016, Journal of neural engineering.

[57]  Mehdi Aghagolzadeh,et al.  Inference and Decoding of Motor Cortex Low-Dimensional Dynamics via Latent State-Space Models , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[58]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[59]  G. Buzsáki Large-scale recording of neuronal ensembles , 2004, Nature Neuroscience.

[60]  Naoshige Uchida,et al.  Demixed principal component analysis of neural population data , 2014, eLife.

[61]  G B Stanley,et al.  Design strategies for dynamic closed-loop optogenetic neurocontrol in vivo , 2018, Journal of neural engineering.

[62]  Gerwin Schalk,et al.  Dynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening , 2012, NeuroImage.

[63]  Andrey Eliseyev,et al.  Penalized Multi-Way Partial Least Squares for Smooth Trajectory Decoding from Electrocorticographic (ECoG) Recording , 2016, PloS one.

[64]  Naotaka Fujii,et al.  Decoding continuous three-dimensional hand trajectories from epidural electrocorticographic signals in Japanese macaques , 2012, Journal of neural engineering.

[65]  Chethan Pandarinath,et al.  Inferring single-trial neural population dynamics using sequential auto-encoders , 2017, Nature Methods.

[66]  Stephen T. Foldes,et al.  Remapping cortical modulation for electrocorticographic brain–computer interfaces: a somatotopy-based approach in individuals with upper-limb paralysis , 2018, Journal of neural engineering.

[67]  Leigh R. Hochberg,et al.  Review: Human Intracortical Recording and Neural Decoding for Brain–Computer Interfaces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[68]  Bijan Pesaran,et al.  Investigating large-scale brain dynamics using field potential recordings: analysis and interpretation , 2018, Nature Neuroscience.

[69]  Robert T Knight,et al.  Intracranial recordings and human memory , 2015, Current Opinion in Neurobiology.

[70]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[71]  Sagi Perel,et al.  Single-unit activity, threshold crossings, and local field potentials in motor cortex differentially encode reach kinematics. , 2015, Journal of neurophysiology.

[72]  Andreas Schulze-Bonhage,et al.  Prediction of arm movement trajectories from ECoG-recordings in humans , 2008, Journal of Neuroscience Methods.

[73]  Geertjan Huiskamp,et al.  Neocortical electrical stimulation for epilepsy: Closed-loop versus open-loop , 2018, Epilepsy Research.

[74]  Kristofer E. Bouchard,et al.  Functional Organization of Human Sensorimotor Cortex for Speech Articulation , 2013, Nature.

[75]  Maryam M. Shanechi,et al.  Estimating Multiscale Direct Causality Graphs in Neural Spike-Field Networks , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[76]  Bijan Pesaran,et al.  Coherent neuronal ensembles are rapidly recruited when making a look-reach decision , 2015, Nature Neuroscience.

[77]  L. Carin,et al.  Relationship between intracortical electrode design and chronic recording function. , 2013, Biomaterials.

[78]  Yukihiro Toyoda,et al.  A parameter optimization method for radial basis function type models , 2003, IEEE Trans. Neural Networks.

[79]  Kelvin So,et al.  Subject-specific modulation of local field potential spectral power during brain–machine interface control in primates , 2014, Journal of neural engineering.

[80]  L. Frank,et al.  Behavioral/Systems/Cognitive Hippocampal Plasticity across Multiple Days of Exposure to Novel Environments , 2022 .

[81]  Mirela V. Simon,et al.  Neural encoding and production of functional morphemes in the posterior temporal lobe , 2018, Nature Communications.

[82]  Robin C. Ashmore,et al.  An Electrocorticographic Brain Interface in an Individual with Tetraplegia , 2013, PloS one.

[83]  Yuxiao Yang,et al.  An adaptive and generalizable closed-loop system for control of medically induced coma and other states of anesthesia , 2016, Journal of neural engineering.

[84]  Han-Lin Hsieh,et al.  Optimizing the learning rate for adaptive estimation of neural encoding models , 2018, PLoS Comput. Biol..

[85]  Bijan Pesaran,et al.  Differential roles of high gamma and local motor potentials for movement preparation and execution , 2016 .

[86]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[87]  Daniel Moran,et al.  Evolution of brain–computer interface: action potentials, local field potentials and electrocorticograms , 2010, Current Opinion in Neurobiology.

[88]  Luca Citi,et al.  A Real-Time Automated Point-Process Method for the Detection and Correction of Erroneous and Ectopic Heartbeats , 2012, IEEE Transactions on Biomedical Engineering.

[89]  A. Beuter,et al.  Closed-loop cortical neuromodulation in Parkinson’s disease: An alternative to deep brain stimulation? , 2014, Clinical Neurophysiology.

[90]  Byron M. Yu,et al.  Neural constraints on learning , 2014, Nature.