Single-trial dynamics of motor cortex and their applications to brain-machine interfaces

Increasing evidence suggests that neural population responses have their own internal drive, or dynamics, that describe how the neural population evolves through time. An important prediction of neural dynamical models is that previously observed neural activity is informative of noisy yet-to-be-observed activity on single-trials, and may thus have a denoising effect. To investigate this prediction, we built and characterized dynamical models of single-trial motor cortical activity. We find these models capture salient dynamical features of the neural population and are informative of future neural activity on single trials. To assess how neural dynamics may beneficially denoise single-trial neural activity, we incorporate neural dynamics into a brain–machine interface (BMI). In online experiments, we find that a neural dynamical BMI achieves substantially higher performance than its non-dynamical counterpart. These results provide evidence that neural dynamics beneficially inform the temporal evolution of neural activity on single trials and may directly impact the performance of BMIs.

[1]  Paul Nuyujukian,et al.  Intention estimation in brain–machine interfaces , 2014, Journal of neural engineering.

[2]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[3]  N. Sigala,et al.  Dynamic Coding for Cognitive Control in Prefrontal Cortex , 2013, Neuron.

[4]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[5]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[6]  Geoffrey E. Hinton,et al.  Parameter estimation for linear dynamical systems , 1996 .

[7]  Paul Nuyujukian,et al.  Performance sustaining intracortical neural prostheses , 2014, Journal of neural engineering.

[8]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[9]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[10]  Kevin L. Briggman,et al.  Multifunctional pattern-generating circuits. , 2008, Annual review of neuroscience.

[11]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[12]  Surya Ganguli,et al.  Investigating the role of firing-rate normalization and dimensionality reduction in brain-machine interface robustness , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[13]  Maneesh Sahani,et al.  Learning stable, regularised latent models of neural population dynamics , 2012, Network.

[14]  Christian K. Machens,et al.  Demixing Population Activity in Higher Cortical Areas , 2009, Front. Comput. Neurosci..

[15]  Wei Wu,et al.  Neural Decoding of Hand Motion Using a Linear State-Space Model With Hidden States , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Gopal Santhanam,et al.  Preparatory activity in premotor and motor cortex reflects the speed of the upcoming reach. , 2006, Journal of neurophysiology.

[17]  Matthew T. Kaufman,et al.  Supplementary materials for : Cortical activity in the null space : permitting preparation without movement , 2014 .

[18]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[19]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[20]  John P. Cunningham,et al.  Empirical models of spiking in neural populations , 2011, NIPS.

[21]  Stephen I. Ryu,et al.  Neural Dynamics of Reaching following Incorrect or Absent Motor Preparation , 2014, Neuron.

[22]  Stephen I. Ryu,et al.  A High-Performance Keyboard Neural Prosthesis Enabled by Task Optimization , 2015, IEEE Transactions on Biomedical Engineering.

[23]  John P. Cunningham,et al.  Dynamical segmentation of single trials from population neural data , 2011, NIPS.

[24]  Byron M. Yu,et al.  Factor-analysis methods for higher-performance neural prostheses. , 2009, Journal of neurophysiology.

[25]  David Sussillo,et al.  A recurrent neural network for closed-loop intracortical brain–machine interface decoders , 2012, Journal of neural engineering.

[26]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[27]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[28]  V. Jayaraman,et al.  Encoding and Decoding of Overlapping Odor Sequences , 2006, Neuron.

[29]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[30]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[31]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[32]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[33]  Haim Sompolinsky,et al.  How the Brain Generates Movement , 2012, Neural Computation.

[34]  Byron M. Yu,et al.  Single-Trial Neural Correlates of Arm Movement Preparation , 2011, Neuron.

[35]  Gilles Laurent,et al.  Transient Dynamics for Neural Processing , 2008, Science.

[36]  W. Gerstner,et al.  Optimal Control of Transient Dynamics in Balanced Networks Supports Generation of Complex Movements , 2014, Neuron.

[37]  Kevin L. Briggman,et al.  Optical Imaging of Neuronal Populations During Decision-Making , 2005, Science.

[38]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[39]  Emilio Salinas,et al.  Vector reconstruction from firing rates , 1994, Journal of Computational Neuroscience.

[40]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[41]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[42]  M. Sahani,et al.  Cortical control of arm movements: a dynamical systems perspective. , 2013, Annual review of neuroscience.

[43]  J. Donoghue,et al.  Primary Motor Cortex Tuning to Intended Movement Kinematics in Humans with Tetraplegia , 2008, The Journal of Neuroscience.

[44]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[45]  S. Meagher Instant neural control of a movement signal , 2002 .

[46]  Krishna V. Shenoy,et al.  Information Systems Opportunities in Brain–Machine Interface Decoders , 2014, Proceedings of the IEEE.

[47]  V. Jayaraman,et al.  Intensity versus Identity Coding in an Olfactory System , 2003, Neuron.

[48]  K. Shenoy,et al.  Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. , 2007, Journal of neurophysiology.

[49]  Krishna V. Shenoy,et al.  Monkey models for brain-machine interfaces: The need for maintaining diversity , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[50]  Michael J. Black,et al.  A switching Kalman filter model for the motor cortical coding of hand motion , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[51]  Chethan Pandarinath,et al.  Neural population dynamics in human motor cortex during movements in people with ALS , 2015, eLife.

[52]  Vikash Gilja,et al.  A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. , 2011, Journal of neurophysiology.

[53]  Byron M. Yu,et al.  Neural constraints on learning , 2014, Nature.