Augmenting intracortical brain-machine interface with neurally driven error detectors

OBJECTIVE Making mistakes is inevitable, but identifying them allows us to correct or adapt our behavior to improve future performance. Current brain-machine interfaces (BMIs) make errors that need to be explicitly corrected by the user, thereby consuming time and thus hindering performance. We hypothesized that neural correlates of the user perceiving the mistake could be used by the BMI to automatically correct errors. However, it was unknown whether intracortical outcome error signals were present in the premotor and primary motor cortices, brain regions successfully used for intracortical BMIs. APPROACH We report here for the first time a putative outcome error signal in spiking activity within these cortices when rhesus macaques performed an intracortical BMI computer cursor task. MAIN RESULTS We decoded BMI trial outcomes shortly after and even before a trial ended with 96% and 84% accuracy, respectively. This led us to develop and implement in real-time a first-of-its-kind intracortical BMI error 'detect-and-act' system that attempts to automatically 'undo' or 'prevent' mistakes. The detect-and-act system works independently and in parallel to a kinematic BMI decoder. In a challenging task that resulted in substantial errors, this approach improved the performance of a BMI employing two variants of the ubiquitous Kalman velocity filter, including a state-of-the-art decoder (ReFIT-KF). SIGNIFICANCE Detecting errors in real-time from the same brain regions that are commonly used to control BMIs should improve the clinical viability of BMIs aimed at restoring motor function to people with paralysis.

[1]  Gordon Cheng,et al.  Long-Term Training with a Brain-Machine Interface-Based Gait Protocol Induces Partial Neurological Recovery in Paraplegic Patients , 2016, Scientific Reports.

[2]  J. Donoghue,et al.  Failure mode analysis of silicon-based intracortical microelectrode arrays in non-human primates , 2013, Journal of neural engineering.

[3]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[4]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.

[5]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[6]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[7]  Jose M. Carmena,et al.  Robust Brain-Machine Interface Design Using Optimal Feedback Control Modeling and Adaptive Point Process Filtering , 2016, PLoS Comput. Biol..

[8]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[9]  Ricardo Chavarriaga,et al.  Errare machinale est: the use of error-related potentials in brain-machine interfaces , 2014, Front. Neurosci..

[10]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[11]  L R Hochberg,et al.  Efficient Decoding With Steady-State Kalman Filter in Neural Interface Systems , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Ashesh K Dhawale,et al.  Motor Cortex Is Required for Learning but Not for Executing a Motor Skill , 2015, Neuron.

[13]  M. Sahani,et al.  Cortical control of arm movements: a dynamical systems perspective. , 2013, Annual review of neuroscience.

[14]  Anish A. Sarma,et al.  Clinical translation of a high-performance neural prosthesis , 2015, Nature Medicine.

[15]  R. Andersen,et al.  Decoding motor imagery from the posterior parietal cortex of a tetraplegic human , 2015, Science.

[16]  M L Boninger,et al.  Ten-dimensional anthropomorphic arm control in a human brain−machine interface: difficulties, solutions, and limitations , 2015, Journal of neural engineering.

[17]  W. Gehring,et al.  Neural Systems for Error Monitoring , 2007, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[18]  Yasmin L. Hashambhoy,et al.  Neural Correlates of Reach Errors , 2005, The Journal of Neuroscience.

[19]  Uri T Eden,et al.  General-purpose filter design for neural prosthetic devices. , 2007, Journal of neurophysiology.

[20]  Wolfgang Rosenstiel,et al.  Online use of error-related potentials in healthy users and people with severe motor impairment increases performance of a P300-BCI , 2012, Clinical Neurophysiology.

[21]  B. Burle,et al.  Action Monitoring and Medial Frontal Cortex: Leading Role of Supplementary Motor Area , 2014, Science.

[22]  David Sussillo,et al.  Making brain–machine interfaces robust to future neural variability , 2016, Nature Communications.

[23]  Robert D Flint,et al.  Long-Term Stability of Motor Cortical Activity: Implications for Brain Machine Interfaces and Optimal Feedback Control , 2016, The Journal of Neuroscience.

[24]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[25]  Clay B. Holroyd,et al.  Reward prediction error signals associated with a modified time estimation task. , 2007, Psychophysiology.

[26]  Stephen I. Ryu,et al.  Motor Cortical Visuomotor Feedback Activity Is Initially Isolated from Downstream Targets in Output-Null Neural State Space Dimensions , 2017, Neuron.

[27]  Andreas Schulze-Bonhage,et al.  Error-related electrocorticographic activity in humans during continuous movements , 2012, Journal of neural engineering.

[28]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[29]  L. Miller,et al.  Accurate decoding of reaching movements from field potentials in the absence of spikes , 2012, Journal of neural engineering.

[30]  J. Tanji,et al.  Spatial distribution of cingulate cells projecting to the primary, supplementary, and pre-supplementary motor areas: a retrograde multiple labeling study in the macaque monkey , 2001, Neuroscience Research.

[31]  E. Evarts,et al.  Motor Cortex control of finely graded forces. , 1983, Journal of neurophysiology.

[32]  Eilon Vaadia,et al.  Kernel-ARMA for Hand Tracking and Brain-Machine interfacing During 3D Motor Control , 2008, NIPS.

[33]  Miguel A. L. Nicolelis,et al.  Adaptive Decoding for Brain-Machine Interfaces Through Bayesian Parameter Updates , 2011, Neural Computation.

[34]  Paul Nuyujukian,et al.  Intention estimation in brain–machine interfaces , 2014, Journal of neural engineering.

[35]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[36]  Clay B. Holroyd,et al.  Hierarchical error processing: Different errors, different systems , 2007, Brain Research.

[37]  S I Helms Tillery,et al.  Training in Cortical Control of Neuroprosthetic Devices Improves Signal Extraction from Small Neuronal Ensembles , 2003, Reviews in the neurosciences.

[38]  Muhammad Abd-El-Barr,et al.  Long-term Training With a Brain-Machine Interface-Based Gait Protocol Induces Partial Neurological Recovery in Paraplegic Patients. , 2016, Neurosurgery.

[39]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[40]  Justin C. Sanchez,et al.  Using Reinforcement Learning to Provide Stable Brain-Machine Interface Control Despite Neural Input Reorganization , 2014, PloS one.

[41]  Konrad Paul Kording,et al.  Premotor and Motor Cortices Encode Reward , 2016, PloS one.

[42]  Stephen I. Ryu,et al.  Auto-deleting brain machine interface: Error detection using spiking neural activity in the motor cortex , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[43]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[44]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[45]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[46]  José del R. Millán,et al.  Simultaneous Real-Time Detection of Motor Imagery and Error-Related Potentials for Improved BCI Accuracy , 2008 .

[47]  L. Miller,et al.  Restoration of grasp following paralysis through brain-controlled stimulation of muscles , 2012, Nature.

[48]  Michael J. Black,et al.  Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array , 2011 .

[49]  Olav E. Krigolson,et al.  How We Learn to Make Decisions: Rapid Propagation of Reinforcement Learning Prediction Errors in Humans , 2014, Journal of Cognitive Neuroscience.

[50]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[51]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[52]  Francis R. Willett,et al.  High performance communication by people with paralysis using an intracortical brain-computer interface , 2017, eLife.

[53]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[54]  Ricardo Chavarriaga,et al.  Robust, accurate spelling based on error-related potentials , 2016 .

[55]  Nico M Schmidt,et al.  Online detection of error-related potentials boosts the performance of mental typewriters , 2012, BMC Neuroscience.

[56]  Wei Wu,et al.  Real-Time Decoding of Nonstationary Neural Activity in Motor Cortex , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[57]  John P. Cunningham,et al.  Single-trial dynamics of motor cortex and their applications to brain-machine interfaces , 2015, Nature Communications.

[58]  William J. Gehring,et al.  Medial prefrontal cortex and error potentials , 2002 .

[59]  Clay B. Holroyd,et al.  Evidence for hierarchical error processing in the human brain , 2006, Neuroscience.

[60]  R Chavarriaga,et al.  EEG-based decoding of error-related brain activity in a real-world driving task , 2015, Journal of neural engineering.

[61]  E. Todorov Direct cortical control of muscle activation in voluntary arm movements: a model , 2000, Nature Neuroscience.

[62]  G. Rizzolatti,et al.  Seven Years of Recording from Monkey Cortex with a Chronically Implanted Multiple Microelectrode , 2010, Front. Neuroeng..

[63]  Clay B. Holroyd,et al.  Predictive information and error processing: the role of medial-frontal cortex during motor control. , 2007, Psychophysiology.

[64]  Paul Nuyujukian,et al.  Performance sustaining intracortical neural prostheses , 2014, Journal of neural engineering.

[65]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[66]  Nicholas V. Annetta,et al.  Restoring cortical control of functional movement in a human with quadriplegia , 2016, Nature.

[67]  Nicolas Y. Masse,et al.  Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface , 2015, Science Translational Medicine.

[68]  Matthew T. Kaufman,et al.  A neural network that finds a naturalistic solution for the production of muscle activity , 2015, Nature Neuroscience.

[69]  Matthew T. Kaufman,et al.  Supplementary materials for : Cortical activity in the null space : permitting preparation without movement , 2014 .

[70]  Masato Inoue,et al.  Error Signals in Motor Cortices Drive Adaptation in Reaching , 2016, Neuron.

[71]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[72]  Stephen I. Ryu,et al.  A High-Performance Keyboard Neural Prosthesis Enabled by Task Optimization , 2015, IEEE Transactions on Biomedical Engineering.

[73]  Paul Nuyujukian,et al.  A high performing brain–machine interface driven by low-frequency local field potentials alone and together with spikes , 2015, bioRxiv.

[74]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[75]  Krishna V. Shenoy,et al.  Monkey models for brain-machine interfaces: The need for maintaining diversity , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[76]  Vikash Gilja,et al.  Long-term Stability of Neural Prosthetic Control Signals from Silicon Cortical Arrays in Rhesus Macaque Motor Cortex , 2010 .

[77]  C. Mehring,et al.  Detection of Error Related Neuronal Responses Recorded by Electrocorticography in Humans during Continuous Movements , 2013, PloS one.

[78]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[79]  Stephen I. Ryu,et al.  Trial-by-Trial Motor Cortical Correlates of a Rapidly Adapting Visuomotor Internal Model , 2017, The Journal of Neuroscience.

[80]  J. Kalaska,et al.  A comparison of movement direction-related versus load direction- related activity in primate motor cortex, using a two-dimensional reaching task , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[81]  Stephen I. Ryu,et al.  A Nonhuman Primate Brain–Computer Typing Interface , 2017, Proceedings of the IEEE.

[82]  Stephen I. Ryu,et al.  Leveraging historical knowledge of neural dynamics to rescue decoder performance as neural channels are lost: “Decoder hysteresis” , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[83]  Clay B. Holroyd,et al.  Electroencephalographic correlates of target and outcome errors , 2008, Experimental Brain Research.

[84]  Stephen I. Ryu,et al.  A High-Performance Neural Prosthesis Incorporating Discrete State Selection With Hidden Markov Models , 2017, IEEE Transactions on Biomedical Engineering.

[85]  Ricardo Chavarriaga,et al.  Teaching brain-machine interfaces as an alternative paradigm to neuroprosthetics control , 2015, Scientific Reports.

[86]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[87]  Kelvin So,et al.  Subject-specific modulation of local field potential spectral power during brain–machine interface control in primates , 2014, Journal of neural engineering.

[88]  Jose M. Carmena,et al.  Closed-Loop Decoder Adaptation Shapes Neural Plasticity for Skillful Neuroprosthetic Control , 2014, Neuron.

[89]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[90]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.