Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface

Individuals with tetraplegia are able to type self-paced for hours across multiple days using a self-calibrating point-and-click intracortical brain-computer interface. Prolonged typing with refined BCI The fact that the brain can be hooked up to a computer to allow paralyzed individuals to type is already a technological feat. But, these so-called brain-computer interface technologies can be tiring and burdensome for users, requiring frequent disruptions for recalibration when the decoded neural signals change. Jarosiewicz and colleagues therefore combined three calibration methods—retrospective target interference, velocity bias correction, and adaptive tracking of neural features—for seamless typing and stable neural control. This combination allowed two individuals with tetraplegia and with cortical microelectrode arrays to compose long texts at their own paces, with no need to interrupt typing for recalibration. Brain-computer interfaces (BCIs) promise to restore independence for people with severe motor disabilities by translating decoded neural activity directly into the control of a computer. However, recorded neural signals are not stationary (that is, can change over time), degrading the quality of decoding. Requiring users to pause what they are doing whenever signals change to perform decoder recalibration routines is time-consuming and impractical for everyday use of BCIs. We demonstrate that signal nonstationarity in an intracortical BCI can be mitigated automatically in software, enabling long periods (hours to days) of self-paced point-and-click typing by people with tetraplegia, without degradation in neural control. Three key innovations were included in our approach: tracking the statistics of the neural activity during self-timed pauses in neural control, velocity bias correction during neural control, and periodically recalibrating the decoder using data acquired during typing by mapping neural activity to movement intentions that are inferred retrospectively based on the user’s self-selected targets. These methods, which can be extended to a variety of neurally controlled applications, advance the potential for intracortical BCIs to help restore independent communication and assistive device control for people with paralysis.

[1]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[2]  Anish A. Sarma,et al.  Clinical translation of a high-performance neural prosthesis , 2015, Nature Medicine.

[3]  R. Andersen,et al.  Decoding motor imagery from the posterior parietal cortex of a tetraplegic human , 2015, Science.

[4]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[5]  L R Hochberg,et al.  Efficient Decoding With Steady-State Kalman Filter in Neural Interface Systems , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Me Meluin Bruce,et al.  Estimation of variance by a recursive equation , 1969 .

[7]  C. Mehring,et al.  Detection of Error Related Neuronal Responses Recorded by Electrocorticography in Humans during Continuous Movements , 2013, PloS one.

[8]  H. Alkadhi,et al.  Localization of the motor hand area to a knob on the precentral gyrus. A new landmark. , 1997, Brain : a journal of neurology.

[9]  Pamela W. Duncan,et al.  Textbook of Neural Repair and Rehabilitation: Functional plasticity in CNS system , 2006 .

[10]  J. Donoghue,et al.  Primary Motor Cortex Tuning to Intended Movement Kinematics in Humans with Tetraplegia , 2008, The Journal of Neuroscience.

[11]  Michael J. Black,et al.  Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array , 2011 .

[12]  Krishna V. Shenoy,et al.  Information Systems Opportunities in Brain–Machine Interface Decoders , 2014, Proceedings of the IEEE.

[13]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[14]  Meel Velliste,et al.  Motor Cortical Correlates of Arm Resting in the Context of a Reaching Task and Implications for Prosthetic Control , 2014, The Journal of Neuroscience.

[15]  Byron M. Yu,et al.  Factor-analysis methods for higher-performance neural prostheses. , 2009, Journal of neurophysiology.

[16]  L. Miller,et al.  Restoration of grasp following paralysis through brain-controlled stimulation of muscles , 2012, Nature.

[17]  Bijan Pesaran,et al.  Neural Correlates of Visual–Spatial Attention in Electrocorticographic Signals in Humans , 2011, Front. Hum. Neurosci..

[18]  Kip A Ludwig,et al.  Using a common average reference to improve cortical neuron recordings from microelectrode arrays. , 2009, Journal of neurophysiology.

[19]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[20]  Steven M Chase,et al.  Control of a brain–computer interface without spike sorting , 2009, Journal of neural engineering.

[21]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[22]  J D Simeral,et al.  Continuous neuronal ensemble control of simulated arm reaching by a human with tetraplegia , 2011, Journal of neural engineering.

[23]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[24]  Herbert F. Voigt,et al.  IEEE Engineering in Medicine and Biology Society , 2019, IEEE Transactions on Biomedical Engineering.

[25]  Teresa H. Y. Meng,et al.  HermesB: A Continuous Neural Recording System for Freely Behaving Primates , 2007, IEEE Transactions on Biomedical Engineering.

[26]  Rajesh P. N. Rao,et al.  Spectral Changes in Cortical Surface Potentials during Motor Movement , 2007, The Journal of Neuroscience.

[27]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[28]  G. Pfurtscheller,et al.  ERD/ERS patterns reflecting sensorimotor activation and deactivation. , 2006, Progress in brain research.

[29]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[30]  Vikash Gilja,et al.  Long-term Stability of Neural Prosthetic Control Signals from Silicon Cortical Arrays in Rhesus Macaque Motor Cortex , 2010 .

[31]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[32]  Michael J. Black,et al.  Point-and-Click Cursor Control With an Intracortical Neural Interface System by Humans With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[34]  Luca Mainardi,et al.  Performance measurement for brain–computer or brain–machine interfaces: a tutorial , 2014, Journal of neural engineering.

[35]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[36]  Gerhard Friehs,et al.  Intra-day signal instabilities affect decoding performance in an intracortical neural interface system , 2013, Journal of neural engineering.

[37]  Nicolas Y. Masse,et al.  Non-causal spike filtering improves decoding of movement intention for intracortical BCIs , 2014, Journal of Neuroscience Methods.

[38]  Roy Fox,et al.  A multi-agent control framework for co-adaptation in brain-computer interfaces , 2013, NIPS.

[39]  Paul Nuyujukian,et al.  Performance sustaining intracortical neural prostheses , 2014, Journal of neural engineering.

[40]  Jonathan R. Wolpaw,et al.  Brain–Computer InterfacesPrinciples and Practice , 2012 .

[41]  Michael J. Black,et al.  Statistical Analysis of the Non-stationarity of Neural Population Codes , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[42]  Nicolas Y. Masse,et al.  Advantages of closed-loop calibration in intracortical brain–computer interfaces for people with tetraplegia , 2013, Journal of neural engineering.

[43]  Robert D Flint,et al.  Long term, stable brain machine interface performance using local field potentials and multiunit spikes , 2013, Journal of neural engineering.

[44]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[45]  Andreas Schulze-Bonhage,et al.  Error-related electrocorticographic activity in humans during continuous movements , 2012, Journal of neural engineering.

[46]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[47]  S. Clarke,et al.  Textbook of Neural Repair and Rehabilitation: Textbook of Neural Repair and Rehabilitation , 2006 .

[48]  Paul Nuyujukian,et al.  Intention estimation in brain–machine interfaces , 2014, Journal of neural engineering.

[49]  Nicolas Y. Masse,et al.  Neural Point-and-Click Communication by a Person With Incomplete Locked-In Syndrome , 2015, Neurorehabilitation and neural repair.

[50]  Vikash Gilja,et al.  Comparison of spike sorting and thresholding of voltage waveforms for intracortical brain–machine interface performance , 2015, Journal of neural engineering.

[51]  M. Nicolelis,et al.  Optimizing a Linear Algorithm for Real-Time Robotic Control using Chronic Cortical Ensemble Recordings in Monkeys , 2004, Journal of Cognitive Neuroscience.