High performance communication by people with paralysis using an intracortical brain-computer interface

Brain-computer interfaces (BCIs) have the potential to restore communication for people with tetraplegia and anarthria by translating neural activity into control signals for assistive communication devices. While previous pre-clinical and clinical studies have demonstrated promising proofs-of-concept (Serruya et al., 2002; Simeral et al., 2011; Bacher et al., 2015; Nuyujukian et al., 2015; Aflalo et al., 2015; Gilja et al., 2015; Jarosiewicz et al., 2015; Wolpaw et al., 1998; Hwang et al., 2012; Spüler et al., 2012; Leuthardt et al., 2004; Taylor et al., 2002; Schalk et al., 2008; Moran, 2010; Brunner et al., 2011; Wang et al., 2013; Townsend and Platsko, 2016; Vansteensel et al., 2016; Nuyujukian et al., 2016; Carmena et al., 2003; Musallam et al., 2004; Santhanam et al., 2006; Hochberg et al., 2006; Ganguly et al., 2011; O’Doherty et al., 2011; Gilja et al., 2012), the performance of human clinical BCI systems is not yet high enough to support widespread adoption by people with physical limitations of speech. Here we report a high-performance intracortical BCI (iBCI) for communication, which was tested by three clinical trial participants with paralysis. The system leveraged advances in decoder design developed in prior pre-clinical and clinical studies (Gilja et al., 2015; Kao et al., 2016; Gilja et al., 2012). For all three participants, performance exceeded previous iBCIs (Bacher et al., 2015; Jarosiewicz et al., 2015) as measured by typing rate (by a factor of 1.4–4.2) and information throughput (by a factor of 2.2–4.0). This high level of performance demonstrates the potential utility of iBCIs as powerful assistive communication devices for people with limited motor function. Clinical Trial No: NCT00912041 DOI: http://dx.doi.org/10.7554/eLife.18554.001

[1]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[2]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[3]  Michael Bensch,et al.  Design and Implementation of a P300-Based Brain-Computer Interface for Controlling an Internet Browser , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  B O Mainsah,et al.  Increasing BCI communication rates with dynamic stopping towards more practical use: an ALS study , 2015, Journal of neural engineering.

[5]  N. Birbaumer,et al.  The Influence of Psychological State and Motivation on Brain–Computer Interface Performance in Patients with Amyotrophic Lateral Sclerosis – a Longitudinal Study , 2010, Front. Neuropharma..

[6]  Robert D Flint,et al.  Long term, stable brain machine interface performance using local field potentials and multiunit spikes , 2013, Journal of neural engineering.

[7]  Vikash Gilja,et al.  Long-term Stability of Neural Prosthetic Control Signals from Silicon Cortical Arrays in Rhesus Macaque Motor Cortex , 2010 .

[8]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[9]  Chang-Hwan Im,et al.  Development of an SSVEP-based BCI spelling system adopting a QWERTY-style LED keyboard , 2012, Journal of Neuroscience Methods.

[10]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[11]  G. Fairbanks Voice and articulation drillbook , 1960 .

[12]  Dennis J. McFarland,et al.  P 300-based brain-computer interface ( BCI ) event-related potentials ( ERPs ) : People with amyotrophic lateral sclerosis ( ALS ) vs . age-matched controls , 2015 .

[13]  Michael J. Black,et al.  Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array , 2011 .

[14]  Byron M. Yu,et al.  Detecting neural-state transitions using hidden Markov models for motor cortical prostheses. , 2008, Journal of neurophysiology.

[15]  Paul Nuyujukian,et al.  Performance sustaining intracortical neural prostheses , 2014, Journal of neural engineering.

[16]  Gerwin Schalk,et al.  Rapid Communication with a “P300” Matrix Speller Using Electrocorticographic Signals (ECoG) , 2010, Front. Neurosci..

[17]  Nicolas Y. Masse,et al.  Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface , 2015, Science Translational Medicine.

[18]  A. Kübler,et al.  Brain Painting: First Evaluation of a New Brain–Computer Interface Application with ALS-Patients and Healthy Volunteers , 2010, Front. Neurosci..

[19]  Christopher K. Kovach,et al.  Manifestation of ocular-muscle EMG contamination in human intracranial recordings , 2011, NeuroImage.

[20]  J. Huggins,et al.  What would brain-computer interface users want? Opinions and priorities of potential users with amyotrophic lateral sclerosis , 2011, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[21]  I. Scott MacKenzie,et al.  Predicting text entry speed on mobile phones , 2000, CHI.

[22]  Leigh R. Hochberg,et al.  BCI Users and Their Needs , 2012 .

[23]  Stephen I. Ryu,et al.  A High-Performance Neural Prosthesis Incorporating Discrete State Selection With Hidden Markov Models , 2017, IEEE Transactions on Biomedical Engineering.

[24]  Eric W. Sellers,et al.  Noninvasive brain-computer interface enables communication after brainstem stroke , 2014, Science Translational Medicine.

[25]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[26]  Hannes Bleuler,et al.  Active tactile exploration enabled by a brain-machine-brain interface , 2011, Nature.

[27]  Jochen Rick,et al.  Performance optimizations of virtual keyboards for stroke-based text entry on a touch-based tabletop , 2010, UIST.

[28]  I. Scott MacKenzie,et al.  Text Entry for Mobile Computing: Models and Methods,Theory and Practice , 2002, Hum. Comput. Interact..

[29]  R. Andersen,et al.  Neural prosthetic control signals from plan activity , 2003, Neuroreport.

[30]  Krishna V. Shenoy,et al.  Challenges and Opportunities for Next-Generation Intracortically Based Neural Prostheses , 2011, IEEE Transactions on Biomedical Engineering.

[31]  Robin C. Ashmore,et al.  An Electrocorticographic Brain Interface in an Individual with Tetraplegia , 2013, PloS one.

[32]  Peter J. Ifft,et al.  Active tactile exploration enabled by a brain-machine-brain interface , 2011, Nature.

[33]  Michael L Boninger,et al.  Functional priorities, assistive technology, and brain-computer interfaces after spinal cord injury. , 2013, Journal of rehabilitation research and development.

[34]  Stephen I. Ryu,et al.  A Nonhuman Primate Brain–Computer Typing Interface , 2017, Proceedings of the IEEE.

[35]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[36]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[37]  J. A. Wilson,et al.  Two-dimensional movement control using electrocorticographic signals in humans , 2008, Journal of neural engineering.

[38]  Byron M. Yu,et al.  Self-recalibrating classifiers for intracortical brain–computer interfaces , 2014, Journal of neural engineering.

[39]  S. Meagher Instant neural control of a movement signal , 2002 .

[40]  Horabail S. Venkatagiri,et al.  Clinical measurement of rate of reading and discourse in young adults , 1999 .

[41]  G Townsend,et al.  Pushing the P300-based brain-computer interface beyond 100 bpm: extending performance guided constraints into the temporal domain. , 2016, Journal of neural engineering.

[42]  Vikash Gilja,et al.  Assessment of brain–machine interfaces from the perspective of people with paralysis , 2015, Journal of neural engineering.

[43]  Krishna V Shenoy,et al.  Human cortical prostheses: lost in translation? , 2009, Neurosurgical focus.

[44]  M. Castelo‐Branco,et al.  Comparison of a row-column speller vs. a novel lateral single-character speller: Assessment of BCI for severe motor disabled patients , 2012, Clinical Neurophysiology.

[45]  Michael J. Black,et al.  Point-and-Click Cursor Control With an Intracortical Neural Interface System by Humans With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[47]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[48]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[49]  Nicolas Y. Masse,et al.  Neural Point-and-Click Communication by a Person With Incomplete Locked-In Syndrome , 2015, Neurorehabilitation and neural repair.

[50]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[51]  Stephen I. Ryu,et al.  A High-Performance Keyboard Neural Prosthesis Enabled by Task Optimization , 2015, IEEE Transactions on Biomedical Engineering.

[52]  N. Ramsey,et al.  Fully Implanted Brain-Computer Interface in a Locked-In Patient with ALS. , 2016, The New England journal of medicine.

[53]  Arto Nurmikko,et al.  An implantable wireless neural interface for recording cortical circuit dynamics in moving primates , 2013, Journal of neural engineering.

[54]  Wolfgang Rosenstiel,et al.  Online Adaptation of a c-VEP Brain-Computer Interface(BCI) Based on Error-Related Potentials and Unsupervised Learning , 2012, PloS one.

[55]  Dragan F. Dimitrov,et al.  Reversible large-scale modification of cortical networks during neuroprosthetic control , 2011, Nature Neuroscience.

[56]  J. Wolpaw,et al.  P300-based brain-computer interface (BCI) event-related potentials (ERPs): People with amyotrophic lateral sclerosis (ALS) vs. age-matched controls , 2015, Clinical Neurophysiology.

[57]  Vikash Gilja,et al.  A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. , 2011, Journal of neurophysiology.

[58]  L. Miller,et al.  Restoration of grasp following paralysis through brain-controlled stimulation of muscles , 2012, Nature.

[59]  Jose M. Carmena,et al.  Rapid control and feedback rates enhance neuroprosthetic control , 2017, Nature Communications.

[60]  Anish A. Sarma,et al.  Clinical translation of a high-performance neural prosthesis , 2015, Nature Medicine.

[61]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[62]  R. Andersen,et al.  Decoding motor imagery from the posterior parietal cortex of a tetraplegic human , 2015, Science.

[63]  Afsheen Afshar,et al.  Free-paced high-performance brain-computer interfaces. , 2007, Journal of neural engineering.

[64]  Urbano Nunes,et al.  Statistical spatial filtering for a P300-based BCI: Tests in able-bodied, and patients with cerebral palsy and amyotrophic lateral sclerosis , 2011, Journal of Neuroscience Methods.

[65]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[66]  Daniel Moran,et al.  Evolution of brain–computer interface: action potentials, local field potentials and electrocorticograms , 2010, Current Opinion in Neurobiology.

[67]  Martha J. Farah,et al.  Neuroethics in practice , 2013 .

[68]  Leigh R. Hochberg,et al.  Implanted Neural Interfaces: Ethics in Treatment and Research , 2013 .

[69]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.