Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array

The ongoing pilot clinical trial of the BrainGate neural interface system aims in part to assess the feasibility of using neural activity obtained from a small-scale, chronically implanted, intracortical microelectrode array to provide control signals for a neural prosthesis system. Critical questions include how long implanted microelectrodes will record useful neural signals, how reliably those signals can be acquired and decoded, and how effectively they can be used to control various assistive technologies such as computers and robotic assistive devices, or to enable functional electrical stimulation of paralyzed muscles. Here we examined these questions by assessing neural cursor control and BrainGate system characteristics on five consecutive days 1000 days after implant of a 4 × 4 mm array of 100 microelectrodes in the motor cortex of a human with longstanding tetraplegia subsequent to a brainstem stroke. On each of five prospectively-selected days we performed time-amplitude sorting of neuronal spiking activity, trained a population-based Kalman velocity decoding filter combined with a linear discriminant click state classifier, and then assessed closed-loop point-and-click cursor control. The participant performed both an eight-target center-out task and a random target Fitts metric task which was adapted from a human-computer interaction ISO standard used to quantify performance of computer input devices. The neural interface system was further characterized by daily measurement of electrode impedances, unit waveforms and local field potentials. Across the five days, spiking signals were obtained from 41 of 96 electrodes and were successfully decoded to provide neural cursor point-and-click control with a mean task performance of 91.3% ± 0.1% (mean ± s.d.) correct target acquisition. Results across five consecutive days demonstrate that a neural interface system based on an intracortical microelectrode array can provide repeatable, accurate point-and-click control of a computer interface to an individual with tetraplegia 1000 days after implantation of this sensor.

[1]  Gregory A Worrell,et al.  INTRACRANIAL ELECTROENCEPHALOGRAPHY WITH SUBDURAL GRID ELECTRODES: TECHNIQUES, COMPLICATIONS, AND OUTCOMES , 2008, Neurosurgery.

[2]  S. Meagher Instant neural control of a movement signal , 2002 .

[3]  Craig T. Nordhausen,et al.  Optimizing recording capabilities of the Utah Intracortical Electrode Array , 1994, Brain Research.

[4]  John P. Donoghue,et al.  Decoding 3-D Reach and Grasp Kinematics From High-Frequency Local Field Potentials in Primate Primary Motor Cortex , 2010, IEEE Transactions on Biomedical Engineering.

[5]  I. Scott MacKenzie,et al.  Accuracy measures for evaluating computer pointing devices , 2001, CHI.

[6]  Bagrat Amirikian,et al.  Directional tuning profiles of motor cortical cells , 2000, Neuroscience Research.

[7]  D. Edell,et al.  Factors influencing the biocompatibility of insertable silicon microshafts in cerebral cortex , 1992, IEEE Transactions on Biomedical Engineering.

[8]  Patrick A. Tresco,et al.  Impedance characterization of microarray recording electrodes in vitro , 2005, IEEE Transactions on Biomedical Engineering.

[9]  D. Kipke,et al.  Long-term neural recording characteristics of wire microelectrode arrays implanted in cerebral cortex. , 1999, Brain research. Brain research protocols.

[10]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[11]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[12]  R. J. Vetter,et al.  Silicon-substrate intracortical microelectrode arrays for long-term recording of neuronal spike activity in cerebral cortex , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  John K. Chapin,et al.  Ceramic-based multisite electrode arrays for chronic single-neuron recording , 2004, IEEE Transactions on Biomedical Engineering.

[14]  R G Radwin,et al.  Evaluation of a modified Fitts law brain–computer interface target acquisition task in able and motor disabled individuals , 2009, Journal of neural engineering.

[15]  David T. Bundy,et al.  Microscale recording from human motor cortex: implications for minimally invasive electrocorticographic brain-computer interfaces. , 2009, Neurosurgical focus.

[16]  Andreas Schulze-Bonhage,et al.  Prediction of arm movement trajectories from ECoG-recordings in humans , 2008, Journal of Neuroscience Methods.

[17]  K. E. Jones,et al.  A glass/silicon composite intracortical electrode array , 2006, Annals of Biomedical Engineering.

[18]  A. Daffertshofer,et al.  A role of beta oscillatory synchrony in biasing response competition? , 2009, Cerebral cortex.

[19]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[20]  Eran Stark,et al.  Predicting Movement from Multiunit Activity , 2007, The Journal of Neuroscience.

[21]  John P. Donoghue,et al.  Bridging the Brain to the World: A Perspective on Neural Interface Systems , 2008, Neuron.

[22]  W.R. Patterson,et al.  Active Microelectronic Neurosensor Arrays for Implantable Brain Communication Interfaces , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  A. T. Welford,et al.  THE MEASUREMENT OF SENSORY-MOTOR PERFORMANCE : SURVEY AND REAPPRAISAL OF TWELVE YEARS' PROGRESS , 1960 .

[24]  E. Fetz,et al.  Oscillatory activity in sensorimotor cortex of awake monkeys: synchronization of local field potentials and relation to behavior. , 1996, Journal of neurophysiology.

[25]  Jeffrey D. Schall,et al.  Review of signal distortion through metal microelectrode recording circuits and filters , 2008, Journal of Neuroscience Methods.

[26]  David C. Martin,et al.  Neuronal cell loss accompanies the brain tissue response to chronically implanted silicon microelectrode arrays , 2005, Experimental Neurology.

[27]  L. Cohen,et al.  Brain–computer interface in paralysis , 2008, Current opinion in neurology.

[28]  Shumin Zhai,et al.  Characterizing computer input with Fitts' law parameters-the information and non-information aspects of pointing , 2004, Int. J. Hum. Comput. Stud..

[29]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[30]  James D. Weiland,et al.  Chronic neural stimulation with thin-film, iridium oxide electrodes , 2000, IEEE Trans. Biomed. Eng..

[31]  Frank H. Guenther,et al.  Brain-computer interfaces for speech communication , 2010, Speech Commun..

[32]  R. Waters,et al.  International Standards for Neurological and Functional Classification of Spinal Cord Injury , 1997, Spinal Cord.

[33]  Michael J. Black,et al.  Point-and-Click Cursor Control With an Intracortical Neural Interface System by Humans With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  J. Donoghue,et al.  Neuronal Interactions Improve Cortical Population Coding of Movement Direction , 1999, The Journal of Neuroscience.

[35]  V. Gilja,et al.  Neural Recording Stability of Chronic Electrode Arrays in Freely Behaving Primates , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  P. Tresco,et al.  Acute microelectrode array implantation into human neocortex: preliminary technique and histological considerations. , 2006, Neurosurgical focus.

[37]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[38]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[39]  A Kübler,et al.  Life can be worth living in locked-in syndrome. , 2009, Progress in brain research.

[40]  M. Carandini,et al.  Local Origin of Field Potentials in Visual Cortex , 2009, Neuron.

[41]  J. A. Wilson,et al.  Electrocorticographically controlled brain-computer interfaces using motor and sensory imagery in patients with temporary subdural electrode implants. Report of four cases. , 2007, Journal of neurosurgery.

[42]  A. Levey,et al.  Implanted neural electrodes cause chronic, local inflammation that is correlated with local neurodegeneration , 2009, Journal of neural engineering.

[43]  Steven Laureys,et al.  Brain function in coma, vegetative state, and related disorders , 2004, The Lancet Neurology.

[44]  U. Mitzdorf Properties of the evoked potential generators: current source-density analysis of visually evoked potentials in the cat cortex. , 1987, The International journal of neuroscience.

[45]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[46]  Apostolos P Georgopoulos,et al.  Erratum to “Directional tuning profiles of motor cortical cells” [Neuroscience Research 36 (2000) 73–79] , 2000, Neuroscience Research.

[47]  E. Maynard,et al.  A technique to prevent dural adhesions to chronically implanted microelectrode arrays , 2000, Journal of Neuroscience Methods.

[48]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[49]  P. Tresco,et al.  Response of brain tissue to chronically implanted neural electrodes , 2005, Journal of Neuroscience Methods.

[50]  R. Eckhorn,et al.  Visual stimulation elicits locked and induced gamma oscillations in monkey intracortical- and EEG-potentials, but not in human EEG , 1999, Experimental Brain Research.

[51]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[52]  J. Donoghue,et al.  Oscillations in local field potentials of the primate motor cortex during voluntary movement. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[53]  José L Contreras-Vidal,et al.  Decoding three-dimensional hand kinematics from electroencephalographic signals , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[54]  C. Braun,et al.  A review on directional information in neural signals for brain-machine interfaces , 2009, Journal of Physiology-Paris.

[55]  Daryl R Kipke,et al.  Complex impedance spectroscopy for monitoring tissue responses to inserted neural implants , 2007, Journal of neural engineering.

[56]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Eduardo Fernández,et al.  Long-term stimulation and recording with a penetrating microelectrode array in cat sciatic nerve , 2004, IEEE Transactions on Biomedical Engineering.

[58]  J. Schellekens,et al.  The micro-structure of tapping movements in children. , 1984, Journal of motor behavior.

[59]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[60]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[61]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[62]  G. Rizzolatti,et al.  Seven Years of Recording from Monkey Cortex with a Chronically Implanted Multiple Microelectrode , 2010, Front. Neuroeng..

[63]  Alexandros Pino,et al.  Brain Computer Interface Cursor Measures for Motion-impaired and Able-bodied Users , 2022 .

[64]  X Liu,et al.  Stability of the interface between neural tissue and chronically implanted intracortical microelectrodes. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[65]  J. A. Wilson,et al.  Two-dimensional movement control using electrocorticographic signals in humans , 2008, Journal of neural engineering.

[66]  Eran Stark,et al.  Motor cortical activity related to movement kinematics exhibits local spatial organization , 2009, Cortex.

[67]  F. Plum,et al.  The diagnosis of stupor and coma. , 1972, Contemporary neurology series.

[68]  D.B. McCreery,et al.  Evaluation of the stability of intracortical microelectrode arrays , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[69]  Steven Laureys,et al.  The locked-in syndrome : what is it like to be conscious but paralyzed and voiceless? , 2005, Progress in brain research.

[70]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[71]  Dean J Krusienski,et al.  Emulation of computer mouse control with a noninvasive brain–computer interface , 2008, Journal of neural engineering.

[72]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[73]  Matthew Fellows,et al.  On the variability of manual spike sorting , 2004, IEEE Transactions on Biomedical Engineering.

[74]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[75]  D. Szarowski,et al.  Cerebral Astrocyte Response to Micromachined Silicon Implants , 1999, Experimental Neurology.

[76]  J. Wolpaw,et al.  Decoding two-dimensional movement trajectories using electrocorticographic signals in humans , 2007, Journal of neural engineering.

[77]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[78]  J. Csicsvari,et al.  Intracellular features predicted by extracellular recordings in the hippocampus in vivo. , 2000, Journal of neurophysiology.

[79]  Bradley Greger,et al.  Human neocortical electrical activity recorded on nonpenetrating microwire arrays: applicability for neuroprostheses. , 2009, Neurosurgical focus.

[80]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[81]  R. Normann,et al.  Chronic recording capability of the Utah Intracortical Electrode Array in cat sensory cortex , 1998, Journal of Neuroscience Methods.

[82]  D. Humphrey,et al.  Long-term gliosis around chronically implanted platinum electrodes in the Rhesus macaque motor cortex , 2006, Neuroscience Letters.

[83]  E. M. Pinches,et al.  The role of synchrony and oscillations in the motor output , 1999, Experimental Brain Research.

[84]  S I Helms Tillery,et al.  Training in Cortical Control of Neuroprosthetic Devices Improves Signal Extraction from Small Neuronal Ensembles , 2003, Reviews in the neurosciences.

[85]  J. Donoghue,et al.  Neural discharge and local field potential oscillations in primate motor cortex during voluntary movements. , 1998, Journal of neurophysiology.

[86]  Justin C. Williams,et al.  Chronic neural recording using silicon-substrate microelectrode arrays implanted in cerebral cortex , 2004, IEEE Transactions on Biomedical Engineering.

[87]  Matthew J Nelson,et al.  Do electrode properties create a problem in interpreting local field potential recordings? , 2010, Journal of neurophysiology.

[88]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[89]  J. Donoghue,et al.  Primary Motor Cortex Tuning to Intended Movement Kinematics in Humans with Tetraplegia , 2008, The Journal of Neuroscience.

[90]  M L Lin,et al.  A Method for Evaluating Head-Controlled Computer Input Devices Using Fitts' Law , 1990, Human factors.

[91]  Yali Amit,et al.  Single-unit stability using chronically implanted multielectrode arrays. , 2009, Journal of neurophysiology.

[92]  D. Szarowski,et al.  Brain responses to micro-machined silicon devices , 2003, Brain Research.

[93]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[94]  J.P. Donoghue,et al.  Reliability of signals from a chronically implanted, silicon-based electrode array in non-human primate primary motor cortex , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.