Speech-related dorsal motor cortex activity does not interfere with iBCI cursor control

OBJECTIVE Speech-related neural modulation was recently reported in 'arm/hand' area of human dorsal motor cortex that is used as a signal source for intracortical brain-computer interfaces (iBCIs). This raises the concern that speech-related modulation might deleteriously affect the decoding of arm movement intentions, for instance by affecting velocity command outputs. This study sought to clarify whether or not speaking would interfere with ongoing iBCI use. APPROACH A participant in the BrainGate2 iBCI clinical trial used an iBCI to control a computer cursor; spoke short words in a stand-alone speech task; and spoke short words during ongoing iBCI use. We examined neural activity in all three behaviors and compared iBCI performance with and without concurrent speech. MAIN RESULTS Dorsal motor cortex firing rates modulated strongly during stand-alone speech, but this activity was largely attenuated when speaking occurred during iBCI cursor control using attempted arm movements. 'Decoder-potent' projections of the attenuated speech-related neural activity were small, explaining why cursor task performance was similar between iBCI use with and without concurrent speaking. SIGNIFICANCE These findings indicate that speaking does not directly interfere with iBCIs that decode attempted arm movements. This suggests that patients who are able to speak will be able to use motor cortical-driven computer interfaces or prostheses without needing to forgo speaking while using these devices.

[1]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[2]  G. Logan.  On the ability to inhibit thought and action , 1984 .

[3]  Marc W Slutzky,et al.  Brain-Machine Interfaces: Powerful Tools for Clinical Treatment and Neuroscientific Investigations , 2019, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[4]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[5]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[6]  Chethan Pandarinath,et al.  Cortical control of a tablet computer by people with paralysis , 2018, PloS one.

[7]  Nicolas Y. Masse,et al.  Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface , 2015, Science Translational Medicine.

[8]  Stephen I. Ryu,et al.  Motor Cortical Visuomotor Feedback Activity Is Initially Isolated from Downstream Targets in Output-Null Neural State Space Dimensions , 2017, Neuron.

[9]  Nicholas V. Annetta,et al.  Restoring cortical control of functional movement in a human with quadriplegia , 2016, Nature.

[10]  Francis R. Willett,et al.  Restoration of reaching and grasping in a person with tetraplegia through brain-controlled muscle stimulation: a proof-of-concept demonstration , 2017, The Lancet.

[11]  M L Boninger,et al.  Ten-dimensional anthropomorphic arm control in a human brain−machine interface: difficulties, solutions, and limitations , 2015, Journal of neural engineering.

[12]  Robert A Gaunt,et al.  Motor cortical activity changes during neuroprosthetic-controlled object interaction , 2017, Scientific Reports.

[13]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[14]  Jose M. Carmena,et al.  Closed-Loop Decoder Adaptation Shapes Neural Plasticity for Skillful Neuroprosthetic Control , 2014, Neuron.

[15]  Francis R. Willett,et al.  Hand Knob Area of Motor Cortex in People with Tetraplegia Represents the Whole Body in a Modular Way , 2019, bioRxiv.

[16]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[17]  L R Hochberg,et al.  Efficient Decoding With Steady-State Kalman Filter in Neural Interface Systems , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  David Sussillo,et al.  Making brain–machine interfaces robust to future neural variability , 2016, Nature communications.

[19]  Nathan E. Crone,et al.  The Potential for a Speech Brain–Computer Interface Using Chronic Electrocorticography , 2019, Neurotherapeutics.

[20]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[21]  Joseph G. Makin,et al.  Real-time decoding of question-and-answer speech dialogue using human cortical activity , 2019, Nature Communications.

[22]  Robert D Flint,et al.  Long term, stable brain machine interface performance using local field potentials and multiunit spikes , 2013, Journal of neural engineering.

[23]  Francis R. Willett,et al.  Decoding Speech from Intracortical Multielectrode Arrays in Dorsal “Arm/Hand Areas” of Human Motor Cortex , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  John D. Simeral,et al.  A Comparison of Intention Estimation Methods for Decoder Calibration in Intracortical Brain–Computer Interfaces , 2018, IEEE Transactions on Biomedical Engineering.

[25]  Gerhard Friehs,et al.  Intra-day signal instabilities affect decoding performance in an intracortical neural interface system , 2013, Journal of neural engineering.

[26]  J. Brion,et al.  Both adult and juvenile tau microtubule-associated proteins are axon specific in the developing and adult rat cerebellum , 1988, Neuroscience.

[27]  L. Miller,et al.  Restoration of grasp following paralysis through brain-controlled stimulation of muscles , 2012, Nature.

[28]  Francis R. Willett,et al.  High performance communication by people with paralysis using an intracortical brain-computer interface , 2017, eLife.

[29]  Matthew C Tate,et al.  Speech synthesis from ECoG using densely connected 3D convolutional neural networks. , 2019, Journal of neural engineering.

[30]  Edward F. Chang,et al.  Speech synthesis from neural decoding of spoken sentences , 2019, Nature.

[31]  Robert D Flint,et al.  Long-Term Stability of Motor Cortical Activity: Implications for Brain Machine Interfaces and Optimal Feedback Control , 2016, The Journal of Neuroscience.

[32]  Leigh R. Hochberg,et al.  Review: Human Intracortical Recording and Neural Decoding for Brain–Computer Interfaces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Paul Nuyujukian,et al.  A high performing brain–machine interface driven by low-frequency local field potentials alone and together with spikes , 2015, bioRxiv.

[34]  R. Andersen,et al.  Decoding motor imagery from the posterior parietal cortex of a tetraplegic human , 2015, Science.

[35]  Nicolas Y. Masse,et al.  Non-causal spike filtering improves decoding of movement intention for intracortical BCIs , 2014, Journal of Neuroscience Methods.

[36]  Christian Ethier,et al.  Cortical population activity within a preserved neural manifold underlies multiple motor behaviors , 2018, Nature Communications.

[37]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[38]  John-Dylan Haynes,et al.  Searchlight-based multi-voxel pattern analysis of fMRI by cross-validated MANOVA , 2014, NeuroImage.

[39]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[40]  Chethan Pandarinath,et al.  Brain-machine interface cursor position only weakly affects monkey and human motor cortical activity in the absence of arm movements , 2018, Scientific Reports.

[41]  Anish A. Sarma,et al.  Clinical translation of a high-performance neural prosthesis , 2015, Nature Medicine.

[42]  Francis R. Willett,et al.  Neural ensemble dynamics in dorsal motor cortex during speech in people with paralysis , 2019, eLife.

[43]  Meel Velliste,et al.  Motor Cortical Correlates of Arm Resting in the Context of a Reaching Task and Implications for Prosthetic Control , 2014, The Journal of Neuroscience.

[44]  Krishna V. Shenoy,et al.  Information Systems Opportunities in Brain–Machine Interface Decoders , 2014, Proceedings of the IEEE.

[45]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.