Upper limb sensorimotor restoration through brain–computer interface technology in tetraparesis

Abstract For individuals with spinal cord injury, brain–computer interface (BCI) technology offers a means to restore lost sensorimotor function by bridging disrupted neural pathways to reanimate paralyzed limbs. Restoring hand function is a high priority of those with tetraparesis because of the impact that manual dexterity has on independence and quality of life. However, to be useful in daily life, BCI systems need to deliver naturalistic and functional grasp speed, force, and dexterity. In clinical trials, individuals with paralysis have achieved the most dexterous control of grasp using either robotic neuroprosthetics or neuromuscular stimulation orthotics controlled by intracortical BCI systems. Next steps are in progress, with the development of portable components and decoding algorithm optimization to simplify setup and calibration.

[1]  Shaomin Zhang,et al.  Reliability of directional information in unsorted spikes and local field potentials recorded in human motor cortex , 2014, Journal of neural engineering.

[2]  J. Marcoux,et al.  Effects of injury level and severity on direct costs of care for acute spinal cord injury , 2014, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.

[3]  Nitish V. Thakor,et al.  Decoding Native Cortical Representations for Flexion and Extension at Upper Limb Joints Using Electrocorticography , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Martial Hebert,et al.  Blending of brain-machine interface and vision-guided autonomous robotics improves neuroprosthetic arm performance during grasping , 2016, Journal of NeuroEngineering and Rehabilitation.

[5]  Yijun Wang,et al.  Control of a 7-DOF Robotic Arm System With an SSVEP-Based BCI , 2018, Int. J. Neural Syst..

[6]  Aleksandra Vuckovic,et al.  Rehabilitation of hand in subacute tetraplegic patients based on brain computer interface and functional electrical stimulation: a randomised pilot study , 2016, Journal of neural engineering.

[7]  Mingming Zhang,et al.  Big data challenges in decoding cortical activity in a human with quadriplegia to inform a brain computer interface , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  K. Anderson.  Targeting recovery: priorities of the spinal cord-injured population. , 2004, Journal of neurotrauma.

[9]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[10]  Dezhi Zheng,et al.  Domain Transfer Multiple Kernel Boosting for Classification of EEG Motor Imagery Signals , 2019, IEEE Access.

[11]  M. Keith,et al.  Development of a quantitative hand grasp and release test for patients with tetraplegia using a hand neuroprosthesis. , 1994, The Journal of hand surgery.

[12]  Anish A. Sarma,et al.  Clinical translation of a high-performance neural prosthesis , 2015, Nature Medicine.

[13]  R. Andersen,et al.  Decoding motor imagery from the posterior parietal cortex of a tetraplegic human , 2015, Science.

[14]  Bin He,et al.  Noninvasive Electroencephalogram Based Control of a Robotic Arm for Reach and Grasp Tasks , 2016, Scientific Reports.

[15]  M. Popovic,et al.  The Graded Redefined Assessment of Strength Sensibility and Prehension: reliability and validity. , 2012, Journal of neurotrauma.

[16]  Josef Parvizi,et al.  Hand posture classification using electrocorticography signals in the gamma band over human sensorimotor brain areas , 2013, Journal of neural engineering.

[17]  R Rupp,et al.  Think2grasp - BCI-Controlled Neuroprosthesis for the Upper Extremity , 2013, Biomedizinische Technik. Biomedical engineering.

[18]  Per B. Sederberg,et al.  Meeting brain–computer interface user performance expectations using a deep neural network decoding framework , 2018, Nature Medicine.

[19]  Grégoire Courtine,et al.  Spinal cord repair: advances in biology and technology , 2019, Nature Medicine.

[20]  Klaus-Robert Müller,et al.  EEG-based BCI for the linear control of an upper-limb neuroprosthesis. , 2016, Medical engineering & physics.

[21]  David A. Friedenberg,et al.  A Characterization of Brain-Computer Interface Performance Trade-Offs Using Support Vector Machines and Deep Neural Networks to Decode Movement Intent , 2018, Front. Neurosci..

[22]  V Kaiser,et al.  Motor imagery-induced EEG patterns in individuals with spinal cord injury and their impact on brain–computer interface accuracy , 2014, Journal of neural engineering.

[23]  Dejan B. Popovic.  Hybrid FES-robot devices for training of activities of daily living , 2018 .

[24]  H. Flor,et al.  The Arm Motor Ability Test: reliability, validity, and sensitivity to change of an instrument for assessing disabilities in activities of daily living. , 1997, Archives of physical medicine and rehabilitation.

[25]  G. Pfurtscheller,et al.  EEG-based neuroprosthesis control: A step towards clinical practice , 2005, Neuroscience Letters.

[26]  P H Peckham,et al.  EEG-based control of a hand grasp neuroprosthesis. , 1999, Neuroreport.

[27]  Grace Kim,et al.  A psychometric evaluation of the Arm Motor Ability Test. , 2013, Journal of rehabilitation medicine.

[28]  Francis R. Willett,et al.  Restoration of reaching and grasping in a person with tetraplegia through brain-controlled muscle stimulation: a proof-of-concept demonstration , 2017, The Lancet.

[29]  M. Popovic,et al.  Responsiveness, Sensitivity, and Minimally Detectable Difference of the Graded and Redefined Assessment of Strength, Sensibility, and Prehension, Version 1.0. , 2016, Journal of Neurotrauma.

[30]  V Kaiser,et al.  BCI and FES Training of a Spinal Cord Injured End-User to Control a Neuroprosthesis , 2013, Biomedizinische Technik. Biomedical engineering.

[31]  N. Yozbatiran,et al.  A Standardized Approach to Performing the Action Research Arm Test , 2008, Neurorehabilitation and neural repair.

[32]  J A Shea,et al.  The Capabilities of Upper Extremity instrument: reliability and validity of a measure of functional limitation in tetraplegia. , 1998, Archives of physical medicine and rehabilitation.

[33]  Mingming Zhang,et al.  A High Definition Noninvasive Neuromuscular Electrical Stimulation System for Cortical Control of Combinatorial Rotary Hand Movements in a Human With Tetraplegia , 2019, IEEE Transactions on Biomedical Engineering.

[34]  R. Marino,et al.  Development of a short-form Quadriplegia Index of Function scale , 1999, Spinal Cord.

[35]  J Esnouf,et al.  The functional impact of the Freehand System on tetraplegic hand function. Clinical Results , 2002, Spinal Cord.

[36]  Maarten J. IJzerman,et al.  Survey of the needs of patients with spinal cord injury: impact and priority for improvement in hand function in tetraplegics , 2004, Spinal Cord.

[37]  Mingming Zhang,et al.  Dexterous Control of Seven Functional Hand Movements Using Cortically-Controlled Transcutaneous Muscle Stimulation in a Person With Tetraplegia , 2018, Front. Neurosci..

[38]  Wolfgang Rosenstiel,et al.  Hybrid Neuroprosthesis for the Upper Limb: Combining Brain-Controlled Neuromuscular Stimulation with a Multi-Joint Arm Exoskeleton , 2016, Front. Neurosci..

[39]  Nicholas V. Annetta,et al.  Clinically Significant Gains in Skillful Grasp Coordination by an Individual With Tetraplegia Using an Implanted Brain-Computer Interface With Forearm Transcutaneous Muscle Stimulation. , 2019, Archives of physical medicine and rehabilitation.

[40]  R. Marino,et al.  Assessing selfcare status in quadriplegia: comparison of the quadriplegia index of function (QIF) and the functional independence measure (FIM) , 1993, Paraplegia.

[41]  Nicholas V. Annetta,et al.  Restoring cortical control of functional movement in a human with quadriplegia , 2016, Nature.

[42]  Nicolas Y. Masse,et al.  Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface , 2015, Science Translational Medicine.

[43]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Sriram Subramanian,et al.  Predicting Mental Imagery-Based BCI Performance from Personality, Cognitive Profile and Neurophysiological Patterns , 2015, PloS one.

[45]  N. Dias,et al.  Brain‐machine interface of upper limb recovery in stroke patients rehabilitation: A systematic review , 2019, Physiotherapy research international : the journal for researchers and clinicians in physical therapy.

[46]  Mario Cortese,et al.  Hybrid EEG/EOG-based brain/neural hand exoskeleton restores fully independent daily living activities after quadriplegia , 2016, Science Robotics.

[47]  Hui Chen,et al.  Test-Retest Reproducibility and Smallest Real Difference of 5 Hand Function Tests in Patients With Stroke , 2009, Neurorehabilitation and neural repair.

[48]  Andreas Schulze-Bonhage,et al.  Grasp Detection from Human ECoG during Natural Reach-to-Grasp Movements , 2013, PloS one.

[49]  Luis Montesano,et al.  Moregrasp: restoration of upper limb function in Individuals with High spinal cord injury by Multimodal Neuroprostheses for Interaction in Daily Activities , 2017, GBCIC.

[50]  Nitish V. Thakor,et al.  Simultaneous Neural Control of Simple Reaching and Grasping With the Modular Prosthetic Limb Using Intracranial EEG , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[51]  Kapil D. Katyal,et al.  Individual finger control of a modular prosthetic limb using high-density electrocorticography in a human subject , 2016, Journal of neural engineering.

[52]  Michael L. Boninger,et al.  Implicit Grasp Force Representation in Human Motor Cortical Recordings , 2018, Front. Neurosci..

[53]  V. Lemmon.  What does “Disruptive” mean? Thoughts on the NIH SCI 2020 meeting , 2019, Neural regeneration research.

[54]  M L Boninger,et al.  Ten-dimensional anthropomorphic arm control in a human brain−machine interface: difficulties, solutions, and limitations , 2015, Journal of neural engineering.

[55]  David A. Friedenberg,et al.  Using an Artificial Neural Bypass to Restore Cortical Control of Rhythmic Movements in a Human with Quadriplegia , 2016, Scientific Reports.

[56]  Stephen T. Foldes,et al.  Intracortical microstimulation of human somatosensory cortex , 2016, Science Translational Medicine.

[57]  Chethan Pandarinath,et al.  Rapid calibration of an intracortical brain–computer interface for people with tetraplegia , 2018, Journal of neural engineering.

[58]  Simona Crea,et al.  Feasibility and safety of shared EEG/EOG and vision-guided autonomous whole-arm exoskeleton control to perform activities of daily living , 2018, Scientific Reports.

[59]  L. Kirkup,et al.  Control of a hand grasp neuroprosthesis using an electroencephalogram-triggered switch: Demonstration of improvements in performance using wavepacket analysis , 2002, Medical and Biological Engineering and Computing.

[60]  Vikash Gilja,et al.  Assessment of brain–machine interfaces from the perspective of people with paralysis , 2015, Journal of neural engineering.

[61]  Gernot R Müller-Putz,et al.  Attempted Arm and Hand Movements can be Decoded from Low-Frequency EEG from Persons with Spinal Cord Injury , 2019, Scientific Reports.

[62]  Robert A Gaunt,et al.  Motor cortical activity changes during neuroprosthetic-controlled object interaction , 2017, Scientific Reports.

[63]  Nick F. Ramsey,et al.  Decoding hand gestures from primary somatosensory cortex using high-density ECoG , 2017, NeuroImage.

[64]  Robin C. Ashmore,et al.  An Electrocorticographic Brain Interface in an Individual with Tetraplegia , 2013, PloS one.

[65]  Gernot R Müller-Putz,et al.  Exploring representations of human grasping in neural, muscle and kinematic signals , 2018, Scientific Reports.

[66]  Spencer Kellis,et al.  Hand Shape Representations in the Human Posterior Parietal Cortex , 2015, The Journal of Neuroscience.

[67]  M. Popovic,et al.  Control of a neuroprosthesis for grasping using off-line classification of electrocorticographic signals: case study , 2009, Spinal Cord.

[68]  V. Mathiowetz,et al.  Adult norms for the Box and Block Test of manual dexterity. , 1985, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[69]  Nicholas V. Annetta,et al.  Extracting wavelet based neural features from human intracortical recordings for neuroprosthetics applications , 2018, Bioelectronic Medicine.

[70]  Chethan Pandarinath,et al.  Feasibility of Automatic Error Detect-and-Undo System in Human Intracortical Brain–Computer Interfaces , 2018, IEEE Transactions on Biomedical Engineering.

[71]  Brian T. Smith,et al.  Psychometric rigor of the Grasp and Release Test for measuring functional limitation of persons with tetraplegia: a preliminary analysis. , 2004, The journal of spinal cord medicine.

[72]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[73]  Christian Klaes,et al.  Invasive Brain-Computer Interfaces and Neural Recordings From Humans , 2018 .

[74]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[75]  Michael L. Boninger,et al.  Intracortical Microstimulation as a Feedback Source for Brain-Computer Interface Users , 2017, Brain-Computer Interface Research.

[76]  Amit Konar,et al.  Motor imagery and error related potential induced position control of a robotic arm , 2017, IEEE/CAA Journal of Automatica Sinica.

[77]  Michael J. Black,et al.  Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array , 2011 .

[78]  T. Oxley,et al.  Removing the need for invasive brain surgery: the potential of stent electrodes , 2019, Bioelectronics in Medicine.

[79]  Robert D Flint,et al.  Long-Term Stability of Motor Cortical Activity: Implications for Brain Machine Interfaces and Optimal Feedback Control , 2016, The Journal of Neuroscience.

[80]  G. Pfurtscheller,et al.  ‘Thought’ – control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia , 2003, Neuroscience Letters.

[81]  Steven M Chase,et al.  Intracortical recording stability in human brain–computer interface users , 2018, Journal of neural engineering.

[82]  Gytis Baranauskas,et al.  What limits the performance of current invasive brain machine interfaces? , 2014, Front. Syst. Neurosci..

[83]  Maarten Joost IJzerman,et al.  The NESS Handmaster othosis , 1996 .

[84]  K. Kilgore,et al.  Efficacy of an implanted neuroprosthesis for restoring hand grasp in tetraplegia: a multicenter study. , 2001, Archives of physical medicine and rehabilitation.

[85]  Marc W. Slutzky,et al.  Continuous decoding of human grasp kinematics using epidural and subdural signals , 2017, Journal of neural engineering.

[86]  Michael L Boninger,et al.  Functional priorities, assistive technology, and brain-computer interfaces after spinal cord injury. , 2013, Journal of rehabilitation research and development.

[87]  Nitish V. Thakor,et al.  Demonstration of a Semi-Autonomous Hybrid Brain–Machine Interface Using Human Intracranial EEG, Eye Tracking, and Computer Vision to Control a Robotic Upper Limb Prosthetic , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[88]  David A. Friedenberg,et al.  Neuroprosthetic-enabled control of graded arm muscle contraction in a paralyzed human , 2017, Scientific Reports.