The future of upper extremity rehabilitation robotics: research and practice

The loss of upper limb motor function can have a devastating effect on people's lives. To restore upper limb control and functionality, researchers and clinicians have developed interfaces to interact directly with the human body's motor system. In this invited review, we aim to provide details on the peripheral nerve interfaces and brain‐machine interfaces that have been developed in the past 30 years for upper extremity control, and we highlight the challenges that still remain to transition the technology into the clinical market. The findings show that peripheral nerve interfaces and brain‐machine interfaces have many similar characteristics that enable them to be concurrently developed. Decoding neural information from both interfaces may lead to novel physiological models that may one day fully restore upper limb motor function for a growing patient population.

[1]  D. Durand,et al.  Chronic Response of the Rat Sciatic Nerve to the Flat Interface Nerve Electrode , 2003, Annals of Biomedical Engineering.

[2]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[3]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[4]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[5]  Dominique M. Durand,et al.  Stable Detection of Movement Intent From Peripheral Nerves: Chronic Study in Dogs , 2017, Proceedings of the IEEE.

[6]  Nicholas B Langhals,et al.  Regenerative Peripheral Nerve Interface Viability and Signal Transduction with an Implanted Electrode , 2014, Plastic and reconstructive surgery.

[7]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[8]  A Pouget,et al.  Decoding M1 neurons during multiple finger movements. , 2007, Journal of neurophysiology.

[9]  Dominique M Durand,et al.  Model-based Bayesian signal extraction algorithm for peripheral nerves , 2017, Journal of neural engineering.

[10]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[11]  Josef Parvizi,et al.  Hand posture classification using electrocorticography signals in the gamma band over human sensorimotor brain areas , 2013, Journal of neural engineering.

[12]  Robert D. Lipschutz,et al.  The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee , 2004, Prosthetics and orthotics international.

[13]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[15]  Vikash Gilja,et al.  Assessment of brain–machine interfaces from the perspective of people with paralysis , 2015, Journal of neural engineering.

[16]  Z T Irwin,et al.  Neural control of finger movement via intracortical brain–machine interface , 2017, Journal of neural engineering.

[17]  B. Greger,et al.  Decoding Dexterous Finger Movements in a Neural Prosthesis Model Approaching Real-World Conditions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  P. Peckham,et al.  Functional electrical stimulation for neuromuscular applications. , 2005, Annual review of biomedical engineering.

[19]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Nicholas V. Annetta,et al.  Restoring cortical control of functional movement in a human with quadriplegia , 2016, Nature.

[21]  R. Andersen,et al.  A floating metal microelectrode array for chronic implantation , 2007, Journal of Neuroscience Methods.

[22]  Xavier Navarro,et al.  Fascicular Topography of the Human Median Nerve for Neuroprosthetic Surgery , 2016, Front. Neurosci..

[23]  D. Durand,et al.  Functionally selective peripheral nerve stimulation with a flat interface nerve electrode , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Cynthia A. Chestek,et al.  Closed-Loop Continuous Hand Control via Chronic Recording of Regenerative Peripheral Nerve Interfaces , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  J. Mortimer,et al.  A spiral nerve cuff electrode for peripheral nerve stimulation , 1988, IEEE Transactions on Biomedical Engineering.

[26]  Christopher M. Frost,et al.  Development of a Regenerative Peripheral Nerve Interface for Control of a Neuroprosthetic Limb , 2016, BioMed research international.

[27]  D. Durand,et al.  Improved nerve cuff electrode recordings with subthreshold anodic currents , 1998, IEEE Transactions on Biomedical Engineering.

[28]  K. Horch,et al.  Acute peripheral nerve recording Characteristics of polymer-based longitudinal intrafascicular electrodes , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Jian Zhang,et al.  Residual motor signal in long-term human severed peripheral nerves and feasibility of neural signal-controlled artificial limb. , 2007, The Journal of hand surgery.

[30]  K.L. Kilgore,et al.  Synthesis of hand grasp using functional neuromuscular stimulation , 1989, IEEE Transactions on Biomedical Engineering.

[31]  T. Kuiken,et al.  Myoelectric Pattern Recognition Outperforms Direct Control for Transhumeral Amputees with Targeted Muscle Reinnervation: A Randomized Clinical Trial , 2017, Scientific Reports.

[32]  P. H. Peckham,et al.  Controlled prehension and release in the C5 quadriplegic elicited by functional electrical stimulation of the paralyzed forearm musculature , 2006, Annals of Biomedical Engineering.

[33]  R Brent Gillespie,et al.  In vivo characterization of regenerative peripheral nerve interface function , 2016, Journal of neural engineering.

[34]  P. H. Peckham,et al.  An implanted upper-extremity neuroprosthesis using myoelectric control. , 2008, The Journal of hand surgery.

[35]  M. M. Morrow,et al.  Prediction of muscle activity by populations of sequentially recorded primary motor cortex neurons. , 2003, Journal of neurophysiology.

[36]  Antonio Frisoli,et al.  Online Finger Control Using High-Density EMG and Minimal Training Data for Robotic Applications , 2019, IEEE Robotics and Automation Letters.

[37]  Mikhail A Lebedev,et al.  Stable Ensemble Performance with Single-neuron Variability during Reaching Movements in Primates , 2022 .

[38]  D. M. Durand,et al.  Bayesian Spatial Filters for Source Signal Extraction: A Study in the Peripheral Nerve , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Kapil D. Katyal,et al.  Individual finger control of a modular prosthetic limb using high-density electrocorticography in a human subject , 2016, Journal of neural engineering.

[40]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[41]  P. London.  Injury , 1969, Definitions.

[42]  Reid R. Harrison,et al.  Recording sensory and motor information from peripheral nerves with Utah Slanted Electrode Arrays , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[43]  D. Farina,et al.  Accessing the Neural Drive to Muscle and Translation to Neurorehabilitation Technologies , 2012, IEEE Reviews in Biomedical Engineering.

[44]  M. Keith,et al.  A neural interface provides long-term stable natural touch perception , 2014, Science Translational Medicine.

[45]  Spinal Cord Injury Facts and Figures at a Glance , 2014, The journal of spinal cord medicine.

[46]  N. Shoylev,et al.  Neural Networks for Online Classification of Hand and Finger Movements Using Surface EMG signals , 2006, 2006 8th Seminar on Neural Network Applications in Electrical Engineering.

[47]  J. Wolpaw,et al.  Decoding flexion of individual fingers using electrocorticographic signals in humans , 2009, Journal of neural engineering.

[48]  David G Lloyd,et al.  Neuromusculoskeletal modeling: estimation of muscle forces and joint moments and movements from measurements of neural command. , 2004, Journal of applied biomechanics.

[49]  Craig T. Nordhausen,et al.  Single unit recording capabilities of a 100 microelectrode array , 1996, Brain Research.

[50]  Dario Farina,et al.  Extracting Signals Robust to Electrode Number and Shift for Online Simultaneous and Proportional Myoelectric Control by Factorization Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[51]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[52]  Ping Zhou,et al.  Decoding a new neural machine interface for control of artificial limbs. , 2007, Journal of neurophysiology.

[53]  V. Patrone,et al.  Gut microbiota profile in systemic sclerosis patients with and without clinical evidence of gastrointestinal involvement , 2017, Scientific Reports.

[54]  Robert D. Lipschutz,et al.  Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. , 2009, JAMA.

[55]  Cynthia A. Chestek,et al.  Cortical Decoding of Individual Finger Group Motions Using ReFIT Kalman Filter , 2018, Front. Neurosci..

[56]  Maarten J. IJzerman,et al.  Survey of the needs of patients with spinal cord injury: impact and priority for improvement in hand function in tetraplegics , 2004, Spinal Cord.

[57]  T. Kuiken,et al.  Targeted Muscle Reinnervation : A Neural Interface for Artificial Limbs , 2013 .

[58]  R J Triolo,et al.  Intraoperative evaluation of the spiral nerve cuff electrode on the femoral nerve trunk , 2009, Journal of neural engineering.

[59]  K. Horch,et al.  A silicon-based, three-dimensional neural interface: manufacturing processes for an intracortical electrode array , 1991, IEEE Transactions on Biomedical Engineering.

[60]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[61]  M. Nicolelis,et al.  Reconstructing the Engram: Simultaneous, Multisite, Many Single Neuron Recordings , 1997, Neuron.

[62]  Barbara Hammer,et al.  Transfer Learning for Rapid Re-calibration of a Myoelectric Prosthesis After Electrode Shift , 2017 .

[63]  G.S. Dhillon,et al.  Direct neural sensory feedback and control of a prosthetic arm , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[64]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[65]  Jana D. Moon,et al.  Quantification of Regenerative Peripheral Nerve Interface Signal Transmission , 2012 .

[66]  Daniela Calvetti,et al.  Hierarchical beamformer and cross-talk reduction in electroneurography , 2011, Journal of neural engineering.

[67]  Theodore A Kung,et al.  Prophylactic Regenerative Peripheral Nerve Interfaces to Prevent Postamputation Pain. , 2019, Plastic and reconstructive surgery.

[68]  Z T Irwin,et al.  Chronic recording of hand prosthesis control signals via a regenerative peripheral nerve interface in a rhesus macaque. , 2016, Journal of neural engineering.

[69]  David J. Warren,et al.  Recording and Decoding for Neural Prostheses , 2016, Proceedings of the IEEE.

[70]  Dario Farina,et al.  Robust simultaneous myoelectric control of multiple degrees of freedom in wrist-hand prostheses by real-time neuromusculoskeletal modeling , 2018, Journal of neural engineering.

[71]  Qin,et al.  A Brain–Spinal Interface Alleviating Gait Deficits after Spinal Cord Injury in Primates , 2017 .

[72]  Aidan D. Roche,et al.  Prosthetic Myoelectric Control Strategies: A Clinical Perspective , 2014, Current Surgery Reports.

[73]  K. Horch,et al.  Residual function in peripheral nerve stumps of amputees: implications for neural control of artificial limbs. , 2004, The Journal of hand surgery.

[74]  Carole Pegg.  Recordings , 1949, Tempo.

[75]  Christopher C. Cline,et al.  Noninvasive neuroimaging enhances continuous neural tracking for robotic device control , 2019, Science Robotics.

[76]  K. Kilgore,et al.  Efficacy of an implanted neuroprosthesis for restoring hand grasp in tetraplegia: a multicenter study. , 2001, Archives of physical medicine and rehabilitation.

[77]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[78]  C. K. Battye,et al.  The use of myo-electric currents in the operation of prostheses. , 1955, The Journal of bone and joint surgery. British volume.

[79]  R. Brent Gillespie,et al.  A regenerative peripheral nerve interface allows real-time control of an artificial hand in upper limb amputees , 2020, Science Translational Medicine.

[80]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[81]  D. J. Warren,et al.  A neural interface for a cortical vision prosthesis , 1999, Vision Research.

[82]  R L Lieber,et al.  Acceptable benefits and risks associated with surgically improving arm function in individuals living with cervical spinal cord injury , 2009, Spinal Cord.

[83]  Marc W. Slutzky,et al.  Continuous decoding of human grasp kinematics using epidural and subdural signals , 2017, Journal of neural engineering.

[84]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[85]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[86]  L. Miller,et al.  Restoration of grasp following paralysis through brain-controlled stimulation of muscles , 2012, Nature.

[87]  D.M. Durand,et al.  Localization and Recovery of Peripheral Neural Sources With Beamforming Algorithms , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[88]  D. Hutchinson,et al.  A histological analysis of human median and ulnar nerves following implantation of Utah slanted electrode arrays. , 2016, Biomaterials.

[89]  J. A. Wilson,et al.  Two-dimensional movement control using electrocorticographic signals in humans , 2008, Journal of neural engineering.

[90]  G A Clark,et al.  Restoring motor control and sensory feedback in people with upper extremity amputations using arrays of 96 microelectrodes implanted in the median and ulnar nerves , 2016, Journal of neural engineering.

[91]  Nicholas G Hatsopoulos,et al.  Incorporating Feedback from Multiple Sensory Modalities Enhances Brain–Machine Interface Control , 2010, The Journal of Neuroscience.

[92]  T. Kuiken,et al.  Occupational therapy protocol for amputees with targeted muscle reinnervation. , 2009, Journal of rehabilitation research and development.

[93]  R. Stein,et al.  Selective stimulation of cat sciatic nerve using an array of varying-length microelectrodes. , 2001, Journal of neurophysiology.

[94]  David J. Warren,et al.  Restoration of motor control and proprioceptive and cutaneous sensation in humans with prior upper-limb amputation via multiple Utah Slanted Electrode Arrays (USEAs) implanted in residual peripheral arm nerves , 2017, Journal of NeuroEngineering and Rehabilitation.

[95]  Lee E Miller,et al.  Prediction of upper limb muscle activity from motor cortical discharge during reaching , 2007, Journal of neural engineering.

[96]  P. Cederna,et al.  Regenerative Peripheral Nerve Interface for Management of Postamputation Neuroma. , 2018, JAMA surgery.

[97]  K. Anderson.  Targeting recovery: priorities of the spinal cord-injured population. , 2004, Journal of neurotrauma.

[98]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[99]  Todd A. Kuiken,et al.  The Effects of Electrode Size and Orientation on the Sensitivity of Myoelectric Pattern Recognition Systems to Electrode Shift , 2011, IEEE Transactions on Biomedical Engineering.

[100]  T. Stieglitz,et al.  A transverse intrafascicular multichannel electrode (TIME) to interface with the peripheral nerve. , 2010, Biosensors & bioelectronics.

[101]  David J. Warren,et al.  Electrophysiological Mapping of Cat Primary Auditory Cortex with Multielectrode Arrays , 2006, Annals of Biomedical Engineering.

[102]  T. Kuiken,et al.  Neural Interfaces for Control of Upper Limb Prostheses: The State of the Art and Future Possibilities , 2011, PM & R : the journal of injury, function, and rehabilitation.

[103]  M. Swiontkowski.  Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[104]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[105]  Andreas Schulze-Bonhage,et al.  Decoding natural grasp types from human ECoG , 2012, NeuroImage.

[106]  Surya Ganguli,et al.  Accurate Estimation of Neural Population Dynamics without Spike Sorting , 2017, Neuron.

[107]  Lauren H Smith,et al.  Use of probabilistic weights to enhance linear regression myoelectric control , 2015, Journal of neural engineering.

[108]  Benedetto Mungo,et al.  Minimally Invasive Esophagectomy: Are There Significant Benefits? , 2014, Current Surgery Reports.

[109]  David Hankin,et al.  First-in-man demonstration of a fully implanted myoelectric sensors system to control an advanced electromechanical prosthetic hand , 2015, Journal of Neuroscience Methods.

[110]  Francis R. Willett,et al.  Restoration of reaching and grasping in a person with tetraplegia through brain-controlled muscle stimulation: a proof-of-concept demonstration , 2017, The Lancet.

[111]  Dario Farina,et al.  Hybrid neuromusculoskeletal modeling to best track joint moments using a balance between muscle excitations derived from electromyograms and optimization. , 2014, Journal of biomechanics.

[112]  Roger M. Enoka,et al.  Physiology of the motor neuron and the motor unit , 2004 .

[113]  Arto Nurmikko,et al.  An implantable wireless neural interface for recording cortical circuit dynamics in moving primates , 2013, Journal of neural engineering.

[114]  D.B. Popovic,et al.  Sensory nerve recording for closed-loop control to restore motor functions , 1993, IEEE Transactions on Biomedical Engineering.

[115]  Luca Citi,et al.  Decoding of grasping information from neural signals recorded using peripheral intrafascicular interfaces , 2011, Journal of NeuroEngineering and Rehabilitation.

[116]  D. Farina,et al.  Spatial Correlation of High Density EMG Signals Provides Features Robust to Electrode Number and Shift in Pattern Recognition for Myocontrol , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[117]  P. Rossini,et al.  Double nerve intraneural interface implant on a human amputee for robotic hand control , 2010, Clinical Neurophysiology.

[118]  K. Horch,et al.  Object Discrimination With an Artificial Hand Using Electrical Stimulation of Peripheral Tactile and Proprioceptive Pathways With Intrafascicular Electrodes , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[119]  Todd A Kuiken,et al.  Targeted Muscle Reinnervation and Advanced Prosthetic Arms , 2015, Seminars in Plastic Surgery.

[120]  Scott M Tintle,et al.  Targeted Muscle Reinnervation Treats Neuroma and Phantom Pain in Major Limb Amputees: A Randomized Clinical Trial. , 2019, Annals of surgery.

[121]  Chethan Pandarinath,et al.  Inferring single-trial neural population dynamics using sequential auto-encoders , 2017, Nature Methods.

[122]  Elizaveta V Okorokova,et al.  Biomimetic sensory feedback through peripheral nerve stimulation improves dexterous use of a bionic hand , 2019, Science Robotics.

[123]  Dario Farina,et al.  Improving the Robustness of Myoelectric Pattern Recognition for Upper Limb Prostheses by Covariate Shift Adaptation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[124]  D M Durand,et al.  Spiral nerve cuff electrode for recordings of respiratory output. , 1997, Journal of applied physiology.

[125]  Dario Farina,et al.  Simultaneous and Proportional Force Estimation for Multifunction Myoelectric Prostheses Using Mirrored Bilateral Training , 2011, IEEE Transactions on Biomedical Engineering.

[126]  Huanan Zhang,et al.  Chronic in vivo stability assessment of carbon fiber microelectrode arrays , 2016, Journal of neural engineering.