Hand-in-hand advances in biomedical engineering and sensorimotor restoration

BACKGROUND Living in a multisensory world entails the continuous sensory processing of environmental information in order to enact appropriate motor routines. The interaction between our body and our brain is the crucial factor for achieving such sensorimotor integration ability. Several clinical conditions dramatically affect the constant body-brain exchange, but the latest developments in biomedical engineering provide promising solutions for overcoming this communication breakdown. NEW METHOD The ultimate technological developments succeeded in transforming neuronal electrical activity into computational input for robotic devices, giving birth to the era of the so-called brain-machine interfaces. Combining rehabilitation robotics and experimental neuroscience the rise of brain-machine interfaces into clinical protocols provided the technological solution for bypassing the neural disconnection and restore sensorimotor function. RESULTS Based on these advances, the recovery of sensorimotor functionality is progressively becoming a concrete reality. However, despite the success of several recent techniques, some open issues still need to be addressed. COMPARISON WITH EXISTING METHOD(S) Typical interventions for sensorimotor deficits include pharmaceutical treatments and manual/robotic assistance in passive movements. These procedures achieve symptoms relief but their applicability to more severe disconnection pathologies is limited (e.g. spinal cord injury or amputation). CONCLUSIONS Here we review how state-of-the-art solutions in biomedical engineering are continuously increasing expectances in sensorimotor rehabilitation, as well as the current challenges especially with regards to the translation of the signals from brain-machine interfaces into sensory feedback and the incorporation of brain-machine interfaces into daily activities.

[1]  V. Dietz Body weight supported gait training: From laboratory to clinical setting , 2009, Brain Research Bulletin.

[2]  Krishna V. Shenoy,et al.  Combining Decoder Design and Neural Adaptation in Brain-Machine Interfaces , 2014, Neuron.

[3]  Olaf Blanke,et al.  Anatomically plausible illusory posture affects mental rotation of body parts , 2013, Cognitive, affective & behavioral neuroscience.

[4]  B. Rockstroh,et al.  Area-specific self-regulation of slow cortical potentials on the sagittal midline and its effects on behavior. , 1992, Electroencephalography and clinical neurophysiology.

[5]  Michael J. Black,et al.  Decoding Complete Reach and Grasp Actions from Local Primary Motor Cortex Populations , 2010, The Journal of Neuroscience.

[6]  O. Blanke,et al.  Differential influence of hands posture on mental rotation of hands and feet in left and right handers , 2009, Experimental Brain Research.

[7]  V. Dietz,et al.  Neurological aspects of spinal-cord repair: promises and challenges , 2006, The Lancet Neurology.

[8]  Edward M. Schmidt,et al.  Single neuron recording from motor cortex as a possible source of signals for control of external devices , 2006, Annals of Biomedical Engineering.

[9]  Mary Y. Harley,et al.  Implanted neuroprosthesis for assisting arm and hand function after stroke: a case study. , 2012, Journal of rehabilitation research and development.

[10]  Arcangelo Merla,et al.  Step‐by‐step: The effects of physical practice on the neural correlates of locomotion imagery revealed by fMRI , 2009, Human brain mapping.

[11]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[12]  E. Fetz Operant Conditioning of Cortical Unit Activity , 1969, Science.

[13]  E. Marsolais,et al.  Walking with a hybrid orthosis system , 1999, Spinal Cord.

[14]  Christian Antfolk,et al.  Sensory feedback in upper limb prosthetics , 2013, Expert review of medical devices.

[15]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[16]  T. Sinkjaer,et al.  Clinical evaluation of Functional Electrical Therapy in acute hemiplegic subjects. , 2003, Journal of rehabilitation research and development.

[17]  José Luis Contreras-Vidal,et al.  Reconstructing hand kinematics during reach to grasp movements from electroencephalographic signals , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  S. Micera,et al.  In Human Implant of Intraneural Multielectrodes for Controlling a 5-Fingered Hand Prosthesis and Delivering Sensorial Feedback , 2012 .

[19]  Markus Reischl,et al.  OrthoJacket: an active FES-hybrid orthosis for the paralysed upper extremity , 2011, Biomedizinische Technik. Biomedical engineering.

[20]  J. Fridén,et al.  Brachialis-to-extensor carpi radialis longus selective nerve transfer to restore wrist extension in tetraplegia: case report. , 2012, The Journal of hand surgery.

[21]  C M Light,et al.  Intelligent multifunction myoelectric control of hand prostheses , 2002, Journal of medical engineering & technology.

[22]  F. Piccione,et al.  P300-based brain computer interface: Reliability and performance in healthy and paralysed participants , 2006, Clinical Neurophysiology.

[23]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[24]  S. Aglioti,et al.  The body in the brain revisited , 2009, Experimental Brain Research.

[25]  Michael J. Black,et al.  Decoding grasp aperture from motor-cortical population activity , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[26]  L. Cohen,et al.  Neuroplasticity in the context of motor rehabilitation after stroke , 2011, Nature Reviews Neurology.

[27]  Chris Berka,et al.  Drowsiness/alertness algorithm development and validation using synchronized EEG and cognitive performance to individualize a generalized model , 2011, Biological Psychology.

[28]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[29]  Qinyin Qiu,et al.  Journal of Neuroengineering and Rehabilitation Design of a Complex Virtual Reality Simulation to Train Finger Motion for Persons with Hemiparesis: a Proof of Concept Study , 2022 .

[30]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[31]  E. Fetz,et al.  Correlations between activity of motor cortex cells and arm muscles during operantly conditioned response patterns , 1975, Experimental Brain Research.

[32]  R. Riener,et al.  Effects of intensive arm training with the rehabilitation robot ARMin II in chronic stroke patients: four single-cases , 2009, Journal of NeuroEngineering and Rehabilitation.

[33]  D. J. Weber,et al.  Limb-State Information Encoded by Peripheral and Central Somatosensory Neurons: Implications for an Afferent Interface , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  G. Berns,et al.  BAD TO WORSE , 1975, The Lancet.

[35]  C. Burgar,et al.  Robot-assisted upper-limb therapy in acute rehabilitation setting following stroke: Department of Veterans Affairs multisite clinical trial. , 2011, Journal of rehabilitation research and development.

[36]  K. Hiraki,et al.  Rubber Hand Illusion under Delayed Visual Feedback , 2009, PloS one.

[37]  Andrés Úbeda,et al.  BMIs for Motor Rehabilitation: Key Concepts and Challenges , 2014 .

[38]  M. Murray,et al.  Focal dystonia and the Sensory-Motor Integrative Loop for Enacting (SMILE) , 2014, Front. Hum. Neurosci..

[39]  F. Lacquaniti,et al.  From Spinal Central Pattern Generators to Cortical Network: Integrated BCI for Walking Rehabilitation , 2012, Neural plasticity.

[40]  Robert D. Lipschutz,et al.  Robotic leg control with EMG decoding in an amputee with nerve transfers. , 2013, The New England journal of medicine.

[41]  N. Thakor,et al.  Electrocorticographic amplitude predicts finger positions during slow grasping motions of the hand , 2010, Journal of neural engineering.

[42]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[43]  L. Miller,et al.  Restoring sensorimotor function through intracortical interfaces: progress and looming challenges , 2014, Nature Reviews Neuroscience.

[44]  Vera Kaiser,et al.  Hybrid brain-computer interfaces and hybrid neuroprostheses for restoration of upper limb functions in individuals with high-level spinal cord injury , 2013, Artif. Intell. Medicine.

[45]  A. J. del-Ama,et al.  Review of hybrid exoskeletons to restore gait following spinal cord injury. , 2012, Journal of rehabilitation research and development.

[46]  H. Flor,et al.  The thought translation device (TTD) for completely paralyzed patients. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[47]  A Pouget,et al.  Decoding M1 neurons during multiple finger movements. , 2007, Journal of neurophysiology.

[48]  Kapil D. Katyal,et al.  Behavioral Demonstration of a Somatosensory Neuroprosthesis , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[50]  John Porrill,et al.  Cerebellar Motor Learning: When Is Cortical Plasticity Not Enough? , 2007, PLoS Comput. Biol..

[51]  Silvestro Micera,et al.  Control of Multifunctional Prosthetic Hands by Processing the Electromyographic Signal. , 2017, Critical reviews in biomedical engineering.

[52]  J. del R. Millán,et al.  Multimodal Fusion of Muscle and Brain Signals for a Hybrid-BCI , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[53]  Agnès Roby-Brami,et al.  Upper limb kinematics after cervical spinal cord injury: a review , 2015, Journal of NeuroEngineering and Rehabilitation.

[54]  S. Grossberg,et al.  A Self-Organizing Neural Model of Motor Equivalent Reaching and Tool Use by a Multijoint Arm , 1993, Journal of Cognitive Neuroscience.

[55]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[56]  Olaf Blanke,et al.  Body Context and Posture Affect Mental Imagery of Hands , 2012, PloS one.

[57]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[58]  Olaf Gefeller,et al.  Epidemiology of Ischemic Stroke Subtypes According to TOAST Criteria: Incidence, Recurrence, and Long-Term Survival in Ischemic Stroke Subtypes: A Population-Based Study , 2001, Stroke.

[59]  R. J. Vogelstein,et al.  Restoring the sense of touch with a prosthetic hand through a brain interface , 2013, Proceedings of the National Academy of Sciences.

[60]  M. Williams,et al.  Evaluation of command sources for a high tetraplegia neural prosthesis , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[61]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[62]  S. Aglioti,et al.  The influence of hands posture on mental rotation of hands and feet , 2007, Experimental Brain Research.

[63]  P. Brugger,et al.  Mental rotation of congenitally absent hands , 2007, Journal of the International Neuropsychological Society.

[64]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[65]  P. Rossini,et al.  Double nerve intraneural interface implant on a human amputee for robotic hand control , 2010, Clinical Neurophysiology.

[66]  T. Kuiken,et al.  Sensory capacity of reinnervated skin after redirection of amputated upper limb nerves to the chest , 2009, Brain : a journal of neurology.

[67]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[68]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[69]  Jose L Pons,et al.  Converging clinical and engineering research on neurorehabilitation , 2013 .

[70]  James A. Reggia,et al.  Cortex inspired model for inverse kinematics computation for a humanoid robotic finger , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[71]  M. Popovic,et al.  Control of a neuroprosthesis for grasping using off-line classification of electrocorticographic signals: case study , 2009, Spinal Cord.

[72]  Hyun-Chool Shin,et al.  Asynchronous Decoding of Dexterous Finger Movements Using M1 Neurons , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[73]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[74]  Shennan A. Weiss,et al.  Behavioural neuroscience: Rat navigation guided by remote control , 2002, Nature.

[75]  Jacob L. Segil,et al.  Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review. , 2013, Journal of rehabilitation research and development.

[76]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[77]  K. Dashtipour,et al.  Evidence for the effectiveness of botulinum toxin for writer’s cramp , 2008, Journal of Neural Transmission.

[78]  Olaf Blanke,et al.  Mental Imagery for Full and Upper Human Bodies: Common Right Hemisphere Activations and Distinct Extrastriate Activations , 2010, Brain Topography.

[79]  Silvia Conforto,et al.  Biologically Inspired Modelling for the Control of Upper Limb Movements: From Concept Studies to Future Applications , 2009, Front. Neurorobot..

[80]  L. Der-Yeghiaian,et al.  Robot-based hand motor therapy after stroke. , 2007, Brain : a journal of neurology.

[81]  A. Nobunaga,et al.  Recent demographic and injury trends in people served by the Model Spinal Cord Injury Care Systems. , 1999, Archives of physical medicine and rehabilitation.

[82]  S. Adamovich,et al.  Sensorimotor Training in a Virtual Reality Environment: Does It Improve Functional Recovery Poststroke? , 2006, Neurorehabilitation and neural repair.

[83]  Hannes P. Saal,et al.  Touch is a team effort: interplay of submodalities in cutaneous sensibility , 2014, Trends in Neurosciences.

[84]  M. Molinari,et al.  Rehabilitation of gait after stroke: a review towards a top-down approach , 2011, Journal of NeuroEngineering and Rehabilitation.

[85]  Hannes Bleuler,et al.  Active tactile exploration enabled by a brain-machine-brain interface , 2011, Nature.

[86]  N. Hogan,et al.  Overview of clinical trials with MIT-MANUS: a robot-aided neuro-rehabilitation facility. , 1999, Technology and health care : official journal of the European Society for Engineering and Medicine.

[87]  G E Loeb,et al.  BION system for distributed neural prosthetic interfaces. , 2001, Medical engineering & physics.

[88]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[89]  Stefan Hesse,et al.  Transfer of scientific concepts to clinical practice: recent robot-assisted training studies. , 2009, Functional neurology.

[90]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[91]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[92]  E. Fetz,et al.  Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. , 1973, Journal of neurophysiology.

[93]  D. Zlotolow,et al.  Advances in upper extremity prosthetics. , 2012, Hand clinics.

[94]  J. Wolpaw,et al.  Decoding flexion of individual fingers using electrocorticographic signals in humans , 2009, Journal of neural engineering.

[95]  N. Birbaumer,et al.  The thought translation device: a neurophysiological approach to communication in total motor paralysis , 1999, Experimental Brain Research.

[96]  Maarten J. IJzerman,et al.  Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. , 2006, Journal of rehabilitation research and development.

[97]  P. Kennedy,et al.  Restoration of neural output from a paralyzed patient by a direct brain connection , 1998, Neuroreport.

[98]  G. Alon,et al.  Functional Electrical Stimulation Enhancement of Upper Extremity Functional Recovery During Stroke Rehabilitation: A Pilot Study , 2007, Neurorehabilitation and neural repair.

[99]  E. Fetz,et al.  Operant Conditioning of Specific Patterns of Neural and Muscular Activity , 1971, Science.

[100]  Paul S. Weiss,et al.  The Brain Activity Map , 2013, Science.

[101]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[102]  S. Grossberg,et al.  A neural model of cerebellar learning for arm movement control: cortico-spino-cerebellar dynamics. , 1997, Learning & memory.