Reprint of "Multimodal adaptive interfaces for 3D robot-mediated upper limb neuro-rehabilitation: An overview of bio-cooperative systems"

Robot-mediated neuro-rehabilitation has been proved to be an effective therapeutic approach for upper limb motor recovery after stroke, though its actual potential when compared to other conventional approaches has still to be fully demonstrated. Most of the proposed solutions use a planar workspace. One key aspect for influencing motor recovery mechanisms, such as neuroplasticity and the level of motivation and involvement of the patient in the exercise, is the design of patient-tailored protocols and on-line adaptation of the assistance provided by the robotic agent to the patient performance. Also, when abilities for performing activities of daily living shall be targeted, exercises in 3D workspace are highly preferable. This paper wants to provide a complete overview on bio-cooperative systems on neuro-rehabilitation, with a special focus on 3D multimodal adaptive interfaces, by partly in-depth reviewing the literature and partly proposing an illustrative case of how to build such a bio-cooperative based on the authors current research. It consists of an operational robotic platform for 3D upper limb robot-aided rehabilitation, directly derived from the MAAT system previously developed by the same research group. The system features on-line adaptation of therapy characteristics to specific patient needs and to the measured level of performance, by including the patient in the control loop. The system is composed of a 7-DoF robot arm, an adaptive interaction control system, a motorized arm-weight support system and a module for on-line evaluation of patient performance. Such module records patient biomechanical data through an unobtrusive, wearable sensory system, evaluates patient biomechanical state and updates robot control parameters for modifying level of assistance and task complexity in the 3D workspace. In addition, a multimodal interface provides information needed to control the motorized arm-weight support by means of a dedicated cablepulley system. Novel classification of bio-cooperative robotic systems.A multimodal 3D robotic platform for upper limb rehabilitation of post stroke patients.Mechatronic module for guaranteeing arm-weight support during therapy.

[1]  Enrique J. Gómez,et al.  Anticipatory assistance-as-needed control algorithm for a multijoint upper limb robotic orthosis in physical neurorehabilitation , 2014, Expert Syst. Appl..

[2]  W. Rymer,et al.  Understanding and treating arm movement impairment after chronic brain injury: progress with the ARM guide. , 2014, Journal of rehabilitation research and development.

[3]  Maarten J. IJzerman,et al.  Influence of Gravity Compensation on Muscle Activation Patterns During Different Temporal Phases of Arm Movements of Stroke Patients , 2009, Neurorehabilitation and neural repair.

[4]  N. Hogan,et al.  Robot-aided neurorehabilitation. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  N. Hogan,et al.  A working model of stroke recovery from rehabilitation robotics practitioners , 2009, Journal of NeuroEngineering and Rehabilitation.

[6]  Imre Horváth,et al.  Current status of robotic stroke rehabilitation and opportunities for a cyber-physically assisted upper limb stroke rehabilitation , 2014 .

[7]  Denis Mottet,et al.  Rehabilitation of arm function after stroke. Literature review. , 2009, Annals of physical and rehabilitation medicine.

[8]  Marcia Kilchenman O'Malley,et al.  Adaptive control of a serial-in-parallel robotic rehabilitation device , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[9]  M.J. Johnson,et al.  Development of ADLER: The Activities of Daily Living Exercise Robot , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[10]  W. Rymer,et al.  Adaptive assistance for guided force training in chronic stroke , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  J. Deutsch,et al.  Virtual Reality for Stroke Rehabilitation , 2012 .

[12]  Loredana Zollo,et al.  Patient-tailored adaptive robotic system for upper-limb rehabilitation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[13]  Farshid Amirabdollahian,et al.  Training modalities in robot-mediated upper limb rehabilitation in stroke: a framework for classification based on a systematic review , 2014, Journal of NeuroEngineering and Rehabilitation.

[14]  Robert Riener,et al.  A novel paradigm for patient-cooperative control of upper-limb rehabilitation robots , 2007, Adv. Robotics.

[15]  J. Basmajian,et al.  Biofeedback in physical medicine and rehabilitation , 1978, Biofeedback and self-regulation.

[16]  Nicola Vitiello,et al.  An EEG/EOG-based hybrid brain-neural computer interaction (BNCI) system to control an exoskeleton for the paralyzed hand , 2015, Biomedizinische Technik. Biomedical engineering.

[17]  David J. Reinkensmeyer,et al.  Robotic assist devices for bimanual physical therapy: preliminary experiments , 1993 .

[18]  Rong Song,et al.  A Comparison Between Electromyography-Driven Robot and Passive Motion Device on Wrist Rehabilitation for Chronic Stroke , 2009, Neurorehabilitation and neural repair.

[19]  Valentina Squeri,et al.  Adaptive regulation of assistance ‘as needed’ in robot-assisted motor skill learning and neuro-rehabilitation , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[20]  M. Munih,et al.  Psychophysiological Measurements in a Biocooperative Feedback Loop for Upper Extremity Rehabilitation , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Hermano Igo Krebs,et al.  Rehabilitation Robotics: Performance-Based Progressive Robot-Assisted Therapy , 2003, Auton. Robots.

[22]  J. Ferri,et al.  Efficacy of Armeo® Spring during the chronic phase of stroke. Study in mild to moderate cases of hemiparesis. , 2013 .

[23]  Robert Riener,et al.  Robot-aided neurorehabilitation of the upper extremities , 2005, Medical and Biological Engineering and Computing.

[24]  N. Hogan,et al.  A novel approach to stroke rehabilitation , 2000, Neurology.

[25]  M. Johnson,et al.  Quantifying kinematics of purposeful movements to real, imagined, or absent functional objects: Implications for modelling trajectories for robot-assisted ADL tasks** , 2007, Journal of NeuroEngineering and Rehabilitation.

[26]  Robert Riener,et al.  Online learning and adaptation of patient support during ADL training , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[27]  M. Grosse-Wentrup,et al.  Towards brain-robot interfaces in stroke rehabilitation , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[28]  A. Mihailidis,et al.  The development of an adaptive upper-limb stroke rehabilitation robotic system , 2011, Journal of NeuroEngineering and Rehabilitation.

[29]  D. Erol,et al.  Coordinated Control of Assistive Robotic Devices for Activities of Daily Living Tasks , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  E. Guglielmelli,et al.  An inverse kinematics algorithm for upper-limb joint reconstruction during robot-aided motor therapy , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[31]  Loredana Zollo,et al.  Upper-limb kinematic reconstruction during stroke robot-aided therapy , 2015, Medical & Biological Engineering & Computing.

[32]  Wei Zhou,et al.  Myoelectrically controlled wrist robot for stroke rehabilitation , 2013, Journal of NeuroEngineering and Rehabilitation.

[33]  Raymond K. Y. Tong,et al.  Coordinated upper limb training assisted with an electromyography (EMG)-driven hand robot after stroke , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  R. Riener,et al.  Bio-cooperative robotics: Controlling mechanical, physiological and mental patient states , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[35]  V. Dietz,et al.  Three-dimensional, task-specific robot therapy of the arm after stroke: a multicentre, parallel-group randomised trial , 2014, The Lancet Neurology.

[36]  M. Bilodeau,et al.  EMG frequency content changes with increasing force and during fatigue in the quadriceps femoris muscle of men and women. , 2003, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[37]  R.C.V. Loureiro,et al.  Reach & Grasp Therapy: Design and Control of a 9-DOF Robotic Neuro-rehabilitation System , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[38]  Marko Munih,et al.  A survey of methods for data fusion and system adaptation using autonomic nervous system responses in physiological computing , 2012, Interact. Comput..

[39]  A.U. Alahakone,et al.  Vibrotactile feedback systems: Current trends in rehabilitation, sports and information display , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[40]  Bernhard Schölkopf,et al.  A brain-robot interface for studying motor learning after stroke , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Eduardo Fernández,et al.  Multimodal Interfaces to Improve Therapeutic Outcomes in Robot-Assisted Rehabilitation , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[42]  Heba Lakany,et al.  Human Behavior Integration Improves Classification Rates in Real-Time BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  David A. Winter,et al.  Biomechanics and Motor Control of Human Movement , 1990 .

[44]  L. Cohen,et al.  Brain–machine interface in chronic stroke rehabilitation: A controlled study , 2013, Annals of neurology.

[45]  P. Giannoni,et al.  Wrist Rehabilitation in Chronic Stroke Patients by Means of Adaptive, Progressive Robot-Aided Therapy , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  N. Birbaumer.  Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[47]  Robert Riener,et al.  A review on bio-cooperative control in gait rehabilitation , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[48]  M. Munih,et al.  Psychophysiological Responses to Robotic Rehabilitation Tasks in Stroke , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  Marko Munih,et al.  Virtual Rehabilitation Environment Using Principles of Intrinsic Motivation and Game Design , 2012, PRESENCE: Teleoperators and Virtual Environments.

[50]  W. Rymer,et al.  Robot-assisted movement training for the stroke-impaired arm: Does it matter what the robot does? , 2006, Journal of rehabilitation research and development.

[51]  M.K. O'Malley,et al.  Design of a haptic arm exoskeleton for training and rehabilitation , 2006, IEEE/ASME Transactions on Mechatronics.

[52]  Loredana Zollo,et al.  Patient-Tailored Assistance: A New Concept of Assistive Robotic Device That Adapts to Individual Users , 2014, IEEE Robotics & Automation Magazine.

[53]  Ryanne J. M. Lemmens,et al.  Effects of task-oriented robot training on arm function, activity, and quality of life in chronic stroke patients: a randomized controlled trial , 2014, Journal of NeuroEngineering and Rehabilitation.

[54]  J. Contreras-Vidal,et al.  Applications of Brain–Machine Interface Systems in Stroke Recovery and Rehabilitation , 2014, Current Physical Medicine and Rehabilitation Reports.

[55]  M. Axe,et al.  Dynamic stability after ACL injury: who can hop? , 2000, Knee Surgery, Sports Traumatology, Arthroscopy.

[56]  K. Y. Tong,et al.  An EMG-driven exoskeleton hand robotic training device on chronic stroke subjects: Task training system for stroke rehabilitation , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[57]  Yoshiaki Hayashi,et al.  An EMG-Based Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[58]  A. Timmermans,et al.  Technology-assisted training of arm-hand skills in stroke: concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design , 2009, Journal of NeuroEngineering and Rehabilitation.

[59]  H. Hermens,et al.  Effect of augmented feedback on motor function of the affected upper extremity in rehabilitation patients: a systematic review of randomized controlled trials. , 2005, Journal of rehabilitation medicine.

[60]  D.J. Reinkensmeyer,et al.  Optimizing Compliant, Model-Based Robotic Assistance to Promote Neurorehabilitation , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[61]  Nicola Vitiello,et al.  Intention-Based EMG Control for Powered Exoskeletons , 2012, IEEE Transactions on Biomedical Engineering.

[62]  Ricardo Chavarriaga,et al.  A hybrid brain–computer interface based on the fusion of electroencephalographic and electromyographic activities , 2011, Journal of neural engineering.

[63]  Eric T. Wolbrecht,et al.  Adaptive control with state-dependent modeling of patient impairment for robotic movement therapy , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[64]  D. Reinkensmeyer,et al.  Review of control strategies for robotic movement training after neurologic injury , 2009, Journal of NeuroEngineering and Rehabilitation.

[65]  Robert Riener,et al.  ARMin - robot for rehabilitation of the upper extremities , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[66]  W. Rymer,et al.  Alterations in upper limb muscle synergy structure in chronic stroke survivors. , 2013, Journal of neurophysiology.

[67]  Maarten J. IJzerman,et al.  Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. , 2006, Journal of rehabilitation research and development.

[68]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[69]  M. Guadagnoli,et al.  Challenge Point: A Framework for Conceptualizing the Effects of Various Practice Conditions in Motor Learning , 2004, Journal of motor behavior.

[70]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[71]  Elsa Andrea Kirchner,et al.  Exoskeleton Technology in Rehabilitation: Towards an EMG-Based Orthosis System for Upper Limb Neuromotor Rehabilitation , 2013, J. Robotics.

[72]  Gerard Jounghyun Kim,et al.  A SWOT Analysis of the Field of Virtual Reality Rehabilitation and Therapy , 2005, Presence: Teleoperators & Virtual Environments.

[73]  Marko Munih,et al.  Upper limb motion analysis using haptic interface , 2001 .

[74]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[75]  J. Dewald,et al.  Shoulder abduction-induced reductions in reaching work area following hemiparetic stroke: neuroscientific implications , 2007, Experimental Brain Research.

[76]  Mindy F. Levin,et al.  Quality of Grasping and the Role of Haptics in a 3-D Immersive Virtual Reality Environment in Individuals With Stroke , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[77]  H. F. Machiel van der Loos,et al.  Development of robots for rehabilitation therapy: the Palo Alto VA/Stanford experience. , 2000, Journal of rehabilitation research and development.

[78]  Marcia Kilchenman O'Malley,et al.  Detecting movement intent from scalp EEG in a novel upper limb robotic rehabilitation system for stroke , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[79]  Loredana Zollo,et al.  Quantitative evaluation of upper-limb motor control in robot-aided rehabilitation , 2011, Medical & Biological Engineering & Computing.

[80]  L Dipietro,et al.  Changing motor synergies in chronic stroke. , 2007, Journal of neurophysiology.

[81]  L. Zollo,et al.  Robotic technologies and rehabilitation: new tools for upper-limb therapy and assessment in chronic stroke. , 2011, European journal of physical and rehabilitation medicine.

[82]  Eugenio Guglielmelli,et al.  Rehabilitation and Therapeutic Robotics , 2011 .

[83]  M. Bergamasco,et al.  A New Gaze-BCI-Driven Control of an Upper Limb Exoskeleton for Rehabilitation in Real-World Tasks , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[84]  Alicia Casals,et al.  Auto-adaptive robot-aided therapy using machine learning techniques , 2014, Comput. Methods Programs Biomed..

[85]  Robert Riener,et al.  ARMin III --arm therapy exoskeleton with an ergonomic shoulder actuation , 2009 .

[86]  J. Perez Turiel,et al.  Bio cooperative robotic platform for motor function recovery of the upper limb after stroke , 2010, EMBC 2010.

[87]  Robert Riener,et al.  Estimating the patient's contribution during robot-assisted therapy. , 2013, Journal of rehabilitation research and development.

[88]  Alin Albu-Schäffer,et al.  The KUKA-DLR Lightweight Robot arm - a new reference platform for robotics research and manufacturing , 2010, ISR/ROBOTIK.

[89]  N. Hogan,et al.  Movement Smoothness Changes during Stroke Recovery , 2002, The Journal of Neuroscience.

[90]  Frans C. T. van der Helm,et al.  Freebal: Design of a Dedicated Weight-Support System for Upper-Extremity Rehabilitation , 2009 .

[91]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[92]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[93]  N. Hogan,et al.  Motions or muscles? Some behavioral factors underlying robotic assistance of motor recovery. , 2006, Journal of rehabilitation research and development.

[94]  Cristina Gómez,et al.  Simulation-Based Planification Tool for an Assistance-as-Needed Upper Limb Neurorehabilitation Robotic Orthosis , 2014 .

[95]  Silvestro Micera,et al.  The effect of arm weight support on upper limb muscle synergies during reaching movements , 2014, Journal of NeuroEngineering and Rehabilitation.

[96]  P. Langhorne,et al.  Rehabilitation therapy services for stroke patients living at home: systematic review of randomised trials , 2004, The Lancet.

[97]  Manjunatha Mahadevappa,et al.  Effect of functional electrical stimulation on the effort and walking speed, surface electromyography activity, and metabolic responses in stroke subjects. , 2010, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[98]  A.H.A. Stienen,et al.  Freebal: dedicated gravity compensation for the upper extremities , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[99]  H. Krebs,et al.  Effects of Robot-Assisted Therapy on Upper Limb Recovery After Stroke: A Systematic Review , 2008, Neurorehabilitation and neural repair.

[100]  Grant D. Huang,et al.  Robot-assisted therapy for long-term upper-limb impairment after stroke. , 2010, The New England journal of medicine.

[101]  Giulio Sandini,et al.  Journal of Neuroengineering and Rehabilitation Performance Adaptive Training Control Strategy for Recovering Wrist Movements in Stroke Patients: a Preliminary, Feasibility Study , 2009 .

[102]  M. Munih,et al.  Challenges in biocooperative rehabilitation robotics , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[103]  C. Burgar,et al.  Robot-assisted movement training compared with conventional therapy techniques for the rehabilitation of upper-limb motor function after stroke. , 2002, Archives of physical medicine and rehabilitation.

[104]  A. U. Pehlivan,et al.  Current Trends in Robot-Assisted Upper-Limb Stroke Rehabilitation: Promoting Patient Engagement in Therapy , 2014, Current Physical Medicine and Rehabilitation Reports.

[105]  H I Krebs,et al.  Rehabilitation robotics. , 2013, Handbook of clinical neurology.

[106]  R. Riener,et al.  Real-Time Closed-Loop Control of Cognitive Load in Neurological Patients During Robot-Assisted Gait Training , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[107]  N. Hogan,et al.  The effect of robot-assisted therapy and rehabilitative training on motor recovery following stroke. , 1997, Archives of neurology.

[108]  Robert Riener,et al.  Special section on rehabilitation via bio-cooperative control. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[109]  Müjdat Çetin,et al.  Brain Computer Interface based robotic rehabilitation with online modification of task speed , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[110]  F Chollet,et al.  Neural Substrate for the Effects of Passive Training on Sensorimotor Cortical Representation: A Study with Functional Magnetic Resonance Imaging in Healthy Subjects , 2000, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[111]  J. Gladman,et al.  Individual Patient Data Meta-Analysis of Randomized Controlled Trials of Community Occupational Therapy for Stroke Patients , 2004, Stroke.

[112]  V Popescu,et al.  Virtual reality-based orthopedic telerehabilitation. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[113]  Peter Langhorne,et al.  Effects of Augmented Exercise Therapy Time After Stroke: A Meta-Analysis , 2004, Stroke.

[114]  Maja J Matarić,et al.  Socially Assistive Robotics for Post-stroke Rehabilitation Journal of Neuroengineering and Rehabilitation Socially Assistive Robotics for Post-stroke Rehabilitation , 2007 .