Control implementation for an integrated robotic and virtual mirror therapy system for stroke rehabilitation

Stroke affects approximately 2% of the population, and with advances in modern technology, more patients are surviving the event and requiring rehabilitation, placing further demand on already stretched medical systems. Because of this, an emergent area of research has arisen, investigating the use of robotics as a means to aid in the rehabilitation of patients affected by stroke. Projects such as the MIT Manus have provided evidence of the efficacy of robotic rehabilitation for stroke patients, but further research is required to provide ongoing improvements to this approach. Further to this, mirror therapy, a treatment initially found to be useful in the treatment of phantom pain syndrome in amputees, has also shown promise in the rehabilitation of stroke, though further research into the mechanisms behind mirror therapy need further investigation. A novel prototype robotic rehabilitation system was developed to investigate the integration of these two emergent approaches to stroke rehabilitation as a more comprehensive approach to stroke rehabilitation. This system was developed around a small industrial robot, utilising motion capture and force feedback for control of the robot with a virtual mirror therapy system to provide visual stimulation for the patient. The operation of the prototype was verified, however further development is required to produce a system suitable for patient trials.

[1]  T. Matyas,et al.  Can simultaneous bilateral movement involve the undamaged hemisphere in reconstruction of neural networks damaged by stroke? , 2000, Disability and rehabilitation.

[2]  Stefano Mazzoleni,et al.  Upper limb robot-assisted therapy in subacute and chronic stroke patients: Preliminary results on initial exposure based on kinematic measures , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[3]  N. Hogan,et al.  Robot-aided sensorimotor arm training improves outcome in patients with chronic stroke , 2003, Neurology.

[4]  André Preumont,et al.  Portable smart wrist rehabilitation device driven by rotational MR-fluid brake actuator for telemedecine applications , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  N. Hogan,et al.  Effects of robotic therapy on motor impairment and recovery in chronic stroke. , 2003, Archives of physical medicine and rehabilitation.

[6]  J. Hidler,et al.  Inverse-Dynamics Based Assessment of Gait using a Robotic Orthosis , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Conor James Walsh,et al.  Development of a lightweight, underactuated exoskeleton for load-carrying augmentation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  Vittorio Cannatà,et al.  Brain network involved in visual processing of movement stimuli used in upper limb robotic training: an fMRI study , 2011, Journal of NeuroEngineering and Rehabilitation.

[9]  R. Tong,et al.  Interactive robot-assisted training system using continuous EMG signals for stroke rehabilitation , 2009, i-CREATe.

[10]  Mark Hallett,et al.  Cortical reorganization induced by virtual reality therapy in a child with hemiparetic cerebral palsy , 2005, Developmental medicine and child neurology.

[11]  C. Burgar,et al.  Robot-assisted movement training compared with conventional therapy techniques for the rehabilitation of upper-limb motor function after stroke. , 2002, Archives of physical medicine and rehabilitation.

[12]  C. Burgar,et al.  Robot-assisted upper-limb therapy in acute rehabilitation setting following stroke: Department of Veterans Affairs multisite clinical trial. , 2011, Journal of rehabilitation research and development.

[13]  S. Hesse,et al.  Robot-assisted arm trainer for the passive and active practice of bilateral forearm and wrist movements in hemiparetic subjects. , 2003, Archives of physical medicine and rehabilitation.

[14]  A. Treloar Psychiatric and Cognitive Disorders in Parkinson's Disease , 2003 .

[15]  Zhenpeng Zhao,et al.  Hand tele-rehabilitation in haptic virtual environment , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[16]  Judith E. Deutsch,et al.  Post-Stroke Rehabilitation with the Rutgers Ankle System: A Case Study , 2001, Presence: Teleoperators & Virtual Environments.

[17]  Pierre Frémont,et al.  Waiting for total knee replacement surgery: factors associated with pain, stiffness, function and quality of life , 2009, BMC musculoskeletal disorders.

[18]  George Kernohan,et al.  Palliative Nursing Care in other Neurological Conditions , 2009 .

[19]  Roderic A. Grupen,et al.  Upper extremity physical therapy for stroke patients using a general purpose robot , 2011, 2011 RO-MAN.

[20]  Lihua Huang,et al.  On the Control of the Berkeley Lower Extremity Exoskeleton (BLEEX) , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[21]  Heikki Handroos,et al.  Virtual reality based robotic therapy for stroke rehabilitation: An initial study , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[22]  W. L. Benedict,et al.  Multiple Sclerosis , 2007, Journal - Michigan State Medical Society.

[23]  Jerry E. Pratt,et al.  The RoboKnee: an exoskeleton for enhancing strength and endurance during walking , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[24]  Phillip J. McKerrow,et al.  Introduction to robotics , 1991 .

[25]  Ruth Seurinck,et al.  Mirror-induced visual illusion of hand movements: a functional magnetic resonance imaging study. , 2009, Archives of physical medicine and rehabilitation.

[26]  R. Riener,et al.  ARMin - design of a novel arm rehabilitation robot , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[27]  Hermano Igo Krebs,et al.  MIT-MANUS: a workstation for manual therapy and training. I , 1992, [1992] Proceedings IEEE International Workshop on Robot and Human Communication.

[28]  Sunil Kumar Agrawal,et al.  A robot test-bed for assistance and assessment in physical therapy , 2001, Adv. Robotics.

[29]  Uri Feintuch,et al.  VirHab - A virtual reality system for treatment of chronic pain and disability , 2009, 2009 Virtual Rehabilitation International Conference.

[30]  Joel C. Perry,et al.  Real-Time Myoprocessors for a Neural Controlled Powered Exoskeleton Arm , 2006, IEEE Transactions on Biomedical Engineering.

[31]  Stefano Tamburin,et al.  Robot-assisted arm training in patients with Parkinson’s disease: a pilot study , 2014, Journal of NeuroEngineering and Rehabilitation.

[32]  Hideo Fujimoto,et al.  A Guideline for Low-Force Robotic Guidance for Enhancing Human Performance of Positioning and Trajectory Tracking: It Should Be Stiff and Appropriately Slow , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[33]  Steve Pettifer,et al.  Immersive Virtual Reality as a Rehabilitative Technology for Phantom Limb Experience: A Protocol , 2005, Cyberpsychology Behav. Soc. Netw..

[34]  H. F. Machiel van der Loos,et al.  Development of robots for rehabilitation therapy: the Palo Alto VA/Stanford experience. , 2000, Journal of rehabilitation research and development.

[35]  W. Rymer,et al.  Robot-assisted movement training for the stroke-impaired arm: Does it matter what the robot does? , 2006, Journal of rehabilitation research and development.

[36]  N. Hogan,et al.  Comparison of Two Techniques of Robot-Aided Upper Limb Exercise Training After Stroke , 2004, American journal of physical medicine & rehabilitation.

[37]  Hong Yue,et al.  Design and Kinematics Simulation of Parallel Robots for Ankle Rehabilitation , 2006, 2006 International Conference on Mechatronics and Automation.

[38]  Aaron M. Dollar,et al.  Lower Extremity Exoskeletons and Active Orthoses: Challenges and State-of-the-Art , 2008, IEEE Transactions on Robotics.

[39]  M. Schoone-Harmsen,et al.  Robot-mediated ACtive REhabilitation (ACRE2) for the hemiplegic upper limb after a stroke: A pilot study , 2008 .

[40]  J. A. Stevens,et al.  Using motor imagery in the rehabilitation of hemiparesis. , 2003, Archives of physical medicine and rehabilitation.

[41]  V. Dietz,et al.  Treadmill training of paraplegic patients using a robotic orthosis. , 2000, Journal of rehabilitation research and development.

[42]  S. Mazzoleni,et al.  Robot-aided therapy on the upper limb of subacute and chronic stroke patients: A biomechanical approach , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[43]  Ken Endo,et al.  A Quasi-Passive Leg Exoskeleton for Load-Carrying Augmentation , 2007, Int. J. Humanoid Robotics.

[44]  H. Goldstein,et al.  The rise of the body bots [robotic exoskeletons] , 2005, IEEE Spectrum.

[45]  Toshio Higashi,et al.  Increased corticospinal excitability during direct observation of self-movement and indirect observation with a mirror box , 2007, Neuroscience Letters.

[46]  J. A. Stevens,et al.  Simulation of Bilateral Movement Training Through Mirror Reflection: A Case Report Demonstrating an Occupational Therapy Technique for Hemiparesis , 2004, Topics in stroke rehabilitation.

[47]  Peter I. Corke,et al.  A robotics toolbox for MATLAB , 1996, IEEE Robotics Autom. Mag..

[48]  S.K. Agrawal,et al.  Exoskeletons for Gait Assistance and Training of the Motor-Impaired , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[49]  Shuguo Wang,et al.  Design and development of a portable exoskeleton based CPM machine for rehabilitation of hand injuries , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[50]  Nancy Byl,et al.  Robotic unilateral and bilateral upper-limb movement training for stroke survivors afflicted by chronic hemiparesis , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[51]  David A. Gabriel,et al.  Shoulder and elbow muscle activity in goal-directed arm movements , 1997, Experimental Brain Research.

[52]  Robert Bogue,et al.  Exoskeletons and robotic prosthetics: a review of recent developments , 2009, Ind. Robot.

[53]  Emma K. Stokes,et al.  Effect of robot-mediated therapy on upper extremity dysfunction post-stroke—a single case study , 2005 .

[54]  H. Stam,et al.  Mirror therapy improves hand function in subacute stroke: a randomized controlled trial. , 2008, Archives of physical medicine and rehabilitation.

[55]  J.C. Perry,et al.  Upper-Limb Powered Exoskeleton Design , 2007, IEEE/ASME Transactions on Mechatronics.

[56]  M. Hoehn,et al.  Parkinsonism , 1998, Neurology.

[57]  Robert J. van Beers,et al.  How humans combine simultaneous proprioceptive and visual position information , 1996, Experimental Brain Research.

[58]  M. Jurak,et al.  Passive robotic movement therapy of the spastic hemiparetic arm with REHAROB: report of the first clinical test and the follow-up system improvement , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[59]  S. Kucuk,et al.  The inverse kinematics solutions of industrial robot manipulators , 2004, Proceedings of the IEEE International Conference on Mechatronics, 2004. ICM '04..

[60]  S.K. Agrawal,et al.  Assessment of Motion of a Swing Leg and Gait Rehabilitation With a Gravity Balancing Exoskeleton , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[61]  R. Maini Study and Comparison of Various Image Edge Detection Techniques , 2004 .

[62]  Gautam Narang,et al.  Use of unobtrusive human-machine interface for rehabilitation of stroke victims through robot assisted mirror therapy , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[63]  E.J. Perreault,et al.  An Assessment of Robot-Assisted Bimanual Movements on Upper Limb Motor Coordination Following Stroke , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[64]  Paul F. M. J. Verschure,et al.  Interactive visuo-motor therapy system for stroke rehabilitation , 2007, Medical & Biological Engineering & Computing.

[65]  H. Karbe,et al.  Mirror Therapy Promotes Recovery From Severe Hemiparesis: A Randomized Controlled Trial , 2009, Neurorehabilitation and neural repair.

[66]  Jan F. Veneman,et al.  LOPES: a lower extremity powered exoskeleton , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[67]  P. Gallina,et al.  Design, Implementation and Clinical Tests of a Wire-Based Robot for Neurorehabilitation , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[68]  T. Olsen,et al.  Outcome and time course of recovery in stroke. Part II: Time course of recovery. The Copenhagen Stroke Study. , 1995, Archives of physical medicine and rehabilitation.

[69]  G. Yavuzer,et al.  Mirror therapy enhances lower-extremity motor recovery and motor functioning after stroke: a randomized controlled trial. , 2007, Archives of physical medicine and rehabilitation.

[70]  Jill Whitall,et al.  Fine motor control in adults with and without chronic hemiparesis: baseline comparison to nondisabled adults and effects of bilateral arm training. , 2004, Archives of physical medicine and rehabilitation.

[71]  Hermano Igo Krebs,et al.  Robotic applications in neuromotor rehabilitation , 2003, Robotica.

[72]  Yoshiyuki Sankai,et al.  Control method of robot suit HAL working as operator's muscle using biological and dynamical information , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[73]  Jeffery J. Summers,et al.  Bilateral and unilateral movement training on upper limb function in chronic stroke patients: A TMS study , 2007, Journal of the Neurological Sciences.

[74]  Alin Albu-Schäffer,et al.  Cartesian impedance control of redundant robots: recent results with the DLR-light-weight-arms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[75]  J. Whitall,et al.  Repetitive Bilateral Arm Training With Rhythmic Auditory Cueing Improves Motor Function in Chronic Hemiparetic Stroke , 2000, Stroke.

[76]  S L Wolf,et al.  Doing It with Mirrors: A Case Study of a Novel Approach to Neurorehabilitation , 2000, Neurorehabilitation and neural repair.

[77]  Gail S. Anderson,et al.  Method to Investigate Contusion Mechanics in Living Humans , 2011 .

[78]  N. Manning,et al.  The human arm kinematics and dynamics during daily activities - toward a 7 DOF upper limb powered exoskeleton , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[79]  Neville Hogan,et al.  Robotic upper-limb neurorehabilitation in chronic stroke patients. , 2005, Journal of rehabilitation research and development.

[80]  Jungwon Yoon,et al.  Reconfigurable ankle rehabilitation robot for various exercises , 2006 .

[81]  Roderic A. Grupen,et al.  Designing a Self-Stabilizing Robot for Dynamic Mobile Manipulation , 2006 .

[82]  Sung Hoon Kim,et al.  Control scheme and networked control architecture for the Berkeley lower extremity exoskeleton (BLEEX) , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[83]  Karsten Morisse,et al.  A new perspective for Virtual Mirror Therapy Developing a low-cost-high-convenient environment utilising the Wiimote , 2009, 2009 Virtual Rehabilitation International Conference.

[84]  C. Burgar,et al.  MIME robotic device for upper-limb neurorehabilitation in subacute stroke subjects: A follow-up study. , 2006, Journal of rehabilitation research and development.

[85]  Rajnikant V. Patel,et al.  A framework for supervised robotics-assisted mirror rehabilitation therapy , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[86]  E. Tunik,et al.  Innovative approaches to the rehabilitation of upper extremity hemiparesis using virtual environments. , 2009, European journal of physical and rehabilitation medicine.

[87]  C.G. Burgar,et al.  Evidence for improved muscle activation patterns after retraining of reaching movements with the MIME robotic system in subjects with post-stroke hemiparesis , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[88]  N. Hogan,et al.  Overview of clinical trials with MIT-MANUS: a robot-aided neuro-rehabilitation facility. , 1999, Technology and health care : official journal of the European Society for Engineering and Medicine.

[89]  D. Sheridan,et al.  Can one accurately date a bruise? State of the science , 2009, Journal of forensic nursing.

[90]  Martin Rydmark,et al.  A home-based Virtual Reality system for Stroke Rehabilitation , 2007, 2007 Virtual Rehabilitation.

[91]  Judith E. Deutsch,et al.  A Stewart Platform-Based System for Ankle Telerehabilitation , 2001, Auton. Robots.

[92]  R. Riener,et al.  A Method of Estimating the Degree of Active Participation During Stepping in a Driven Gait Orthosis Based on Actuator Force Profile Matching , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[93]  Roderic A. Grupen,et al.  Upper-limb exercises for stroke patients through the direct engagement of an embodied agent , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[94]  J.C. Perry,et al.  Design of a 7 Degree-of-Freedom Upper-Limb Powered Exoskeleton , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[95]  V. Ramachandran,et al.  The use of visual feedback, in particular mirror visual feedback, in restoring brain function. , 2009, Brain : a journal of neurology.

[96]  W. Byblow,et al.  Priming the motor system enhances the effects of upper limb therapy in chronic stroke. , 2008, Brain : a journal of neurology.

[97]  C. E. Clauser,et al.  Weight, volume, and center of mass of segments of the human body , 1969 .

[98]  Keijiro Yamamoto,et al.  Stand Alone Wearable Power Assisting Suit (Development and Availability) , 2006 .

[99]  L. Stone,et al.  Rehabilitation of hemiparesis after stroke with a mirror , 1999, The Lancet.

[100]  A. Gelber,et al.  Osteoarthritis , 2020, Annals of Internal Medicine.