Robotics and Virtual Reality: A Perfect Marriage for Motor Control Research and Rehabilitation

This article's goal is to outline the motivations, progress, and future objectives for the development of a state-of-the-art device that allows humans to visualize and feel synthetic objects superimposed on the physical world. The programming flexibility of these devices allows for a variety of scientific questions to be answered in psychology, neurophysiology, rehabilitation, haptics, and automatic control. The benefits are most probable in rehabilitation of brain-injured patients, for whom the costs are high, therapist time is limited, and repetitive practice of movements has been shown to be beneficial. Moreover, beyond simple therapy that guides, strengthens, or stretches, the technology affords a variety of exciting potential techniques that can combine our knowledge of the nervous system with the tireless, precise, and swift capabilities of a robot. Because this is a prototype, the system will also guide new experimental methods by probing the levels of quality that are necessary for future design cycles and related technology. Very important to the project is the early and intimate involvement of therapists and other clinicians in the design of software and its user interface. Inevitably, it should also lead the way to new modes of practice and to the commercialization of haptic/graphic systems.

[1]  T. Jarus,et al.  Effects of Cognitive Processes and Task Complexity on Acquisition, Retention, and Transfer of Motor Skills , 2001, Canadian journal of occupational therapy. Revue canadienne d'ergotherapie.

[2]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  J. Liu,et al.  Monitoring functional arm movement for home-based therapy after stroke , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Michael I. Jordan,et al.  Perceptual distortion contributes to the curvature of human reaching movements , 1994, Experimental Brain Research.

[5]  B. Bobath Adult hemiplegia: Evaluation and treatment , 1978 .

[6]  T. Milner,et al.  Adaptive control of stiffness to stabilize hand position with large loads , 2003, Experimental Brain Research.

[7]  R Shadmehr,et al.  Spatial Generalization from Learning Dynamics of Reaching Movements , 2000, The Journal of Neuroscience.

[8]  David J. Reinkensmeyer,et al.  Human control of a simple two-hand grasp , 1992, Biological Cybernetics.

[9]  E Bizzi,et al.  Motor learning by field approximation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[10]  J. Patton,et al.  Visual error augmentation for enhancing motor learning and rehabilitative relearning , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[11]  Eric J Perreault,et al.  A robotic manipulator for the characterization of two-dimensional dynamic stiffness using stochastic displacement perturbations , 2000, Journal of Neuroscience Methods.

[12]  Ferdinando A. Mussa-Ivaldi,et al.  Linear combinations of nonlinear models for predicting human–machine interface forces , 2002, Biological Cybernetics.

[13]  Ferdinando A. Mussa-Ivaldi,et al.  Haptic interaction with virtual objects , 2000, Biological Cybernetics.

[14]  J. French,et al.  Motor recovery following acute stroke. , 1990, Age and ageing.

[15]  Voss De,et al.  Proprioceptive neuromuscular facilitation. , 1967 .

[16]  M. Perenin,et al.  Prism adaptation to a rightward optical deviation rehabilitates left hemispatial neglect , 1998, Nature.

[17]  Christopher D Mah,et al.  Generalization of Object Manipulation Skills Learned without Limb Motion , 2003, The Journal of Neuroscience.

[18]  Michael I. Jordan,et al.  Are arm trajectories planned in kinematic or dynamic coordinates? An adaptation study , 1995, Experimental Brain Research.

[19]  N. Miller,et al.  Technique to improve chronic motor deficit after stroke. , 1993, Archives of physical medicine and rehabilitation.

[20]  Daniel M. Corcos,et al.  Nonlinear control of movement distance at the human elbow , 1996, Experimental Brain Research.

[21]  S J Phillips,et al.  Incidence rates of stroke in the eighties: the end of the decline in stroke? , 1989, Stroke.

[22]  N. Hogan,et al.  Effects of robotic therapy on motor impairment and recovery in chronic stroke. , 2003, Archives of physical medicine and rehabilitation.

[23]  H. F. Machiel van der Loos,et al.  Development of robots for rehabilitation therapy: the Palo Alto VA/Stanford experience. , 2000, Journal of rehabilitation research and development.

[24]  N. Hogan,et al.  Comparison of Two Techniques of Robot-Aided Upper Limb Exercise Training After Stroke , 2004, American journal of physical medicine & rehabilitation.

[25]  Andrew E. Johnson,et al.  Developing the PARIS : Using the CAVE to Prototype a New VR Display , 2000 .

[26]  Xun Luo,et al.  An augmented reality training environment for post-stroke finger extension rehabilitation , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[27]  M. Hallett,et al.  Adaptation to lateral displacement of vision in patients with lesions of the central nervous system , 1983, Neurology.

[28]  N. Hogan,et al.  Robot training enhanced motor outcome in patients with stroke maintained over 3 years , 1999, Neurology.

[29]  J. Liepert,et al.  Treatment-induced cortical reorganization after stroke in humans. , 2000, Stroke.

[30]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[31]  R. Sainburg,et al.  Differential contributions of vision and proprioception to movement accuracy , 2003, Experimental Brain Research.

[32]  R. Shadmehr,et al.  Neural correlates of motor memory consolidation. , 1997, Science.

[33]  R. Shadmehr,et al.  A Real-Time State Predictor in Motor Control: Study of Saccadic Eye Movements during Unseen Reaching Movements , 2002, The Journal of Neuroscience.

[34]  Andrew E. Johnson,et al.  Colorplate: Pre-surgical Cranial Implant Design using the PARISTM Prototype , 2004, VR.

[35]  Jinsung Wang,et al.  Interlimb transfer of novel inertial dynamics is asymmetrical. , 2004, Journal of neurophysiology.

[36]  W.Z. Rymer,et al.  of the 23 rd Annual EMBS International Conference , October 25-28 , Istanbul , Turkey ALTERING MOVEMENT PATTERNS IN HEALTHY AND BRAIN-INJURED SUBJECTS VIA CUSTOM DESIGNED ROBOTIC FORCES , 2004 .

[37]  M. Kawato,et al.  Functional significance of stiffness in adaptation of multijoint arm movements to stable and unstable dynamics , 2003, Experimental Brain Research.

[38]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[39]  C. D. Mah Spatial and temporal modulation of joint stiffness during multijoint movement , 2001, Experimental Brain Research.

[40]  T. Milner Adaptation to destabilizing dynamics by means of muscle cocontraction , 2002, Experimental Brain Research.

[41]  Christopher D Mah,et al.  Manipulating objects with internal degrees of freedom: evidence for model-based control. , 2002, Journal of neurophysiology.

[42]  Peter Levine,et al.  Modified Constraint-Induced Therapy in Acute Stroke: A Randomized Controlled Pilot Study , 2005, Neurorehabilitation and neural repair.

[43]  N. Hogan,et al.  Is robot-aided sensorimotor training in stroke rehabilitation a realistic option? , 2001, Current opinion in neurology.

[44]  M. Kawato,et al.  Modular organization of internal models of tools in the human cerebellum , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[45]  J. Houk,et al.  Features of motor performance that drive adaptation in rapid hand movements , 2003, Experimental Brain Research.

[46]  M. Srinivasan,et al.  Tactual discrimination of softness. , 1995, Journal of neurophysiology.

[47]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  S. Wolf,et al.  Forced use of hemiplegic upper extremities to reverse the effect of learned nonuse among chronic stroke and head-injured patients , 1989, Experimental Neurology.

[49]  F A Miles,et al.  Long-term adaptive changes in primate vestibuloocular reflex. I. Behavioral observations. , 1980, Journal of neurophysiology.

[50]  Mitsuo Kawato,et al.  Human arm stiffness and equilibrium-point trajectory during multi-joint movement , 1997, Biological Cybernetics.

[51]  N. Hogan,et al.  Overview of clinical trials with MIT-MANUS: a robot-aided neuro-rehabilitation facility. , 1999, Technology and health care : official journal of the European Society for Engineering and Medicine.

[52]  Rieko Osu,et al.  Different mechanisms involved in adaptation to stable and unstable dynamics. , 2003, Journal of neurophysiology.

[53]  D. Wolpert,et al.  The effect of visuomotor displacements on arm movement paths , 1999, Experimental Brain Research.

[54]  R. Hanlon Motor learning following unilateral stroke. , 1996, Archives of physical medicine and rehabilitation.

[55]  Robert F. Kirsch,et al.  Multiple-input, multiple-output system identification for characterization of limb stiffness dynamics , 1999, Biological Cybernetics.

[56]  B. Rockstroh,et al.  Constraint-Induced Therapy of Chronic Aphasia After Stroke , 2001, Stroke.

[57]  Annette Sterr,et al.  Training-Based Interventions in Motor Rehabilitation after Stroke: Theoretical and Clinical Considerations , 2005, Behavioural neurology.

[58]  E. Taub,et al.  Constraint-induced movement therapy and massed practice. , 2000, Stroke.

[59]  Ferdinando A. Mussa-Ivaldi,et al.  Geometric Structure of the Adaptive Controller of the Human Arm , 1993 .

[60]  Vincent Hayward,et al.  Force can overcome object geometry in the perception of shape through active touch , 2001, Nature.

[61]  C. Burgar,et al.  Robot-assisted movement training compared with conventional therapy techniques for the rehabilitation of upper-limb motor function after stroke. , 2002, Archives of physical medicine and rehabilitation.

[62]  R. Nudo,et al.  Cortical plasticity after stroke: implications for rehabilitation. , 1999, Revue neurologique.

[63]  S G Lisberger,et al.  The neural basis for learning of simple motor skills. , 1988, Science.

[64]  N. Hogan,et al.  Increasing productivity and quality of care: robot-aided neuro-rehabilitation. , 2000, Journal of rehabilitation research and development.

[65]  David J. Reinkensmeyer,et al.  Selection of Robotic Therapy Algorithms for the Upper Extremity in Chronic Stroke: Insights from MIME and ARM Guide Results , 2003 .

[66]  Toshio Tsuji,et al.  Human hand impedance characteristics during maintained posture , 1995, Biological Cybernetics.

[67]  R. Shepherd,et al.  Task-related training improves performance of seated reaching tasks after stroke. A randomized controlled trial. , 1997, Stroke.

[68]  W. Rymer,et al.  Understanding and treating arm movement impairment after chronic brain injury: progress with the ARM guide. , 2014, Journal of rehabilitation research and development.

[69]  N. Hogan,et al.  Robot-aided neurorehabilitation. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[70]  D.J. Reinkensmeyer,et al.  Robot-enhanced motor learning: accelerating internal model formation during locomotion by transient dynamic amplification , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[71]  S O'Modhrain Touch and Go — Designing Haptic Feedback for a Hand-Held Mobile Device , 2004 .

[72]  E. Taub,et al.  Constraint-Induced Movement Therapy: a new family of techniques with broad application to physical rehabilitation--a clinical review. , 1999, Journal of rehabilitation research and development.

[73]  J. Salonen,et al.  The significance of intensity of rehabilitation of stroke--a controlled trial. , 1985, Stroke.

[74]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[75]  J. E. Colgate,et al.  Cobots: Robots for Collaboration With Human Operators , 1996, Dynamic Systems and Control.

[76]  Y. Matsuoka,et al.  Perceptual limits for a robotic rehabilitation environment using visual feedback distortion , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[77]  G. DeFriese,et al.  The Stroke Prevention Patient Outcomes Research Team: Goals and Methods , 1993, Stroke.

[78]  R. Nudo Recovery after damage to motor cortical areas , 1999, Current Opinion in Neurobiology.

[79]  Lex M. Bouter,et al.  Constraint-induced movement therapy and massed practice [3] (multiple letters) , 2000 .

[80]  I W Hunter,et al.  System identification of human joint dynamics. , 1990, Critical reviews in biomedical engineering.

[81]  Daniel M Wolpert,et al.  Kinematics and Dynamics Are Not Represented Independently in Motor Working Memory: Evidence from an Interference Study , 2002, The Journal of Neuroscience.

[82]  J. Patton,et al.  Custom-designed haptic training for restoring reaching ability to individuals with poststroke hemiparesis. , 2006, Journal of rehabilitation research and development.

[83]  K. Silver,et al.  Rehabilitation medicine. , 1994, The Surgical clinics of North America.

[84]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[85]  Colin Ware,et al.  Haptic interface for center-of-workspace interaction , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[86]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[87]  Ferdinando A. Mussa-Ivaldi,et al.  Robot-assisted adaptive training: custom force fields for teaching movement patterns , 2004, IEEE Transactions on Biomedical Engineering.

[88]  Ferdinando A. Mussa-Ivaldi,et al.  Sequence, time, or state representation: how does the motor control system adapt to variable environments? , 2003, Biological Cybernetics.

[89]  Jacques Droulez,et al.  Does the brain use sliding variables for the control of movements? , 1997, Biological Cybernetics.

[90]  M. Latash,et al.  Effects of altering initial position on movement direction and extent. , 2003, Journal of neurophysiology.

[91]  Andrew E. Johnson,et al.  Designing cranial implants in a haptic augmented reality environment , 2004, CACM.

[92]  F A Mussa-Ivaldi,et al.  Central representation of time during motor learning. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[93]  J. Patton,et al.  Evaluation of robotic training forces that either enhance or reduce error in chronic hemiparetic stroke survivors , 2005, Experimental Brain Research.

[94]  F. Mussa-Ivaldi,et al.  The motor system does not learn the dynamics of the arm by rote memorization of past experience. , 1997, Journal of neurophysiology.

[95]  J. Edward Colgate,et al.  Improving teleoperation: reducing mental rotations and translations , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[96]  R. Sainburg,et al.  Interlimb transfer of visuomotor rotations: independence of direction and final position information , 2002, Experimental Brain Research.

[97]  N. Hogan,et al.  Robotics in the rehabilitation treatment of patients with stroke , 2002, Current atherosclerosis reports.