Learning to perform a new movement with robotic assistance: comparison of haptic guidance and visual demonstration

BackgroundMechanical guidance with a robotic device is a candidate technique for teaching people desired movement patterns during motor rehabilitation, surgery, and sports training, but it is unclear how effective this approach is as compared to visual demonstration alone. Further, little is known about motor learning and retention involved with either robot-mediated mechanical guidance or visual demonstration alone.MethodsHealthy subjects (n = 20) attempted to reproduce a novel three-dimensional path after practicing it with mechanical guidance from a robot. Subjects viewed their arm as the robot guided it, so this "haptic guidance" training condition provided both somatosensory and visual input. Learning was compared to reproducing the movement following only visual observation of the robot moving along the path, with the hand in the lap (the "visual demonstration" training condition). Retention was assessed periodically by instructing the subjects to reproduce the path without robotic demonstration.ResultsSubjects improved in ability to reproduce the path following practice in the haptic guidance or visual demonstration training conditions, as evidenced by a 30–40% decrease in spatial error across 126 movement attempts in each condition. Performance gains were not significantly different between the two techniques, but there was a nearly significant trend for the visual demonstration condition to be better than the haptic guidance condition (p = 0.09). The 95% confidence interval of the mean difference between the techniques was at most 25% of the absolute error in the last cycle. When asked to reproduce the path repeatedly following either training condition, the subjects' performance degraded significantly over the course of a few trials. The tracing errors were not random, but instead were consistent with a systematic evolution toward another path, as if being drawn to an "attractor path".ConclusionThese results indicate that both forms of robotic demonstration can improve short-term performance of a novel desired path. The availability of both haptic and visual input during the haptic guidance condition did not significantly improve performance compared to visual input alone in the visual demonstration condition. Further, the motor system is inclined to repeat its previous mistakes following just a few movements without robotic demonstration, but these systematic errors can be reduced with periodic training.

[1]  A M Burton,et al.  Sequence learning by action and observation: evidence for separate mechanisms. , 2003, British journal of psychology.

[2]  S. Small,et al.  Functions of the Mirror Neuron System: Implications for Neurorehabilitation , 2006, Cognitive and behavioral neurology : official journal of the Society for Behavioral and Cognitive Neurology.

[3]  Stephen H. Scott,et al.  Apparatus for measuring and perturbing shoulder and elbow joint positions and torques during reaching , 1999, Journal of Neuroscience Methods.

[4]  C. Richards,et al.  Effects of prolonged muscle stretch on reflex and voluntary muscle activations in children with spastic cerebral palsy. , 1989, Scandinavian journal of rehabilitation medicine.

[5]  J. F. Soechting,et al.  Haptic synthesis of shapes and sequences. , 2004, Journal of neurophysiology.

[6]  D. Wolpert,et al.  The effect of visuomotor displacements on arm movement paths , 1999, Experimental Brain Research.

[7]  N. Hogan,et al.  Interactive robots for neuro-rehabilitation. , 2004, Restorative neurology and neuroscience.

[8]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2004, IEEE Trans. Robotics.

[9]  J. Liu,et al.  Learning to perform a novel movement pattern using haptic guidance: slow learning, rapid forgetting, and attractor paths , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[10]  C. Braun,et al.  Motor learning elicited by voluntary drive. , 2003, Brain : a journal of neurology.

[11]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2001, IEEE Transactions on Robotics.

[12]  M. Levin,et al.  Compensatory strategies for reaching in stroke. , 2000, Brain : a journal of neurology.

[13]  David J. Reinkensmeyer,et al.  Hemiparetic stroke impairs anticipatory control of arm movement , 2003, Experimental Brain Research.

[14]  I. Odéen,et al.  Reduction of muscular hypertonus by long-term muscle stretch. , 1981, Scandinavian journal of rehabilitation medicine.

[15]  J. F. Soechting,et al.  Approaches to the study of haptic sensing. , 2005, Journal of neurophysiology.

[16]  N. Hogan,et al.  The effect of robot-assisted therapy and rehabilitative training on motor recovery following stroke. , 1997, Archives of neurology.

[17]  F Chollet,et al.  Neural Substrate for the Effects of Passive Training on Sensorimotor Cortical Representation: A Study with Functional Magnetic Resonance Imaging in Healthy Subjects , 2000, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[18]  N. Hogan,et al.  Effects of robotic therapy on motor impairment and recovery in chronic stroke. , 2003, Archives of physical medicine and rehabilitation.

[19]  Ferdinando A Mussa-Ivaldi,et al.  Interaction of visual and proprioceptive feedback during adaptation of human reaching movements. , 2005, Journal of neurophysiology.

[20]  L. Cohen,et al.  Role of voluntary drive in encoding an elementary motor memory. , 2005, Journal of neurophysiology.

[21]  Etienne Burdet,et al.  A robotic teacher of Chinese handwriting , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[22]  Annie Vinter,et al.  Implicit motor learning through observational training in adults and children , 2002, Memory & cognition.

[23]  J. Eisenberg Agency for Health Care Policy and Research. , 1999, Medical care.

[24]  P. Wiseman The Virtual Teacher , 1998 .

[25]  W. Rymer,et al.  Robot-assisted reaching exercise promotes arm movement recovery in chronic hemiparetic stroke: a randomized controlled pilot study , 2006, Journal of NeuroEngineering and Rehabilitation.

[26]  Allison M. Okamura,et al.  Speed-Accuracy Characteristics of Human-Machine Cooperative Manipulation Using Virtual Fixtures With Variable Admittance , 2004, Hum. Factors.

[27]  Karon E. MacLean,et al.  Predictive haptic guidance: intelligent user assistance for the control of dynamic tasks , 2006, IEEE Transactions on Visualization and Computer Graphics.

[28]  Louis B. Rosenberg Virtual fixtures as tools to enhance operator performance in telepresence environments , 1993, Other Conferences.

[29]  W. Rymer,et al.  Stretch reflex adaptation in elbow flexors during repeated passive movements in unilateral brain-injured patients. , 2000, Archives of physical medicine and rehabilitation.

[30]  C. Burgar,et al.  Robot-assisted movement training compared with conventional therapy techniques for the rehabilitation of upper-limb motor function after stroke. , 2002, Archives of physical medicine and rehabilitation.

[31]  J. F. Soechting,et al.  Bias and sensitivity in the haptic perception of geometry , 2003, Experimental Brain Research.

[32]  Steven C Cramer,et al.  Robotics, motor learning, and neurologic recovery. , 2004, Annual review of biomedical engineering.

[33]  F A Mussa-Ivaldi,et al.  Haptic interaction with virtual objects. Spatial perception and motor control. , 2000, Biological cybernetics.

[34]  P. Duncan,et al.  Post-Stroke Rehabilitation , 2004 .

[35]  C. Winstein,et al.  Motor learning after unilateral brain damage , 1999, Neuropsychologia.

[36]  J. Carey Manual stretch: effect on finger movement control and force control in stroke subjects with spastic extrinsic finger flexor muscles. , 1990, Archives of physical medicine and rehabilitation.

[37]  Allison M. Okamura,et al.  Haptic Virtual Fixtures for Robot-Assisted Manipulation , 2005, ISRR.

[38]  R. Riener,et al.  ARMin - design of a novel arm rehabilitation robot , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[39]  S. Micera,et al.  Robotic techniques for upper limb evaluation and rehabilitation of stroke patients , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  M. Sile O'Modhrain,et al.  The Virtual Teacher , 1999 .

[41]  Andrew A G Mattar,et al.  Motor Learning by Observing , 2005, Neuron.

[42]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[43]  S. Hesse,et al.  Upper and lower extremity robotic devices for rehabilitation and for studying motor control , 2003, Current opinion in neurology.

[44]  A. Wing,et al.  A new challenge--robotics in the rehabilitation of the neurologically motor impaired. , 1991, Physical therapy.