Robot-enhanced motor learning: accelerating internal model formation during locomotion by transient dynamic amplification

When adapting to novel dynamic environments the nervous system learns to anticipate the imposed forces by forming an internal model of the environmental dynamics in a process driven by movement error reduction. Here, we tested the hypothesis that motor learning could be accelerated by transiently amplifying the environmental dynamics. A novel dynamic environment was created during treadmill stepping by applying a perpendicular viscous force field to the leg through a robotic device. The environmental dynamics were amplified by an amount determined by a computational learning model fit on a per-subject basis. On average, subjects significantly reduced the time required to predict the applied force field by approximately 26% when the field was transiently amplified. However, this reduction was not as great as that predicted by the model, likely due to nonstationarities in the learning parameters. We conclude that motor learning of a novel dynamic environment can be accelerated by exploiting the error-based learning mechanism of internal model formation, but that nonlinearities in adaptive response may limit the feasible acceleration. These results support an approach to movement training devices that amplify rather than reduce movement errors, and provide a computational framework for both implementing the approach and understanding its limitations.

[1]  J. Lackner,et al.  Gravitoinertial force background level affects adaptation to coriolis force perturbations of reaching movements. , 1998, Journal of neurophysiology.

[2]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[3]  Ralph V. Clayman,et al.  Training and Assessment of Laparoscopic Skills , 2004, JSLS : Journal of the Society of Laparoendoscopic Surgeons.

[4]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[5]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Ashutosh Tewari,et al.  Surgical robotics and laparoscopic training drills. , 2004, Journal of endourology.

[7]  E. J. Lai,et al.  Influence of interaction force levels on degree of motor adaptation in a stable dynamic force field , 2003, Experimental Brain Research.

[8]  Toshio Tsuji,et al.  A virtual training sports system for measuring human hand impedance , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[9]  C.G. Burgar,et al.  Evidence for improved muscle activation patterns after retraining of reaching movements with the MIME robotic system in subjects with post-stroke hemiparesis , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  R A Scheidt,et al.  Learning to move amid uncertainty. , 2001, Journal of neurophysiology.

[11]  W.Z. Rymer,et al.  of the 23 rd Annual EMBS International Conference , October 25-28 , Istanbul , Turkey ALTERING MOVEMENT PATTERNS IN HEALTHY AND BRAIN-INJURED SUBJECTS VIA CUSTOM DESIGNED ROBOTIC FORCES , 2004 .

[12]  Nathaniel J Soper,et al.  The effect of robotic assistance on learning curves for basic laparoscopic skills. , 2002, American journal of surgery.

[13]  J. Brian Gray,et al.  Introduction to Linear Regression Analysis , 2002, Technometrics.

[14]  Jammalamadaka Introduction to Linear Regression Analysis (3rd ed.) , 2003 .

[15]  David J. Reinkensmeyer,et al.  A robotic tool for studying locomotor adaptation and rehabilitation , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[16]  Paul DiZio,et al.  Adaptation in a rotating artificial gravity environment , 1998, Brain Research Reviews.

[17]  David J. Reinkensmeyer,et al.  Selection of Robotic Therapy Algorithms for the Upper Extremity in Chronic Stroke: Insights from MIME and ARM Guide Results , 2003 .

[18]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[19]  Ferdinando A. Mussa-Ivaldi,et al.  Robot-assisted adaptive training: custom force fields for teaching movement patterns , 2004, IEEE Transactions on Biomedical Engineering.

[20]  N. Hogan,et al.  Robot-aided neurorehabilitation. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[21]  S. Hesse,et al.  Upper and lower extremity robotic devices for rehabilitation and for studying motor control , 2003, Current opinion in neurology.

[22]  Ferdinando A. Mussa-Ivaldi,et al.  Linear combinations of nonlinear models for predicting human–machine interface forces , 2002, Biological Cybernetics.

[23]  N. Hogan,et al.  Robotics in the rehabilitation treatment of patients with stroke , 2002, Current atherosclerosis reports.

[24]  Konrad Paul Körding,et al.  The loss function of sensorimotor learning. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[25]  J. Liu,et al.  Motor adaptation as an optimal combination of computational strategies , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Steven C Cramer,et al.  Robotics, motor learning, and neurologic recovery. , 2004, Annual review of biomedical engineering.

[27]  J Galvez,et al.  Robotic gait training: toward more natural movements and optimal training algorithms , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  David J. Reinkensmeyer,et al.  Evidence for an internal model dedicated to locomotor control , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[29]  D. Reinkensmeyer,et al.  Accelerating motor adaptation by influencing neural computations , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.