Automated Feedback Selection for Robot-Assisted Training

Abstract Robot-assisted training can be enhanced by using augmented feedback to support trainees during learning. Efficacy of augmented feedback is assumed to be dependent on the trainee's skill level and task characteristics. Thus, selecting the most efficient augmented feedback for individual subjects over the course of training is challenging. We present a general concept to automate feedback selection based on predicted performance improvement. As proof of concept, we applied our concept to trunkarm rowing. Using existing data, the assumption that improvement is skill level dependent was verified and a predictive linear mixed model was obtained. We used this model to automatically select feedback for new trainees. The observed improvements were used to adapt the prediction model to the individual subject. The prediction model did not over-fit and generalized to new subjects with this adaptation. Mainly, feedback was selected that showed the highest baseline to retention learning in previous studies. By this replication of our former best results we demonstrate that a simple decision rule based on improvement prediction has the potential to reasonably select feedback, or to provide a comprehensible suggestion to a human supervisor. To our knowledge, this is the first time an automated feedback selection has been realized in motor learning.

[1]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[2]  Helmut Küchenhoff,et al.  Size and power of tests for a zero random effect variance or polynomial regression in additive and linear mixed models , 2008, Comput. Stat. Data Anal..

[3]  Peter Wolf,et al.  Learning of Temporal and Spatial Movement Aspects: A Comparison of Four Types of Haptic Control and Concurrent Visual Feedback , 2015, IEEE Transactions on Haptics.

[4]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[5]  Yohsuke R. Miyamoto,et al.  Temporal structure of motor variability is dynamically regulated and predicts motor learning ability , 2014, Nature Neuroscience.

[6]  David J. Reinkensmeyer,et al.  Slacking by the human motor system: Computational models and implications for robotic orthoses , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  R. Riener,et al.  Transfer of Complex Skill Learning from Virtual to Real Rowing , 2013, PloS one.

[8]  Andrew Gelman,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2006 .

[9]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[10]  Robert Riener,et al.  Assistance or challenge? Filling a gap in user-cooperative control , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Peter Wolf,et al.  Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning , 2014, Experimental Brain Research.

[12]  Dimitrios Gunopulos,et al.  Indexing Multidimensional Time-Series , 2004, The VLDB Journal.

[13]  M. Guadagnoli,et al.  Challenge Point: A Framework for Conceptualizing the Effects of Various Practice Conditions in Motor Learning , 2004, Journal of motor behavior.

[14]  D. Bates,et al.  Linear Mixed-Effects Models using 'Eigen' and S4 , 2015 .

[15]  Peter Wolf,et al.  The role of skill level and motor task characteristics on the effectiveness of robotic training: first results , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[16]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[17]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[18]  Wilsaan M. Joiner,et al.  Long-term retention explained by a model of short-term learning in the adaptive control of reaching. , 2008, Journal of neurophysiology.

[19]  R. Allan Reese,et al.  Linear Mixed Models: a Practical Guide using Statistical Software , 2008 .

[20]  Martin A. Giese,et al.  Morphable Models for the Analysis and Synthesis of Complex Motion Patterns , 2000, International Journal of Computer Vision.

[21]  Robert Riener,et al.  A tendon-based parallel robot applied to motor learning in sports , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[22]  Peter Brusilovsky,et al.  Modeling Skill Combination Patterns for Deeper Knowledge Tracing , 2016, UMAP.