Visual and Auditory Augmented Concurrent Feedback in a Complex Motor Task

In general, concurrent augmented feedback has been shown to effectively enhance learning in complex motor tasks. However, to optimize technical systems that are intended to reinforce motor learning, a systematic evaluation of different augmented feedback designs is required. Until now, mainly visual augmented feedback has been applied to enhance learning of complex motor tasks. Since most complex motor tasks are mastered in response to information visually perceived, providing augmented concurrent feedback in a visual manner may overload the capacities of visual perception and cognitive processing. Thus, the aim of this work was to evaluate the practicability of auditory feedback designs supporting a three-dimensional rowing-type movement in comparison with visual feedback designs. We term a feedback design practical if the provided information can easily be perceived and interpreted, and immediately be used to support the movement. In a first experiment, it became evident that participants could interpret three-dimensional auditory feedback designs based on stereo balance, pitch, timbre, and/or volume. Eleven of 12 participants were able to follow the different target movements using auditory feedback designs as accurately as with a very abstract visual feedback design. Visual designs based on superposition of actual and target oar orientation led to the most accurate performance. Considering the first experimental results, the feedback designs were further developed and again evaluated. It became evident that a permanent visual display of the target trajectories could further enhance movement accuracy. Moreover, results indicated that the practicability of the auditory designs depends on the polarity of the mapping functions. In general, both visual and auditory concurrent feedback designs were practical to immediately support multidimensional movement. In a next step, the effectiveness to enhance motor learning will be systematically evaluated.

[1]  M. Holden,et al.  Virtual Environment Training: A New Tool for Neurorehabilitation , 2002 .

[2]  Barbara Deml,et al.  A Study on Visual, Auditory, and Haptic Feedback for Assembly Tasks , 2004, Presence: Teleoperators & Virtual Environments.

[3]  Stephan P Swinnen,et al.  AGE-RELATED DEFICITS IN MOTOR LEARNING AND DIFFERENCES IN FEEDBACK PROCESSING DURING THE PRODUCTION OF A BIMANUAL COORDINATION PATTERN. , 1998, Cognitive neuropsychology.

[4]  S. Swinnen,et al.  Changes in brain activation during the acquisition of a new bimanual coordination task , 2004, Neuropsychologia.

[5]  S. Swinnen,et al.  Interlimb coordination: Learning and transfer under different feedback conditions , 1997 .

[6]  Ju-Ying Chang,et al.  Effectiveness of Two Forms of Feedback on Training of a Joint Mobilization Skill by Using a Joint Translation Simulator , 2007, Physical Therapy.

[7]  Priscilla M. Clarkson,et al.  The Effect of Augmented Feedback on Foot Pronation during Barre Exercise in Dance , 1986 .

[8]  Xing-Dong Yang,et al.  Validating the Performance of Haptic Motor Skill Training , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[9]  C. Shea,et al.  Benefits of Blocked Over Serial Feedback on Complex Motor Skill Learning. , 1999, Journal of motor behavior.

[10]  Antonio Frisoli,et al.  Vibrotactile perception assessment for a rowing training system , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[11]  Dana Maslovat,et al.  Feedback Effects on Learning a Novel Bimanual Coordination Pattern: Support for the Guidance Hypothesis , 2009, Journal of motor behavior.

[12]  S. P. Swinnen,et al.  Relative Phase Alterations During Bimanual Skill Acquisition. , 1995, Journal of motor behavior.

[13]  D. Reinkensmeyer,et al.  Review of control strategies for robotic movement training after neurologic injury , 2009, Journal of NeuroEngineering and Rehabilitation.

[14]  Didier Chollet,et al.  Auditory concurrent feedback benefits on the circle performed in gymnastics , 2006, Journal of sports sciences.

[15]  Pringle,et al.  Motor learning and performance: A problem-based learning approach , 2000, Journal of manipulative and physiological therapeutics.

[16]  G. Wulf,et al.  Attention and Motor Skill Learning , 2007 .

[17]  Gabriele Wulf,et al.  ATTENTIONAL FOCUS AND MOTOR LEARNING: A REVIEW OF 10 YEARS OF RESEARCH , 2007 .

[18]  R. Carson,et al.  The acquisition of movement skills: practice enhances the dynamic stability of bimanual coordination. , 2001, Human movement science.

[19]  Niilo Konttinen,et al.  The Effects of Augmented Auditory Feedback on Psychomotor Skill Learning in Precision Shooting , 2004 .

[20]  Timothy D. Lee,et al.  Age-related differences and the role of augmented visual feedback in learning a bimanual coordination pattern. , 2002, Acta psychologica.

[21]  C. Shea,et al.  Enhancing motor learning through external-focus instructions and feedback , 1999 .

[22]  K. Mononen.  The effects of augmented feedback on motor skill learning in shooting : a feedback training intervention among inexperienced rifle shooters , 2007 .

[23]  C. Shea,et al.  Principles derived from the study of simple skills do not generalize to complex skill learning , 2002, Psychonomic bulletin & review.

[24]  Suzanne J. Snodgrass,et al.  Real-time feedback improves accuracy of manually applied forces during cervical spine mobilisation. , 2010, Manual therapy.

[25]  Gabriele Wulf,et al.  Continuous Concurrent Feedback Degrades Skill Learning: Implications for Training and Simulation , 1997, Hum. Factors.

[26]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[27]  Sarah R Hurley,et al.  The influence of augmented feedback and prior learning on the acquisition of a new bimanual coordination pattern. , 2006, Human movement science.

[28]  C. Shea,et al.  Frequent feedback enhances complex motor skill learning. , 1998, Journal of motor behavior.

[29]  Tadej Bajd,et al.  Virtual environment for lower-extremities training. , 2008, Gait & posture.

[30]  K. Refshauge,et al.  Effect of feedback on learning a vertebral joint mobilization skill. , 1990, Physical therapy.

[31]  Gregory Kramer,et al.  Pitch and loudness interact in auditory displays: can the data get lost in the map? , 2002, Journal of experimental psychology. Applied.

[32]  D. M. Jacobs,et al.  Self-controlled concurrent feedback and the education of attention towards perceptual invariants. , 2009, Human movement science.

[33]  E Bizzi,et al.  Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task. , 1997, Journal of motor behavior.