Superimposed Skilled Performance in a Virtual Mirror Improves Motor Performance and Cognitive Representation of a Full Body Motor Action

Feedback is essential for skill acquisition as it helps identifying and correcting performance errors. Nowadays, Virtual Reality can be used as a tool to guide motor learning, and to provide innovative types of augmented feedback that exceed real world opportunities. Concurrent feedback has shown to be especially beneficial for novices. Moreover, watching skilled performances helps novices to acquire a motor skill, and this effect depends on the perspective taken by the observer. To date, however, the impact of watching one's own performance together with full body superimposition of a skilled performance, either from the front or from the side, remains to be explored. Here we used an immersive, state-of-the-art, low-latency cave automatic virtual environment (CAVE), and we asked novices to perform squat movements in front of a virtual mirror. Participants were assigned to one of three concurrent visual feedback groups: participants either watched their own avatar performing full body movements or were presented with the movement of a skilled individual superimposed on their own performance during movement execution, either from a frontal or from a side view. Motor performance and cognitive representation were measured in order to track changes in movement quality as well as motor memory across time. Consistent with our hypotheses, results showed an advantage of the groups that observed their own avatar performing the squat together with the superimposed skilled performance for some of the investigated parameters, depending on perspective. Specifically, for the deepest point of the squat, participants watching the squat from the front adapted their height, while those watching from the side adapted their backward movement. In a control experiment, we ruled out the possibility that the observed improvements were due to the mere fact of performing the squat movements—irrespective of the type of visual feedback. The present findings indicate that it can be beneficial for novices to watch themselves together with a skilled performance during execution, and that improvement depends on the perspective chosen.

[1]  Ori Ossmy,et al.  Neural Network Underlying Intermanual Skill Transfer in Humans. , 2016, Cell reports.

[2]  Y. Paulignan,et al.  An Interference Effect of Observed Biological Movement on Action , 2003, Current Biology.

[3]  E. Rosch,et al.  Categorization of Natural Objects , 1981 .

[4]  Thomas Schack,et al.  Team action imagery: Imagery of game situations and required team actions promotes a functional structure in players' representations of team-level tactics , 2018 .

[5]  Richard A. Schmidt,et al.  Frequent Augmented Feedback Can Degrade Learning: Evidence and Interpretations , 1991 .

[6]  Josef Wiemeyer,et al.  Does frequent augmented feedback really degrade learning? A meta-analysis , 2007 .

[7]  William M. Land,et al.  Mental Representation and Mental Practice: Experimental Investigation on the Functional Links between Motor Memory and Motor Imagery , 2014, PloS one.

[8]  C. Shea,et al.  Enhancing motor learning through external-focus instructions and feedback , 1999 .

[9]  E Bizzi,et al.  Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task. , 1997, Journal of motor behavior.

[10]  Tomohisa Asai,et al.  Dissociation of agency and body ownership following visuomotor temporal recalibration , 2015, Front. Integr. Neurosci..

[11]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[12]  M. Slater,et al.  The building blocks of the full body ownership illusion , 2013, Front. Hum. Neurosci..

[13]  Giacomo Rizzolatti,et al.  The mirror mechanism: a basic principle of brain function , 2016, Nature Reviews Neuroscience.

[14]  P. Haggard,et al.  Having a body versus moving your body: How agency structures body-ownership , 2006, Consciousness and Cognition.

[15]  T. Schack Measuring Mental Representations , 2012 .

[16]  Thomas Schack,et al.  Team Action Imagery and Team Cognition: Imagery of Game Situations and Required Team Actions Promotes a Functional Structure in Players' Representations of Team-Level Tactics. , 2018, Journal of sport & exercise psychology.

[17]  Heidi Sveistrup,et al.  Motor rehabilitation using virtual reality , 2004, Journal of NeuroEngineering and Rehabilitation.

[18]  Ori Ossmy,et al.  Perception as a Route for Motor Skill Learning: Perspectives from Neuroscience , 2018, Neuroscience.

[19]  W. Prinz,et al.  Compatibility between Observed and Executed Finger Movements: Comparing Symbolic, Spatial, and Imitative Cues , 2000, Brain and Cognition.

[20]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[21]  J. Hoffmann Uber die Integration von Wissen in die Verhaltenssteuerung , 1990 .

[22]  E. Tunik,et al.  Sensorimotor training in virtual reality: a review. , 2009, NeuroRehabilitation.

[23]  Luc Proteau,et al.  Learning through observation: a combination of expert and novice models favors learning , 2011, Experimental Brain Research.

[24]  Nigel W. John,et al.  A review of virtual environments for training in ball sports , 2012, Comput. Graph..

[25]  Daniel Thalmann,et al.  Quantifying Effects of Exposure to the Third and First-Person Perspectives in Virtual-Reality-Based Training , 2010, IEEE Transactions on Learning Technologies.

[26]  Mark J. Embrechts,et al.  On the Use of the Adjusted Rand Index as a Metric for Evaluating Supervised Classification , 2009, ICANN.

[27]  C. Winstein,et al.  Learning–performance distinction and memory processes for motor skills: A focused review and perspective , 2012, Behavioural Brain Research.

[28]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[29]  Thomas Schack,et al.  Observational Practice Promotes Action-Related Order Formation in Long-Term Memory: Investigating Action Observation and the Development of Cognitive Representation in Complex Motor Action , 2017, Journal of Motor Learning and Development.

[30]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[31]  N. Hodges,et al.  Modelling coaching practice: the role of instruction and demonstration , 2002, Journal of sports sciences.

[32]  A. Mark Williams,et al.  The roles and uses of augmented feedback in motor skill acquisition RICHARD A . M AG ILL AND DAV I D I . ANDERSON , 2012 .

[33]  Diane M. Ste-Marie,et al.  Modeling and Performance , 2012 .

[34]  O. Blanke,et al.  Spatial aspects of bodily self-consciousness , 2009, Consciousness and Cognition.

[35]  R. Schmidt,et al.  Reduced frequency of knowledge of results enhances motor skill learning. , 1990 .

[36]  Peter Wolf,et al.  Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning , 2014, Experimental Brain Research.

[37]  D. C. Shapiro,et al.  Summary knowledge of results for skill acquisition: support for the guidance hypothesis. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[38]  T. Schack,et al.  Representation of motor skills in human long-term memory , 2006, Neuroscience Letters.

[39]  Konrad Paul Kording,et al.  Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception , 2015, Front. Hum. Neurosci..

[40]  August Ponschab DIE WELT DER BEGRIFFE , 1973 .

[41]  B. Bläsing,et al.  The cognitive structure of movements in classical dance , 2009 .

[42]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[43]  M. Jeannerod,et al.  Defective recognition of one's own actions in patients with schizophrenia. , 2001, The American journal of psychiatry.

[44]  Nadia Bolognini,et al.  Altered visual feedback modulates cortical excitability in a mirror-box-like paradigm , 2015, Experimental Brain Research.

[45]  Tovi Grossman,et al.  YouMove: enhancing movement training with an augmented reality mirror , 2013, UIST.

[46]  J Zuckerman,et al.  Modeling effects on motor performance. , 1976, Research quarterly.

[47]  Hae Kyung Park,et al.  Upper extremity rehabilitation of stroke: Facilitation of corticospinal excitability using virtual mirror paradigm , 2012, Journal of NeuroEngineering and Rehabilitation.

[48]  Thomas Schack,et al.  From action representation to action execution: exploring the links between cognitive and biomechanical levels of motor control , 2013, Front. Comput. Neurosci..

[49]  Stefan Kopp,et al.  The Intelligent Coaching Space: A Demonstration , 2017, IVA.

[50]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[51]  Franck Multon,et al.  Third person view and guidance for more natural motor behaviour in immersive basketball playing , 2014, VRST '14.

[52]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[53]  David P. Watling,et al.  A systematic review of the application of interactive virtual reality to sport , 2017, Virtual Reality.

[54]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[55]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[56]  P. Haggard,et al.  Sense of Agency Primes Manual Motor Responses , 2009, Perception.

[57]  P. Haggard,et al.  Having a body versus moving your body: Neural signatures of agency and body-ownership , 2010, Neuropsychologia.

[58]  Luc Proteau,et al.  Observation learning of a motor task: who and when? , 2013, Experimental Brain Research.

[59]  Stefan Kopp,et al.  Realizing a low-latency virtual reality environment for motor learning , 2015, VRST.

[60]  Ori Ossmy,et al.  Short Term Motor-Skill Acquisition Improves with Size of Self-Controlled Virtual Hands , 2017, PloS one.

[61]  Frank Vetere,et al.  Onebody: Remote Posture Guidance System using First Person View in Virtual Environment , 2016, NordiCHI.

[62]  Richard Kulpa,et al.  Using virtual humans and computer animations to learn complex motor skills: a case study in karate , 2011 .

[63]  Luc Proteau,et al.  Mixed observation favors motor learning through better estimation of the model’s performance , 2014, Experimental Brain Research.

[64]  M. Guadagnoli,et al.  Challenge Point: A Framework for Conceptualizing the Effects of Various Practice Conditions in Motor Learning , 2004, Journal of motor behavior.

[65]  Ian M. Franks,et al.  The nature of feedback , 2004 .

[66]  Stefan Kopp,et al.  The impact of latency on perceptual judgments and motor performance in closed-loop interaction in virtual reality , 2016, VRST.

[67]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[68]  H. Ritter,et al.  Representation and learning in motor action – Bridges between experimental research and cognitive robotics , 2013 .

[69]  Diane M. Ste-Marie,et al.  Modeling and feedback , 2014 .

[70]  Barbi Law,et al.  Modeling in Sport and Performance , 2017 .

[71]  R. Schmidt,et al.  Knowledge of results and motor learning: a review and critical reappraisal. , 1984, Psychological bulletin.

[72]  Xing-Dong Yang,et al.  Physio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises , 2015, CHI.

[73]  Shuichi Nishio,et al.  The Importance of Visual Feedback Design in BCIs; from Embodiment to Motor Imagery Learning , 2016, PloS one.

[74]  Sophie Jörg,et al.  How responsiveness affects players' perception in digital games , 2012, SAP.

[75]  T. Schack The cognitive architecture of complex movement , 2004 .

[76]  Timothy D. Lee,et al.  Motor Control and Learning: A Behavioral Emphasis , 1982 .

[77]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[78]  Ori Ossmy,et al.  Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another , 2017, Journal of visualized experiments : JoVE.

[79]  William M. Land,et al.  Mental representation and learning: The influence of practice on the development of mental representation structure in complex action , 2013 .