Prism aftereffects for throwing with a self-avatar in an immersive virtual environment

The use of first-person self-avatars in immersive virtual environments (VEs) has grown over recent years. It is unknown, however, how visual feedback from a self-avatar influences a user's online actions and subsequent calibration of actions within an immersive VE. The current paper uses a prism throwing adaptation paradigm to test the role of a self-avatar arm or full body on action calibration in a VE. Participants' throwing accuracy to a target on the ground was measured first in a normal viewing environment, then with the visual field rotated clockwise about their vertical axis by 17° (prism simulation), and then again in the normal viewing environment with the prism distortion removed. Participants experienced either no-avatar, a first-person avatar arm and hand, or a first-person full body avatar during the entire experimental session, in a between-subjects manipulation. Results showed similar throwing error and adaptation during the prism exposure for all conditions, but a reduced aftereffect (displacement with respect to the target in the opposite direction of the prism-exposure) when the avatar arm or full body was present. The results are discussed in the context of how an avatar can provide a visual frame of reference to aid in action calibration.

[1]  Bobby Bodenheimer,et al.  Affordance Judgments in HMD-Based Virtual Environments: Stepping over a Pole and Stepping off a Ledge , 2015, TAP.

[2]  Jaron Lanier,et al.  Homuncular Flexibility in Virtual Reality , 2015, J. Comput. Mediat. Commun..

[3]  M. Slater,et al.  Sliding perspectives: dissociating ownership from self-location during full body illusions in virtual reality , 2014, Front. Hum. Neurosci..

[4]  Peter Willemsen,et al.  Throwing versus walking as indicators of distance perception in similar real and virtual environments , 2005, TAP.

[5]  J. Krakauer,et al.  Human sensorimotor learning: adaptation, skill, and beyond , 2011, Current Opinion in Neurobiology.

[6]  Judy M. Vance,et al.  Puzzle assembly training: Real world vs. virtual environment , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[7]  Bobby Bodenheimer,et al.  Stepping over and ducking under: the influence of an avatar on locomotion in an HMD-based immersive virtual environment , 2012, SAP.

[8]  Betty J. Mohler,et al.  Calibration of locomotion resulting from visual motion in a treadmill-based virtual environment , 2007, TAP.

[9]  Joan López-Moliner,et al.  The Effects of Visuomotor Calibration to the Perceived Space and Body, through Embodiment in Immersive Virtual Reality , 2015, TAP.

[10]  W. T. Thach,et al.  Throwing while looking through prisms. II. Specificity and storage of multiple gaze-throw calibrations. , 1996, Brain : a journal of neurology.

[11]  H. Pick,et al.  Visual and proprioceptive adaptation to optical displacement of the visual stimulus. , 1966, Journal of experimental psychology.

[12]  H. Henrik Ehrsson,et al.  Being Barbie: The Size of One’s Own Body Determines the Perceived Size of the World , 2011, PloS one.

[13]  U. Castiello,et al.  Improving left hemispatial neglect using virtual reality , 2004, Neurology.

[14]  Franck Multon,et al.  Visual Perspective and Feedback Guidance for VR Free-Throw Training , 2015, IEEE Computer Graphics and Applications.

[15]  David Waller,et al.  Interaction With an Immersive Virtual Environment Corrects Users' Distance Estimates , 2007, Hum. Factors.

[16]  Nigel W. John,et al.  A review of virtual environments for training in ball sports , 2012, Comput. Graph..

[17]  William H Warren,et al.  The Direction of Walking—but Not Throwing or Kicking—Is Adapted by Optic Flow , 2010, Psychological science.

[18]  C Hall,et al.  Prism adaptation in normal aging: slower adaptation rate and larger aftereffect. , 2000, Brain research. Cognitive brain research.

[19]  Maria V. Sanchez-Vives,et al.  Changing bodies changes minds: owning another body affects social cognition , 2015, Trends in Cognitive Sciences.

[20]  W. T. Thach,et al.  Throwing while looking through prisms , 2005 .

[21]  Jörg Schorer,et al.  Virtual Realities as Optimal Learning Environments in Sport - A Transfer Study of Virtual and Real Dart Throwing , 2015 .

[22]  D W Eby,et al.  A study of visually directed throwing in the presence of multiple distance cues , 1987, Perception & psychophysics.

[23]  Heinrich H. Bülthoff,et al.  Virtual arm׳s reach influences perceived distances but only after experience reaching , 2015, Neuropsychologia.

[24]  Heinrich H. Bülthoff,et al.  The Effect of Viewing a Self-Avatar on Distance Judgments in an HMD-Based Virtual Environment , 2010, PRESENCE: Teleoperators and Virtual Environments.

[25]  Victoria Interrante,et al.  Seven League Boots: A New Metaphor for Augmented Locomotion through Moderately Large Scale Immersive Virtual Environments , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[26]  Peter J. Werkhoven,et al.  Visuomotor Adaptation to Virtual Hand Position in Interactive Virtual Environments , 1998, Presence.

[27]  Ye Yuan,et al.  Is the rubber hand illusion induced by immersive virtual reality? , 2010, 2010 IEEE Virtual Reality Conference (VR).

[28]  D. Gopher,et al.  Evaluation of the light weight Juggling system , 2011, BIO Web of Conferences.

[29]  William B. Thompson,et al.  Does Perceptual-Motor Calibration Generalize across Two Different Forms of Locomotion? Investigations of Walking and Wheelchairs , 2013, PloS one.

[30]  Betty J. Mohler,et al.  The influence of feedback on egocentric distance judgments in real and virtual environments , 2006, APGV '06.

[31]  Mel Slater,et al.  Human Tails: Ownership and Control of Extended Humanoid Avatars , 2013, IEEE Transactions on Visualization and Computer Graphics.

[32]  Frank T. J. M. Zaal,et al.  Virtual Reality as a Tool for the Study of Perception-Action: The Case of Running to Catch Fly Balls , 2011, PRESENCE: Teleoperators and Virtual Environments.

[33]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[34]  Shirley Dex,et al.  JR 旅客販売総合システム（マルス）における運用及び管理について , 1991 .

[35]  Otmar Bock.  Basic principles of sensorimotor adaptation to different distortions with different effectors and movement types: a review and synthesis of behavioral findings , 2013, Front. Hum. Neurosci..

[36]  Gerd Bruder,et al.  Estimation of Detection Thresholds for Redirected Walking Techniques , 2010, IEEE Transactions on Visualization and Computer Graphics.

[37]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[38]  W. T. Thach,et al.  Throwing while looking through prisms. I. Focal olivocerebellar lesions impair adaptation. , 1996, Brain : a journal of neurology.

[39]  Patrick Haggard,et al.  What Is It Like to Have a Body? , 2012 .

[40]  Sharif Razzaque,et al.  Redirected Walking , 2001, Eurographics.

[41]  Jeanine Stefanucci,et al.  Pointing from a third person avatar location: does dynamic feedback help? , 2014, SAP '14.

[42]  Judy M. Vance,et al.  Virtual Training: Learning Transfer of Assembly Tasks , 2015, IEEE Transactions on Visualization and Computer Graphics.

[43]  Jeanine Stefanucci,et al.  Big Foot , 2015, ACM Trans. Appl. Percept..

[44]  Benjamin Wallace,et al.  Generalization of prism adaptation. , 2006, Journal of experimental psychology. Human perception and performance.

[45]  Benjamin J Chihak,et al.  Manipulating perception versus action in recalibration tasks , 2013, Attention, Perception, & Psychophysics.

[46]  Sharif Razzaque,et al.  The hand is slower than the eye: a quantitative exploration of visual dominance over proprioception , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[47]  B Wallace,et al.  Calibration and Alignment are Separable: Evidence From Prism Adaptation , 2001, Journal of motor behavior.

[48]  Heinrich H. Bülthoff,et al.  Welcome to Wonderland: The Influence of the Size and Shape of a Virtual Hand On the Perceived Size and Shape of Virtual Objects , 2013, PloS one.

[49]  Mel Slater,et al.  How to Build an Embodiment Lab: Achieving Body Representation Illusions in Virtual Reality , 2014, Front. Robot. AI.

[50]  Bobby Bodenheimer,et al.  Perceiving alterations in trajectories while throwing in a virtual environment , 2011, APGV '11.

[51]  Tabitha C. Peck,et al.  Putting yourself in the skin of a black avatar reduces implicit racial bias , 2013, Consciousness and Cognition.

[52]  M. Slater,et al.  Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes , 2013, Proceedings of the National Academy of Sciences.

[53]  K. J. Blom,et al.  The Effects of Rotating the Self Out of the Body in the Full Virtual Body Ownership Illusion , 2014, Perception.

[54]  M. Slater,et al.  Measuring the Effects through Time of the Influence of Visuomotor and Visuotactile Synchronous Stimulation on a Virtual Body Ownership Illusion , 2014, Perception.

[55]  Richard Kulpa,et al.  Which technology to investigate visual perception in sport: video vs. virtual reality. , 2015, Human movement science.

[56]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[57]  B Wallace,et al.  Phenomenal versus process explanations of prism aftereffects. , 1998, Journal of motor behavior.

[58]  Nigel W. John,et al.  Efficacy of a Virtual Environment for Training Ball Passing Skills in Rugby , 2014, Trans. Comput. Sci..

[59]  Eyal Ofek,et al.  Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences , 2016, CHI.