“Wow! I Have Six Fingers!”: Would You Accept Structural Changes of Your Hand in VR?

With the increasing demand in virtual reality applications and games, the need to understand how users perceive their virtual representation (avatar) is becoming more and more important. In particular, with the potential of virtual reality to alter and control avatars in different ways, the user representation in the virtual world does not always necessarily match the user body structure. In this context, this paper explores how users would accept as their own a six-digit realistic virtual hand. By measuring participants' senses of ownership (i.e., the impression that the virtual hand is actually our own hand) and agency (i.e., the impression to be able to control the actions of the virtual hand), we somehow evaluate the possibility of creating a Six-Finger Illusion in VR. We measured these two dimensions of virtual embodiment in a virtual reality experiment where participants performed two tasks successively: 1) a self-manipulation task inducing visuomotor feedback, where participants mimicked finger movements presented in the virtual scene, and 2) a visuotactile task inspired by Rubber Hand Illusion protocols, where an experimenter stroked the hand of the user with a brush. The real and virtual brushes were synchronously stroking the participants' real and virtual hand, and in the case when the virtual brush was stroking the additional virtual digit the real ring finger was also synchronously stroked to provide consistent tactile stimulation and elicit a sense of embodiment. Results of the experiment show that participants did experience high levels of ownership and agency of the six-digit virtual hand as a whole. We found higher levels of ownership and agency for the additional finger when the hand was fully animated, compared to a control group where the additional digit was not animated. Through the presented experiment, we found that participants responded positively to the possibility of controlling the six-digit hand despite the structural difference, and accepted the six-digit virtual hand and individual digits as their own to some extent. These results bring preliminary insights about how avatar with structural differences can affect the senses of ownership and agency experienced by users in VR.

[1]  Tabitha C. Peck,et al.  Putting yourself in the skin of a black avatar reduces implicit racial bias , 2013, Consciousness and Cognition.

[2]  Betty J. Mohler,et al.  Recognizing your own motions on virtual avatars: is it me or not? , 2013, SAP.

[3]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[4]  F. Vignemont Embodiment, ownership and disownership , 2011, Consciousness and Cognition.

[5]  Marjolein P. M. Kammers,et al.  What is embodiment? A psychometric approach , 2008, Cognition.

[6]  Axel Cleeremans,et al.  The relationship between human agency and embodiment , 2015, Consciousness and Cognition.

[7]  Jaron Lanier,et al.  Homuncular Flexibility in Virtual Reality , 2015, J. Comput. Mediat. Commun..

[8]  Ferran Argelaguet,et al.  The role of interaction in virtual embodiment: Effects of the virtual hand representation , 2016, 2016 IEEE Virtual Reality (VR).

[9]  Mel Slater,et al.  How to Build an Embodiment Lab: Achieving Body Representation Illusions in Virtual Reality , 2014, Front. Robot. AI.

[10]  Marc H Schieber,et al.  Human finger independence: limitations due to passive mechanical coupling versus active neuromuscular control. , 2004, Journal of neurophysiology.

[11]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[12]  Dottie M. Clower,et al.  Selective use of perceptual recalibration versus visuomotor skill acquisition. , 2000, Journal of neurophysiology.

[13]  H. Henrik Ehrsson,et al.  The Illusion of Owning a Third Arm , 2011, PloS one.

[14]  Maria V. Sanchez-Vives,et al.  Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion , 2012, PloS one.

[15]  A. Farnè,et al.  The Rubber Hand Illusion: Two’s a company, but three’s a crowd , 2012, Consciousness and Cognition.

[16]  C. Moore,et al.  Movement and the Rubber Hand Illusion , 2009, Perception.

[17]  W. IJsselsteijn,et al.  The effect of similarities in skin texture and hand shape on perceived ownership of a fake limb. , 2008, Body image.

[18]  Heinrich H. Bülthoff,et al.  Welcome to Wonderland: The Influence of the Size and Shape of a Virtual Hand On the Perceived Size and Shape of Virtual Objects , 2013, PloS one.

[19]  Ye Yuan,et al.  Is the rubber hand illusion induced by immersive virtual reality? , 2010, 2010 IEEE Virtual Reality Conference (VR).

[20]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[21]  H. Ehrsson,et al.  Upper limb amputees can be induced to experience a rubber hand as their own , 2008, Brain : a journal of neurology.

[22]  K. Vogeley,et al.  The “sense of agency” and its underlying cognitive and neural mechanisms , 2008, Consciousness and Cognition.

[23]  Mel Slater,et al.  Human Tails: Ownership and Control of Extended Humanoid Avatars , 2013, IEEE Transactions on Visualization and Computer Graphics.

[24]  Yeongho Seol,et al.  Creature features: online motion puppetry for non-human characters , 2013, SCA '13.

[25]  H. Ehrsson,et al.  The moving rubber hand illusion revisited: Comparing movements and visuotactile stimulation to induce illusory ownership , 2014, Consciousness and Cognition.

[26]  H. Ehrsson,et al.  How Many Arms Make a Pair? Perceptual Illusion of Having an Additional Limb , 2009, Perception.

[27]  Maria V. Sanchez-Vives,et al.  Virtual Hand Illusion Induced by Visuomotor Correlations , 2010, PloS one.

[28]  O. Blanke Multisensory brain mechanisms of bodily self-consciousness , 2012, Nature Reviews Neuroscience.

[29]  P. Haggard,et al.  The rubber hand illusion revisited: visuotactile integration and self-attribution. , 2005, Journal of experimental psychology. Human perception and performance.

[30]  Valeria I. Petkova,et al.  The Perspective Matters! Multisensory Integration in Ego-Centric Reference Frames Determines Full-Body Ownership , 2011, Front. Psychology.

[31]  Hong Yu Wong,et al.  Owning an Overweight or Underweight Body: Distinguishing the Physical, Experienced and Virtual Body , 2014, PloS one.

[32]  C. Spence,et al.  Visual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves , 2000, Psychological science.

[33]  H. Henrik Ehrsson,et al.  When Right Feels Left: Referral of Touch and Ownership between the Hands , 2009, PloS one.

[34]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[35]  Domenico Prattichizzo,et al.  On Control Interfaces for the Robotic Sixth Finger , 2016, AH.

[36]  John L Bradshaw,et al.  The Phantom in the Mirror: A Modified Rubber-Hand Illusion in Amputees and Normals , 2010, Perception.

[37]  V. Ramachandran,et al.  Touching the phantom limb , 1995, Nature.

[38]  Justin M. Harris,et al.  If I Were You: Perceptual Illusion of Body Swapping , 2008, PloS one.

[39]  H. Ehrsson,et al.  Moving a Rubber Hand that Feels Like Your Own: A Dissociation of Ownership and Agency , 2012, Front. Hum. Neurosci..

[40]  T. Metzinger,et al.  Full-body illusions and minimal phenomenal selfhood , 2009, Trends in Cognitive Sciences.

[41]  M. Slater,et al.  Measuring the Effects through Time of the Influence of Visuomotor and Visuotactile Synchronous Stimulation on a Virtual Body Ownership Illusion , 2014, Perception.

[42]  P. Haggard,et al.  Having a body versus moving your body: How agency structures body-ownership , 2006, Consciousness and Cognition.

[43]  Maria V. Sanchez-Vives,et al.  Towards a Digital Body: The Virtual Arm Illusion , 2008, Frontiers in human neuroscience.

[44]  H. Henrik Ehrsson,et al.  Illusory ownership of an invisible body reduces autonomic and subjective social anxiety responses , 2015, Scientific Reports.