Non-hierarchical Influence of Visual Form, Touch, and Position Cues on Embodiment, Agency, and Presence in Virtual Reality

The concept of self-representation is commonly decomposed into three component constructs (sense of embodiment, sense of agency, and sense of presence), and each is typically investigated separately across different experimental contexts. For example, embodiment has been explored in bodily illusions; agency has been investigated in hypnosis research; and presence has been primarily studied in the context of Virtual Reality (VR) technology. Given that each component involves the integration of multiple cues within and across sensory modalities, they may rely on similar underlying mechanisms. However, the degree to which this may be true remains unclear when they are independently studied. As a first step toward addressing this issue, we manipulated a range of cues relevant to these components of self-representation within a single experimental context. Using consumer-grade Oculus Rift VR technology, and a new implementation of the Virtual Hand Illusion, we systematically manipulated visual form plausibility, visual–tactile synchrony, and visual–proprioceptive spatial offset to explore their influence on self-representation. Our results show that these cues differentially influence embodiment, agency, and presence. We provide evidence that each type of cue can independently and non-hierarchically influence self-representation yet none of these cues strictly constrains or gates the influence of the others. We discuss theoretical implications for understanding self-representation as well as practical implications for VR experiment design, including the suitability of consumer-based VR technology in research settings.

[1]  B. Hommel,et al.  Body-ownership for actively operated non-corporeal objects , 2015, Consciousness and Cognition.

[2]  Olaf Blanke,et al.  Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness , 2015, Neuron.

[3]  H. Morgan,et al.  Sense of agency and sense of ownership: Arguing against a dissociation and for a critical role for multisensory binding. , 2015 .

[4]  Konrad Paul Kording,et al.  Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception , 2015, Front. Hum. Neurosci..

[5]  Jing Zhang,et al.  Disentangling the sense of agency and the sense of ownership in the virtual hand illusion paradigm , 2014 .

[6]  M. Tsakiris,et al.  The free-energy self: A predictive coding account of self-recognition , 2014, Neuroscience & Biobehavioral Reviews.

[7]  Alisa Mandrigin,et al.  Bodily ownership and self-location: Components of bodily self-consciousness , 2013, Consciousness and Cognition.

[8]  Amanda J. Barnier,et al.  Developing the Sense of Agency Rating Scale (SOARS): An empirical measure of agency disruption in hypnosis , 2013, Consciousness and Cognition.

[9]  Regine Zopf,et al.  The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm , 2013, Journal of visualized experiments : JoVE.

[10]  Catherine Preston,et al.  The role of distance from the body and distance from the real hand in ownership and disownership during the rubber hand illusion. , 2013, Acta psychologica.

[11]  R. Hastie,et al.  The influence of perceived causation on judgments of time: an integrative review and implications for decision-making , 2012, Front. Psychol..

[12]  Maria V. Sanchez-Vives,et al.  Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion , 2012, PloS one.

[13]  O. Blanke Multisensory brain mechanisms of bodily self-consciousness , 2012, Nature Reviews Neuroscience.

[14]  Shaun Gallagher,et al.  Multiple aspects in the sense of agency , 2012 .

[15]  H. Ehrsson,et al.  Moving a Rubber Hand that Feels Like Your Own: A Dissociation of Ownership and Agency , 2012, Front. Hum. Neurosci..

[16]  P. Fletcher,et al.  Sense of agency in health and disease: A review of cue integration approaches☆ , 2012, Consciousness and Cognition.

[17]  Massimiliano Di Luca,et al.  The Rubber Hand Illusion: Feeling of Ownership and Proprioceptive Drift Do Not Go Hand in Hand , 2011, PloS one.

[18]  J. Friedman,et al.  Viewing and feeling touch modulates hand position for reaching , 2011, Neuropsychologia.

[19]  M. Tsakiris,et al.  Hands only illusion: multisensory integration elicits sense of ownership for body parts but not for non-corporeal objects , 2010, Experimental Brain Research.

[20]  Regine Zopf,et al.  Crossmodal congruency measures of lateral distance effects on the rubber hand illusion , 2010, Neuropsychologia.

[21]  M. Tsakiris My body in the brain: A neurocognitive model of body-ownership , 2010, Neuropsychologia.

[22]  Maria V. Sanchez-Vives,et al.  How we experience immersive virtual environments: the concept of presence and its measurement * , 2009 .

[23]  Olaf Blanke,et al.  Keeping in Touch with One's Self: Multisensory Mechanisms of Self-Consciousness , 2009, PloS one.

[24]  K. Hiraki,et al.  Rubber Hand Illusion under Delayed Visual Feedback , 2009, PloS one.

[25]  P. Haggard,et al.  Visual enhancement of touch and the bodily self , 2008, Consciousness and Cognition.

[26]  A. Newen,et al.  I move, therefore I am: A new theoretical framework to investigate agency and ownership , 2008, Consciousness and Cognition.

[27]  Marjolein P. M. Kammers,et al.  What is embodiment? A psychometric approach , 2008, Cognition.

[28]  J. Kihlstrom The domain of hypnosis, revisited , 2008 .

[29]  Maria V. Sanchez-Vives,et al.  Towards a Digital Body: The Virtual Arm Illusion , 2008, Frontiers in human neuroscience.

[30]  Mel Slater,et al.  Presence in response to dynamic visual realism: a preliminary report of an experiment study , 2006, VRST '06.

[31]  P. Haggard,et al.  Having a body versus moving your body: How agency structures body-ownership , 2006, Consciousness and Cognition.

[32]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[33]  P. Haggard,et al.  The rubber hand illusion revisited: visuotactile integration and self-attribution. , 2005, Journal of experimental psychology. Human perception and performance.

[34]  Daniel M Wegner,et al.  Précis of The illusion of conscious will , 2004, Behavioral and Brain Sciences.

[35]  V. Ramachandran,et al.  Projecting sensations to external objects: evidence from skin conductance response , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[36]  P. Haggard,et al.  Voluntary action and conscious awareness , 2002, Nature Neuroscience.

[37]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[38]  Wijnand A. IJsselsteijn,et al.  Presence: Where Are We? , 2001, Cyberpsychology Behav. Soc. Netw..

[39]  D. Wolpert,et al.  Why can't you tickle yourself? , 2000, Neuroreport.

[40]  D. Wegner,et al.  Apparent mental causation. Sources of the experience of will. , 1999, The American psychologist.

[41]  Woodrow Barfield,et al.  Effects of Stereopsis and Head Tracking on Performance Using Desktop Virtual Environment Displays , 1999, Presence: Teleoperators & Virtual Environments.

[42]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[43]  Woodrow Barfield,et al.  The effect of update rate on the sense of presence within virtual environments , 1995, Virtual Reality.

[44]  Woodrow Barfield,et al.  Presence in virtual environments as a function of visual and auditory cues , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[45]  C. Frith,et al.  Experiences of alien control in schizophrenia reflect a disorder in the central monitoring of action , 1989, Psychological Medicine.

[46]  Oculus Best Practices , 2017 .

[47]  F. Waters,et al.  Sense of agency: theory, methods, and application , 2015 .

[48]  Michael H. Connors,et al.  Measuring Agency Change Across the Domain of Hypnosis , 2014 .

[49]  Mel Slater,et al.  Visual Realism Enhances Realistic Response in an Immersive Virtual Environment , 2009, IEEE Computer Graphics and Applications.

[50]  Maria V. Sanchez-Vives,et al.  1 From Presence Towards Consciousness , 2005 .

[51]  D. Wegner,et al.  Apparent mental causation , 1999 .

[52]  K. Bowers Do the Stanford Scales tap the "classic suggestion effect"? , 1981, The International journal of clinical and experimental hypnosis.