Measuring Presence in Virtual Environments: A Survey

The effectiveness of a virtual reality experience is strongly affected by the sense of presence of the users involved. This article reviews the different definitions of presence and the main proposed methods to measure it through the analysis of 1,214 papers published in the past 30 years. From the analysis of 239 user studies, we found that 85.8% used subjective measures, 11.7% used a combination of subjective and objective measures, while 2.5% used only objective measures. We also identified, from the studies reviewed, 29 main factors to evoke presence in virtual environments, grouped into four categories: Engagement, Personal Characteristics, Interaction Fidelity, and Display Fidelity.

[1]  Nicola Döring,et al.  Integration of spatial sound in immersive virtual environments an experimental study on effects of spatial sound on presence , 2013, 2013 IEEE Virtual Reality (VR).

[2]  Woodrow Barfield,et al.  Presence within Virtual Environments as a Function of Visual Display Parameters , 1996, Presence: Teleoperators & Virtual Environments.

[3]  Paula J. Durlach,et al.  Effect of Variations in Sensory Feedback on Performance in a Virtual Reaching Task , 2005, Presence: Teleoperators & Virtual Environments.

[4]  Maria del Carmen Juan Lizandra,et al.  Using augmented and virtual reality for the development of acrophobic scenarios. Comparison of the levels of presence and anxiety , 2010, Comput. Graph..

[5]  Helene S. Wallach,et al.  Attachment and sense of presence in a virtual environment , 2009, Virtual Reality.

[6]  Kerry L. Marsh,et al.  Perceiving interpersonally-mediated risk in virtual environments , 2010, Virtual Reality.

[7]  Pavel Zahorik,et al.  Presence as Being-in-the-World , 1998, Presence.

[8]  Marc Erich Latoschik,et al.  The Effects of Immersion on Harm-inducing Factors in Virtual Slot Machines , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[9]  Heinrich H. Bülthoff,et al.  Turbulent motions cannot shake VR , 2015, 2015 IEEE Virtual Reality (VR).

[10]  Mel Slater,et al.  A Virtual Presence Counter , 2000, Presence: Teleoperators & Virtual Environments.

[11]  Frank Steinicke,et al.  Blended Agents: Manipulation of Physical Objects within Mixed Reality Environments and Beyond , 2019, SUI.

[12]  Marc Busch,et al.  Being there for real: presence in real and virtual environments and its relation to usability , 2014, NordiCHI.

[13]  Frank Biocca,et al.  Telepresence via Television: Two Dimensions of Telepresence May Have Different Connections to Memory and Persuasion , 2006, J. Comput. Mediat. Commun..

[14]  Gerard Jounghyun Kim,et al.  Using a vibro-tactile display for enhanced collision perception and presence , 2004, VRST '04.

[15]  J. Freeman,et al.  Aroused and Immersed: The Psychophysiology of Presence , 2000 .

[16]  David W. Schloerb,et al.  A Quantitative Measure of Telepresence , 1995, Presence: Teleoperators & Virtual Environments.

[17]  Martin Fischbach,et al.  Effects of VE Transition Techniques on Presence, Illusion of Virtual Body Ownership, Efficiency, and Naturalness , 2018, SUI.

[18]  Erik Sikström,et al.  Shop 'til you hear it drop: influence of interactive auditory feedback in a virtual reality supermarket , 2016, VRST.

[19]  Kangsoo Kim,et al.  The impact of avatar-owner visual similarity on body ownership in immersive virtual reality , 2017, VRST.

[20]  Marc Cavazza,et al.  CaveUDK: a VR game engine middleware , 2012, VRST '12.

[21]  Ilona Heldal,et al.  Are two heads better than one?: object-focused work in physical and in virtual environments , 2006, VRST '06.

[22]  Kyungsik Han,et al.  Being More Focused and Engaged in Firefighting Training: Applying User-Centered Design to VR System Development , 2019, VRST.

[23]  Seung-A. Annie Jin,et al.  “It Feels Right. Therefore, I Feel Present and Enjoy”: The Effects of Regulatory Fit and the Mediating Roles of Social Presence and Self-Presence in Avatar-Based 3D Virtual Environments , 2011, PRESENCE: Teleoperators and Virtual Environments.

[24]  Jean-Marc Vézien,et al.  Spatial Presence in Real and Remote Immersive Environments , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[25]  Jari Takatalo,et al.  The Experiential Dimensions of Two Different Digital Games , 2004 .

[26]  John Quarles,et al.  Information recall in VR disability simulation , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[27]  Rajiv V. Dubey,et al.  Locomotion in Virtual Reality for Individuals with Autism Spectrum Disorder , 2016, SUI.

[28]  Phil Turner,et al.  Place, Sense of Place, and Presence , 2006, Presence: Teleoperators & Virtual Environments.

[29]  Steven K. Feiner,et al.  Comparing steering-based travel techniques for search tasks in a CAVE , 2011, 2011 IEEE Virtual Reality Conference.

[30]  Holger Regenbrecht,et al.  The Experience of Presence: Factor Analytic Insights , 2001, Presence: Teleoperators & Virtual Environments.

[31]  Holger Regenbrecht,et al.  Real and Illusory Interactions Enhance Presence in Virtual Environments , 2002, Presence: Teleoperators & Virtual Environments.

[32]  Julian Frommel,et al.  ShareVR: Enabling Co-Located Experiences for Virtual Reality between HMD and Non-HMD Users , 2017, CHI.

[33]  Daniel Västfjäll,et al.  The Actor-Observer Effect in Virtual Reality Presentations , 2001, Cyberpsychology Behav. Soc. Netw..

[34]  Steffi Beckhaus,et al.  Adaptive Generation of Emotional Impact Using Enhanced Virtual Environments , 2012, PRESENCE: Teleoperators and Virtual Environments.

[35]  Antonio Frisoli,et al.  Multisensory Feedback Can Enhance Embodiment Within an Enriched Virtual Walking Scenario , 2014, PRESENCE: Teleoperators and Virtual Environments.

[36]  Mel Slater,et al.  How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments , 2004, Presence: Teleoperators & Virtual Environments.

[37]  Timo Saari,et al.  Using eye tracking and psychophysiological methods to study spatial presence , 2003 .

[38]  Helene S. Wallach,et al.  Personality variables and presence , 2010, Virtual Reality.

[39]  Mel Slater,et al.  Effects of P300-Based BCI Use on Reported Presence in a Virtual Environment , 2010, PRESENCE: Teleoperators and Virtual Environments.

[40]  Kwang Suk Park,et al.  The Application of Biosignal Feedback for Reducing Cybersickness from Exposure to a Virtual Environment , 2008, PRESENCE: Teleoperators and Virtual Environments.

[41]  Kangsoo Kim,et al.  Exploring social presence transfer in real-virtual human interaction , 2016, 2016 IEEE Virtual Reality (VR).

[42]  Daniel Casasanto,et al.  When Does Virtual Embodiment Change Our Minds? , 2016, PRESENCE: Teleoperators and Virtual Environments.

[43]  Doron Friedman,et al.  Comparing Group Discussion in Virtual and Physical Environments , 2009, PRESENCE: Teleoperators and Virtual Environments.

[44]  Wijnand A. IJsselsteijn,et al.  Effects of Stereoscopic Presentation, Image Motion, and Screen Size on Subjective and Objective Corroborative Measures of Presence , 2001, Presence: Teleoperators & Virtual Environments.

[45]  Roderick Murray-Smith,et al.  A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays , 2015, CHI Extended Abstracts.

[46]  Marc Cavazza,et al.  Exploring the usability of immersive interactive storytelling , 2010, VRST '10.

[47]  Ellen Yi-Luen Do,et al.  Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience , 2018, CHI.

[48]  Paul R. MacNeilage,et al.  Underwater Virtual Reality System for Neutral Buoyancy Training: Development and Evaluation , 2019, VRST.

[49]  Matthieu Poyade,et al.  The Influence of Passive Haptic Feedback and Difference Interaction Metaphors on Presence and Task Performance , 2010, PRESENCE: Teleoperators and Virtual Environments.

[50]  Hongsong Li,et al.  Am I in the theater?: usability study of live performance based virtual reality , 2018, VRST.

[51]  António Augusto de Sousa,et al.  The effects of body position on Reflexive Motor Acts and the sense of presence in virtual environments , 2018, Comput. Graph..

[52]  Hans-Werner Gellersen,et al.  Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences , 2015, CHI.

[53]  Neff Walker,et al.  Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[54]  Stéphane Bouchard,et al.  Exposure to an unpleasant odour increases the sense of Presence in virtual reality , 2017, Virtual Reality.

[55]  Craig D. Murray,et al.  Presence Accompanying Induced Hearing Loss: Implications for Immersive Virtual Environments , 2000, Presence: Teleoperators & Virtual Environments.

[56]  Hunter G. Hoffman,et al.  The Illusion of Presence in Immersive Virtual Reality during an fMRI Brain Scan , 2003, Cyberpsychology Behav. Soc. Netw..

[57]  Dianne M. Murray,et al.  Interacting with Presence. HCI and the Sense of Presence in Computer-mediated Environments , 2014 .

[58]  Mel Slater,et al.  Presence in immersive virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[59]  Ming C. Lin,et al.  Evaluating the Effectiveness of Redirected Walking with Auditory Distractors for Navigation in Virtual Environments , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[60]  Dinesh Manocha,et al.  PedVR: simulating gaze-based interactions between a real user and virtual crowds , 2016, VRST.

[61]  Stephen A. Palmisano,et al.  Effects of head-display lag on presence in the oculus rift , 2018, VRST.

[62]  Jaehoon Jung,et al.  Hand-held virtual reality: a feasibility study , 2006, VRST '06.

[63]  C. Youngblut.  Experience of Presence in Virtual Environments , 2003 .

[64]  Dennis Wiebusch,et al.  Usability benchmarks for motion tracking systems , 2013, VRST '13.

[65]  Woodrow Barfield,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[66]  Woodrow Barfield,et al.  Collaborative Task Performance for Learning Using a Virtual Environment , 1999, Presence.

[67]  Mel Slater,et al.  Temporal and Spatial Variations in Presence: Qualitative Analysis of Interviews from an Experiment on Breaks in Presence , 2008, PRESENCE: Teleoperators and Virtual Environments.

[68]  Anthony Steed,et al.  Merging environments for shared spaces in mixed reality , 2018, VRST.

[69]  Kasper Hornbæk,et al.  Virtual reality studies outside the laboratory , 2017, VRST.

[70]  Susan R. Fussell,et al.  Using linguistic features to measure presence in computer-mediated communication , 2006, CHI.

[71]  David Moore,et al.  Rapid, Continuous Movement Between Nodes as an Accessible Virtual Reality Locomotion Technique , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[72]  Pamela J. Wisniewski,et al.  Over My Hand: Using a Personalized Hand in VR to Improve Object Size Estimation, Body Ownership, and Presence , 2018, SUI.

[73]  Benjamin Weyers,et al.  A Non-Stationary Office Desk Substitution for Desk-Based and HMD-Projected Virtual Reality , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[74]  Stefania Serafin,et al.  Effects of vibrotactile stimulation during virtual sandboarding , 2016, 2016 IEEE Virtual Reality (VR).

[75]  Gerard Llorach,et al.  Simulator sickness and presence using HMDs: comparing use of a game controller and a position estimation system , 2014, VRST '14.

[76]  Katerina Mania,et al.  An experimental exploration of the relationship between subjective impressions of illumination and physical fidelity , 2005, Comput. Graph..

[77]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[78]  Martijn J. Schuemie,et al.  Research on Presence in Virtual Reality: A Survey , 2001, Cyberpsychology Behav. Soc. Netw..

[79]  Edwin H. Blake,et al.  Cultural reinterpretation and resonance: The San and hip-hop , 2011, Comput. Graph..

[80]  Dieter Schmalstieg,et al.  Human upper-body inverse kinematics for increased embodiment in consumer-grade virtual reality , 2018, VRST.

[81]  Rosa María Baños,et al.  An Augmented Reality System for the Treatment of Acrophobia: The Sense of Presence Using Immersive Photography , 2006, PRESENCE: Teleoperators and Virtual Environments.

[82]  Kwanguk Kim,et al.  Comparison of desktop, head mounted display, and six wall fully immersive systems using a stressful task , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[83]  Luca Chittaro,et al.  Effects of Different Types of Virtual Reality Display on Presence and Learning in a Safety Training Scenario , 2018, IEEE Transactions on Visualization and Computer Graphics.

[84]  Gianluca De Leo,et al.  Measuring Sense of Presence and User Characteristics to Predict Effective Training in an Online Simulated Virtual Environment , 2014, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[85]  Isabelle Milleville-Pennel,et al.  Driving for Real or on a Fixed-Base Simulator: Is It so Different? An Explorative Study , 2015, PRESENCE: Teleoperators and Virtual Environments.

[86]  Carrie Heeter,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[87]  Gerard Jounghyun Kim,et al.  Design and evaluation of a wind display for virtual reality , 2004, VRST '04.

[88]  Gaurav S. Sukhatme,et al.  Haptic Teleoperation of a Mobile Robot: A User Study , 2005, Presence: Teleoperators & Virtual Environments.

[89]  Mariano Alcañiz Raya,et al.  A Neuroscience Approach to Virtual Reality Experience Using Transcranial Doppler Monitoring , 2009, PRESENCE: Teleoperators and Virtual Environments.

[90]  Maximino Bessa,et al.  Application of the steering law to virtual reality walking navigation interfaces , 2018, Comput. Graph..

[91]  John Quarles,et al.  The effects of VEs on mobility impaired users: presence, gait, and physiological response , 2013, VRST '13.

[92]  Matthew Coxon,et al.  Individual differences in virtual reality: Are spatial presence and spatial ability linked? , 2016, Virtual Reality.

[93]  Takuji Narumi,et al.  Ascending and Descending in Virtual Reality: Simple and Safe System Using Passive Haptics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[94]  Abraham G. Campbell,et al.  Why, when and how to use augmented reality agents (AuRAs) , 2013, Virtual Reality.

[95]  Luca Turchet,et al.  Enhancing realism in virtual environments by simulating the audio-haptic sensation of walking on ground surfaces , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[96]  Mariano Alcañiz Raya,et al.  Breaks in Presence in Virtual Environments: An Analysis of Blood Flow Velocity Responses , 2011, PRESENCE: Teleoperators and Virtual Environments.

[97]  Stéphane Bouchard,et al.  Anxiety Increases the Feeling of Presence in Virtual Reality , 2008, PRESENCE: Teleoperators and Virtual Environments.

[98]  Gert Pfurtscheller,et al.  Navigating Virtual Reality by Thought: What Is It Like? , 2007, PRESENCE: Teleoperators and Virtual Environments.

[99]  John M. Flach,et al.  The Reality of Experience: Gibson's Way , 1998, Presence.

[100]  Eyal Ofek,et al.  Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences , 2016, CHI.

[101]  G. Riva,et al.  Being There: Concepts, Effects and Measurements of User Presence in Synthetic Environments , 2003 .

[102]  William R. Sherman,et al.  RIST: Radiological Immersive Survey Training for two simultaneous users , 2010, Comput. Graph..

[103]  Klaus H. Hinrichs,et al.  Natural Perspective Projections for Head-Mounted Displays , 2011, IEEE Transactions on Visualization and Computer Graphics.

[104]  Extending Virtual Reality Display Wall Environments Using Augmented Reality , 2019, SUI.

[105]  Shuo Zhou,et al.  Sense of Presence, Attitude Change, Perspective-Taking and Usability in First-Person Split-Sphere 360° Video , 2018, CHI.

[106]  Martin White,et al.  Usability evaluation of the EPOCH multimodal user interface: designing 3D tangible interactions , 2006, VRST '06.

[107]  Brian F. Goldiez,et al.  Virtual Experience Test: A virtual environment evaluation questionnaire , 2010, 2010 IEEE Virtual Reality Conference (VR).

[108]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[109]  Kyle Johnsen,et al.  An Evaluation of Immersive Displays for Virtual Human Experiences , 2008, 2008 IEEE Virtual Reality Conference.

[110]  Mary C. Whitton,et al.  Effects of handling real objects and avatar fidelity on cognitive task performance in virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[111]  Minyoung Kwon,et al.  The Influence of Body Position on Presence When Playing a Virtual Reality Game , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[112]  Karsten Bormann,et al.  Presence and the Utility of Audio Spatialization , 2005, Presence: Teleoperators & Virtual Environments.

[113]  Concepción Perpiñá,et al.  Presence and Reality Judgment in Virtual Environments: A Unitary Construct? , 2000, Cyberpsychology Behav. Soc. Netw..

[114]  Henry R. Jex,et al.  Measuring Mental Workload: Problems, Progress, and Promises , 1988 .

[115]  Anderson Maciel,et al.  Using Immersive Virtual Reality to Reduce Work Accidents in Developing Countries , 2016, IEEE Computer Graphics and Applications.

[116]  Paul Zimmons,et al.  The influence of rendering quality on presence and task performance in a virtual environment , 2003, IEEE Virtual Reality, 2003. Proceedings..

[117]  J V Cohn,et al.  Reaching during virtual rotation: context specific compensations for expected coriolis forces. , 2000, Journal of neurophysiology.

[118]  Thomas Alexander,et al.  Head turn scaling below the threshold of perception in immersive virtual environments , 2016, VRST.

[119]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[120]  M. Whitton,et al.  Effect of latency on presence in stressful virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[121]  Sabarish V. Babu,et al.  Comparison of path visualizations and cognitive measures relative to travel technique in a virtual environment , 2005, IEEE Transactions on Visualization and Computer Graphics.

[122]  William Ribarsky,et al.  Simulator sickness and presence in a high FOV virtual environment , 2001, Proceedings IEEE Virtual Reality 2001.

[123]  OmniPres project IST-2001-39237 Deliverable 5 Measuring Presence : A Guide to Current Measurement Approaches , 2004 .

[124]  Wijnand A. IJsselsteijn,et al.  Using Behavioral Realism to Estimate Presence: A Study of the Utility of Postural Responses to Motion Stimuli , 2000, Presence: Teleoperators & Virtual Environments.

[125]  Robert S. Allison,et al.  Personal Space in Virtual Reality , 2003, TAP.

[126]  David Callear,et al.  Putting the Virtual into Reality: Assessing Object-Presence with Projection-Augmented Models , 2002, Presence: Teleoperators & Virtual Environments.

[127]  S. Bouchard,et al.  Reliability and validity of a single-item measure of presence in VR , 2004, Proceedings. Second International Conference on Creating, Connecting and Collaborating through Computing.

[128]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[129]  Woodrow Barfield,et al.  The effect of update rate on the sense of presence within virtual environments , 1995, Virtual Reality.

[130]  Jeremy N. Bailenson,et al.  Virtual Experiences, Physical Behaviors: The Effect of Presence on Imitation of an Eating Avatar , 2009, PRESENCE: Teleoperators and Virtual Environments.

[131]  Gregory M. P. O'Hare,et al.  Presence Equation: An Investigation into Cognitive Factors Underlying Presence , 2003, Presence: Teleoperators & Virtual Environments.

[132]  SwiVRChair: A Motorized Swivel Chair to Nudge Users' Orientation for 360 Degree Storytelling in Virtual Reality , 2016, CHI.

[133]  NedelLuciana,et al.  Using Immersive Virtual Reality to Reduce Work Accidents in Developing Countries , 2016 .

[134]  Tassos A. Mikropoulos,et al.  Presence: a unique characteristic in educational virtual environments , 2006, Virtual Reality.

[135]  Kangsoo Kim,et al.  The wobbly table: Increased social presence via subtle incidental movement of a real-virtual table , 2016, 2016 IEEE Virtual Reality (VR).

[136]  Kay M. Stanney,et al.  Handbook of Virtual Environments - Design, Implementation, and Applications, Second Edition , 2014, Handbook of Virtual Environments, 2nd ed..

[137]  Bob G. Witmer,et al.  Judging Perceived and Traversed Distance in Virtual Environments , 1998, Presence.

[138]  Mariano Alcañiz Raya,et al.  Assessment of the influence of navigation control and screen size on the sense of presence in virtual reality using EEG , 2014, Expert Syst. Appl..

[139]  Karsten Bormann,et al.  Visuals are not what they look , 2008, Virtual Reality.

[140]  Sharif Razzaque,et al.  Comparing VE locomotion interfaces , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[141]  Gerard Jounghyun Kim,et al.  Effect of accompanying onomatopoeia with sound feedback toward presence and user experience in virtual reality , 2018, VRST.

[142]  Ronald R. Mourant,et al.  Human Factors Issues in Virtual Environments: A Review of the Literature , 1998, Presence.

[143]  Bartholomäus Wissmath,et al.  Measuring Spatial Presence: Introducing and Validating the Pictorial Presence SAM , 2015, PRESENCE: Teleoperators and Virtual Environments.

[144]  Gerard Jounghyun Kim.  Designing virtual reality systems - the structured approach , 2005 .

[145]  Rod McCall,et al.  Measuring presence in virtual environments , 2004, CHI EA '04.

[146]  In-Young Kim,et al.  10 An Investigation into Physiological Responses in Virtual Environments: An Objective Measurement of Presence , 2003 .

[147]  Matthew Lombard,et al.  MEASURING PRESENCE: A LITERATURE-BASED APPROACH TO THE DEVELOPMENT OF A STANDARDIZED PAPER-AND-PENCIL INSTRUMENT , 2000 .

[148]  Yvonne de Kort,et al.  Virtual Fitness: Stimulating Exercise Behavior through Media Technology , 2006, PRESENCE: Teleoperators and Virtual Environments.

[149]  Umberto Cugini,et al.  Visual-olfactory immersive environment for product evaluation , 2015, 2015 IEEE Virtual Reality (VR).

[150]  Lutz Jäncke,et al.  Neural Correlate of Spatial Presence in an Arousing and Noninteractive Virtual Reality: An EEG and Psychophysiology Study , 2006, Cyberpsychology Behav. Soc. Netw..

[151]  Federica Pallavicini,et al.  What Is the Relationship Among Positive Emotions, Sense of Presence, and Ease of Interaction in Virtual Reality Systems? An On-Site Evaluation of a Commercial Virtual Experience , 2018, PRESENCE: Virtual and Augmented Reality.

[152]  Klaus H. Hinrichs,et al.  Gradual transitions and their effects on presence and distance estimation , 2010, Comput. Graph..

[153]  Joaquim A. Jorge,et al.  Combining EEG Data with Place and Plausibility Responses as an Approach to Measuring Presence in Outdoor Virtual Environments , 2014, PRESENCE: Teleoperators and Virtual Environments.

[154]  Seungyong Lee,et al.  The dichotomy of presence elements: the where and what , 2003, IEEE Virtual Reality, 2003. Proceedings..

[155]  Mel Slater,et al.  Grand Challenges in Virtual Environments , 2014, Front. Robot. AI.

[156]  John R. Wilson,et al.  Presence and Side Effects: Complementary or Contradictory? , 1997, HCI.

[157]  Ahmad R. Hariri,et al.  The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences , 2017, Behavior research methods.

[158]  M. Lombard,et al.  Measuring Presence: The Temple Presence Inventory , 2009 .

[159]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[160]  Anatole Lécuyer,et al.  Inducing self-motion sensations in driving simulators using force-feedback and haptic motion , 2017, 2017 IEEE Virtual Reality (VR).

[161]  Blair MacIntyre,et al.  Presence and engagement in an interactive drama , 2007, CHI.

[162]  F. Brooks,et al.  Physiological Reaction as an Objective Measure of Presence in Virtual Environments , 2001 .

[163]  Klaus H. Hinrichs,et al.  Does a Gradual Transition to the Virtual World increase Presence? , 2009, 2009 IEEE Virtual Reality Conference.

[164]  Weiwei Zhang,et al.  Face-tracking as an augmented input in video games: enhancing presence, role-playing and control , 2006, CHI.

[165]  Bektur Ryskeldiev,et al.  Avatars for Co-located Collaborations in HMO-based Virtual Environments , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[166]  Yun Ling,et al.  Effects of Stereoscopic Viewing on Presence, Anxiety, and Cybersickness in a Virtual Reality Environment for Public Speaking , 2012, PRESENCE: Teleoperators and Virtual Environments.

[167]  Beatriz Rey,et al.  Research in Neuroscience and Virtual Reality , 2010 .

[168]  John R. Wilson,et al.  Measurement of presence and its consequences in virtual environments , 2000, Int. J. Hum. Comput. Stud..

[169]  Woodrow Barfield,et al.  A Review of Presence and Performance in Virtual Environments , 2000, Int. J. Hum. Comput. Interact..

[170]  Nathaniel I. Durlach,et al.  Telepresence , 1992, Presence: Teleoperators & Virtual Environments.

[171]  Hrishikesh M. Rao,et al.  Exploring the effects of image persistence in low frame rate virtual environments , 2015, 2015 IEEE Virtual Reality (VR).

[172]  Fabien Lotte,et al.  Brain computer interface vs walking interface in VR: the impact of motor activity on spatial transfer , 2012, VRST '12.

[173]  Yu Wang,et al.  Exploring the Use of a Robust Depth-sensor-based Avatar Control System and its Effects on Communication Behaviors , 2019, VRST.

[174]  Dirk Heylen,et al.  With a little help from a holographic friend: the OpenIMPRESS mixed reality telepresence toolkit for remote collaboration systems , 2018, VRST.

[175]  Christa Neuper,et al.  Walking by Thinking: The Brainwaves Are Crucial, Not the Muscles! , 2006, PRESENCE: Teleoperators and Virtual Environments.

[176]  Rafael E. Riveros,et al.  Studies in Health Technology and Informatics , 2005 .

[177]  Frank Biocca,et al.  The Effect of the Agency and Anthropomorphism on Users' Sense of Telepresence, Copresence, and Social Presence in Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[178]  Daniel M. Shafer,et al.  Control mapping in virtual reality: effects on spatial presence and controller naturalness , 2018, Virtual Reality.

[179]  Bruce H. Thomas,et al.  Remapped Physical-Virtual Interfaces with Bimanual Haptic Retargeting , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[180]  Robbe Cools,et al.  Investigating the Effect of Distractor Interactivity for Redirected Walking in Virtual Reality , 2019, SUI.

[181]  Ugur Güdükbay,et al.  Increasing the Sense of Presence in a Simulation Environment Using Image Generators Based on Visual Attention , 2010, PRESENCE: Teleoperators and Virtual Environments.

[182]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[183]  Ceenu George,et al.  ElectroCutscenes: Realistic Haptic Feedback in Cutscenes of Virtual Reality Games Using Electric Muscle Stimulation , 2019, VRST.

[184]  Mary C. Whitton,et al.  A Survey of Presence and Related Concepts , 2017, ACM Comput. Surv..

[185]  Holger Regenbrecht,et al.  Visual manipulations for motor rehabilitation , 2012, Comput. Graph..

[186]  Hannes Kaufmann,et al.  Co-presence and proxemics in shared walkable virtual environments with mixed colocation , 2018, VRST.

[187]  Pamela J. Wisniewski,et al.  RealME: the influence of body and hand representations on body ownership and presence , 2017, SUI.

[188]  Holger Regenbrecht,et al.  A virtual reality claustrophobia therapy system - implementation and test , 2009, 2009 IEEE Virtual Reality Conference.

[189]  Miguel Melo,et al.  Impact of Different Sensory Stimuli on Presence in Credible Virtual Environments , 2020, IEEE Transactions on Visualization and Computer Graphics.

[190]  Mel Slater,et al.  Using Presence Questionnaires in Reality , 2000, Presence: Teleoperators & Virtual Environments.

[191]  Mel Slater,et al.  Persuading people in a remote destination to sing by beaming there , 2013, VRST '13.

[192]  Albert A. Rizzo,et al.  Comparison of Two VR Platforms for Rehabilitation: Video Capture versus HMD , 2005, Presence: Teleoperators & Virtual Environments.

[193]  Mores Prachyabrued,et al.  Toward Virtual Stress Inoculation Training of Prehospital Healthcare Personnel: A Stress-Inducing Environment Design and Investigation of an Emotional Connection Factor , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[194]  Sharif Razzaque,et al.  The Responses of People to Virtual Humans in an Immersive Virtual Environment , 2005, Presence: Teleoperators & Virtual Environments.

[195]  Corey P. Carbonara,et al.  Spatial Presence and Perceived Reality as Predictors of Motion-Based Video Game Enjoyment , 2011, PRESENCE: Teleoperators and Virtual Environments.

[196]  Mary C. Whitton,et al.  Effects of Handling Real Objects and Self-Avatar Fidelity on Cognitive Task Performance and Sense of Presence in Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[197]  Mel Slater,et al.  The Influence of Body Movement on Subjective Presence in Virtual Environments , 1998, Hum. Factors.

[198]  Bartholomäus Wissmath,et al.  Measuring presence with verbal versus pictorial scales: a comparison between online- and ex post-ratings , 2010, Virtual Reality.

[199]  Dave J. Hobbs,et al.  Continuous Presence in Collaborative Virtual Environments: Towards a Hybrid Avatar-Agent Model for User Representation , 2001, IVA.

[200]  Ingrid Heynderickx,et al.  The Effect of Priming Pictures and Videos on a QuestionAnswer Dialog Scenario in a Virtual Environment , 2013, PRESENCE: Teleoperators and Virtual Environments.

[201]  Eelke Folmer,et al.  Legomotion: scalable walking-based virtual locomotion , 2017, VRST.

[202]  Marc Rébillat,et al.  Audio, visual, and audio-visual egocentric distance perception by moving subjects in virtual environments , 2012, TAP.

[203]  Daniela E. Damian,et al.  Evaluating the effectiveness of mixed reality music instrument learning with the theremin , 2019, Virtual Reality.

[204]  Marc Cavazza,et al.  Causal Perception in Virtual Reality and its Implications for Presence Factors , 2007, PRESENCE: Teleoperators and Virtual Environments.

[205]  Michal Lahav,et al.  Virtual guiding avatar: an effective procedure to reduce simulator sickness in virtual environments , 2004, CHI.

[206]  Jari Takatalo,et al.  Presence and Flow in Virtual Environments: An Explorative Study , 2002 .

[207]  Bernhard E. Riecke,et al.  Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality , 2009, TAP.

[208]  Indira Thouvenin,et al.  A study on improving performance in gesture training through visual guidance based on learners' errors , 2017, VRST.

[209]  Pattie Maes,et al.  BreathVR: Leveraging Breathing as a Directly Controlled Interface for Virtual Reality Games , 2018, CHI.

[210]  Henry Been-Lirn Duh,et al.  Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[211]  Benjamin Weyers,et al.  Examining Rotation Gain in CAVE-like Virtual Environments , 2016, IEEE Transactions on Visualization and Computer Graphics.

[212]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[213]  Wolfgang Ellermeier,et al.  Noise-cancelling, steps and soundscapes: the effect of auditory stimulation on presence in virtual realities while walking , 2016, VRST.

[214]  Miguel Melo,et al.  Presence and cybersickness in immersive content: Effects of content type, exposure time and gender , 2017, Comput. Graph..

[215]  Robin Horst,et al.  Virtual Reality Forge: Pattern-Oriented Authoring of Virtual Reality Nuggets , 2019, VRST.

[216]  Teresa Chambel,et al.  Windy sight surfers: sensing and awareness of 360° immersive videos on the move , 2013, EuroITV.

[217]  Peter van der Straaten,et al.  Research on Presence in VR: a Survey , 2001 .

[218]  Kouta Minamizawa,et al.  Extra-normal interactions in mediated virtual environments: An investigation of an audio-visual crossed-sense modality , 2016, 2016 IEEE Virtual Reality (VR).

[219]  Zachary Wartell,et al.  Leveraging change blindness for redirection in virtual environments , 2011, 2011 IEEE Virtual Reality Conference.

[220]  Guy M. Wallis,et al.  Predicting the Efficacy of Simulator-based Training Using a Perceptual Judgment Task Versus Questionnaire-based Measures of Presence , 2013, PRESENCE: Teleoperators and Virtual Environments.

[221]  Pattie Maes,et al.  Auris: creating affective virtual spaces from music , 2017, VRST.

[222]  Ilona Heldal,et al.  Collaborating in networked immersive spaces: as good as being there together? , 2001, Comput. Graph..

[223]  Thuong N. Hoang,et al.  Alternating Reality: An Interweaving Narrative of Physical and Virtual Cultural Exhibitions , 2017, PRESENCE: Teleoperators and Virtual Environments.

[224]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[225]  Corey P. Carbonara,et al.  Controller Required? The Impact of Natural Mapping on Interactivity, Realism, Presence, and Enjoyment in Motion-Based Video Games , 2014, PRESENCE: Teleoperators and Virtual Environments.

[226]  Dominique Bechmann,et al.  New hybrid projection to widen the vertical field of view with large screen to improve the perception of personal space in architectural project review , 2016, 2016 IEEE Virtual Reality (VR).

[227]  David B. Kaber,et al.  Telepresence , 1998, Hum. Factors.

[228]  Michael Neff,et al.  The Impact of Avatar Tracking Errors on User Experience in VR , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[229]  Kim Willems,et al.  When brands come to life: experimental research on the vividness effect of Virtual Reality in transformational marketing communications , 2017, Virtual Reality.

[230]  Kim Willems,et al.  Leveraging advertising to a higher dimension: experimental research on the impact of virtual reality on brand personality impressions , 2018, Virtual Reality.

[231]  John Quarles,et al.  A unique way to increase presence of mobility impaired users — Increasing confidence in balance , 2014, 2014 IEEE Virtual Reality (VR).

[232]  Cristina Botella,et al.  An fMRI Study to Analyze Neural Correlates of Presence during Virtual Reality Experiences , 2014, Interact. Comput..

[233]  Dimitar Valkov,et al.  Smooth immersion: the benefits of making the transition to virtual environments a continuous process , 2017, SUI.

[234]  Marko Turpeinen,et al.  Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? , 2006, PRESENCE: Teleoperators and Virtual Environments.

[235]  Gustavo R. Silva,et al.  A questionnaire for measuring presence in virtual environments: factor analysis of the presence questionnaire and adaptation into Brazilian Portuguese , 2016, Virtual Reality.

[236]  Sungkil Lee,et al.  Observing effects of attention on presence with fMRI , 2004, VRST '04.

[237]  Heinrich H. Bülthoff,et al.  Cognitive factors can influence self-motion perception (vection) in virtual reality , 2006, TAP.

[238]  Nicholas Polys,et al.  Cinemacraft: exploring fidelity cues in collaborative virtual world interactions , 2019, Virtual Reality.

[239]  Mel Slater,et al.  Variations in physiological responses of participants during different stages of an immersive virtual environment experiment , 2006, VRST '06.

[240]  Arnulf Remote,et al.  PICTORIAL COMMUNICATION IN VIRTUAL AND REAL ENVIRONMENTS , 1992 .

[241]  Sabarish V. Babu,et al.  Programming moves: Design and evaluation of applying embodied interaction in virtual environments to enhance computational thinking in middle school students , 2016, 2016 IEEE Virtual Reality (VR).

[242]  Stefan M. Grünvogel,et al.  Comparison of the usability of a car infotainment system in a mixed reality environment and in a real car , 2018, VRST.

[243]  Mary C. Whitton,et al.  Immersion and coherence in a stressful virtual environment , 2018, VRST.

[244]  Presence-Related Influences of a Small Talking Facial Image on Psychophysiological Measures of Emotion and Attention , 2006 .

[245]  Mary C. Whitton,et al.  Passive haptics significantly enhances virtual environments , 2001 .

[246]  Bernhard Preim,et al.  The FAUST framework: Free-form annotations on unfolding vascular structures for treatment planning , 2017, Comput. Graph..

[247]  Massimo Bergamasco,et al.  Investigating the process of emotion recognition in immersive and non-immersive virtual technological setups , 2016, VRST.

[248]  Marc Busch,et al.  I'm There! The influence of virtual reality and mixed reality environments combined with two different navigation methods on presence , 2015, 2015 IEEE Virtual Reality (VR).

[249]  Rolf Nordahl,et al.  Missing the point: an exploration of how to guide users' attention during cinematic virtual reality , 2016, VRST.

[250]  P. Emmelkamp,et al.  Sense of presence and anxiety during virtual social interactions between a human and virtual humans , 2014, PeerJ.

[251]  Thies Pfeiffer,et al.  Detecting movement patterns from inertial data of a mobile head-mounted-display for navigation via walking-in-place , 2016, 2016 IEEE Virtual Reality (VR).

[252]  Eva-Lotta Sallnäs,et al.  Effects of Communication Mode on Social Presence, Virtual Presence, and Performance in Collaborative Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[253]  Mel Slater,et al.  A note on presence terminology , 2003 .

[254]  Victoria Interrante,et al.  Elucidating Factors that Can Facilitate Veridical Spatial Perception in Immersive Virtual Environments , 2007, PRESENCE: Teleoperators and Virtual Environments.

[255]  Mel Slater,et al.  Presence in response to dynamic visual realism: a preliminary report of an experiment study , 2006, VRST '06.

[256]  Anja S. Göritz,et al.  Virtual reality in the application of heart rate variability biofeedback , 2019, Int. J. Hum. Comput. Stud..

[257]  Vijay Pawar,et al.  Evaluating the Influence of Haptic Force-Feedback on 3D Selection Tasks using Natural Egocentric Gestures , 2009, 2009 IEEE Virtual Reality Conference.

[258]  Enrico Rukzio,et al.  Breaking the Tracking: Enabling Weight Perception using Perceivable Tracking Offsets , 2018, CHI.

[259]  Robert W. Lindeman,et al.  Investigating a Physical Dial as a Measurement Tool for Cybersickness in Virtual Reality , 2019, VRST.

[260]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[261]  Maria del Carmen Juan Lizandra,et al.  Comparison of the Levels of Presence and Anxiety in an Acrophobic Environment Viewed via HMD or CAVE , 2009, PRESENCE: Teleoperators and Virtual Environments.

[262]  José Gutiérrez-Maldonado,et al.  Predictors of Smoking Craving During Virtual Reality Exposure , 2012, PRESENCE: Teleoperators and Virtual Environments.

[263]  Mariano Alcañiz Raya,et al.  Brain activity and presence: a preliminary study in different immersive conditions using transcranial Doppler monitoring , 2010, Virtual Reality.

[264]  Susan Persky,et al.  Immersive Virtual Video Game Play and Presence: Influences on Aggressive Feelings and Behavior , 2008, PRESENCE: Teleoperators and Virtual Environments.

[265]  Rolf Nordahl,et al.  Distraction as a measure of presence: using visual and tactile adjustable distraction as a measure to determine immersive presence of content in mediated environments , 2010, Virtual Reality.

[266]  Holger Regenbrecht,et al.  Can we perceive changes in our moving speed: a comparison between directly and indirectly powering the locomotion in virtual environments , 2018, VRST.

[267]  Victoria Interrante,et al.  Correlations Between Physiological Response, Gait, Personality, and Presence in Immersive Virtual Environments , 2012, PRESENCE: Teleoperators and Virtual Environments.

[268]  Dong Hyun Jeong,et al.  User experimentation: an evaluation of velocity control techniques in immersive virtual environments , 2009, Virtual Reality.

[269]  Daniel Sjölie,et al.  Human brains and virtual realities: Computer-generated presence in theory and practice , 2013 .

[270]  Guillaume Moreau,et al.  A study on the use of an immersive virtual reality store to investigate consumer perceptions and purchase behavior toward non-standard fruits and vegetables , 2017, 2017 IEEE Virtual Reality (VR).

[271]  Gerd Bruder,et al.  Self-motion illusions in immersive virtual reality environments , 2011, 2011 IEEE Virtual Reality Conference.

[272]  Bliss M. Altenhoff,et al.  An evaluation of immersive viewing on spatial knowledge acquisition in spherical panoramic environments , 2014, Virtual Reality.

[273]  Luca Chittaro,et al.  Locomotion in Place in Virtual Reality: A Comparative Evaluation of Joystick, Teleport, and Leaning , 2021, IEEE Transactions on Visualization and Computer Graphics.

[274]  Jeffrey W. Bertrand,et al.  The role of dimensional symmetry on bimanual psychomotor skills education in immersive virtual environments , 2015, 2015 IEEE Virtual Reality (VR).

[275]  Arindam Dey,et al.  Burnar: Involuntary heat sensations in augmented reality , 2013, 2013 IEEE Virtual Reality (VR).

[276]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[277]  Taehyun Rhee,et al.  Real-Time Mixed Reality Rendering for Underwater 360° Videos , 2019, 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[278]  Mary C. Whitton,et al.  An evaluation of navigational ability comparing Redirected Free Exploration with Distractors to Walking-in-Place and joystick locomotio interfaces , 2011, 2011 IEEE Virtual Reality Conference.

[279]  Chris Houliez,et al.  Dwelling in Second Life? A phenomenological evaluation of online virtual worlds , 2012, Virtual Reality.

[280]  Shu-Hsuan Chang,et al.  Do virtual reality head-mounted displays make a difference? A comparison of presence and self-efficacy between head-mounted displays and desktop computer-facilitated virtual environments , 2018, Virtual Reality.

[281]  B K Wiederhold,et al.  The effects of immersiveness on physiology. , 1998, Studies in health technology and informatics.

[282]  Wijnand A. IJsselsteijn,et al.  Effects of Sensory Information and Prior Experience on Direct Subjective Ratings of Presence , 1999, Presence: Teleoperators & Virtual Environments.

[283]  Sabarish V. Babu,et al.  Effects of travel technique on cognition in virtual environments , 2004, IEEE Virtual Reality 2004.

[284]  Callum Parker,et al.  Is Any Room Really OK? The Effect of Room Size and Furniture on Presence, Narrative Engagement, and Usability During a Space-Adaptive Augmented Reality Game , 2019, 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[285]  Manolya Kavakli,et al.  Behavioral Presence Test in Threatening Virtual Environments , 2012, PRESENCE: Teleoperators and Virtual Environments.

[286]  Nicole C. Krämer,et al.  Do 3D Moviegoers Enjoy Screenings More than 2D Moviegoers?—On the Impact of 3D Fantasy Movie Perception on Enjoyment , 2014, PRESENCE: Teleoperators and Virtual Environments.

[287]  Carrie Heater,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[288]  Ellen Yi-Luen Do,et al.  Ambiotherm: Enhancing Sense of Presence in Virtual Reality by Simulating Real-World Environmental Conditions , 2017, CHI.

[289]  Gerd Bruder,et al.  CAVE Size Matters: Effects of Screen Distance and Parallax on Distance Estimation in Large Immersive Display Setups , 2016, PRESENCE: Teleoperators and Virtual Environments.

[290]  Maori Kobayashi,et al.  The Effects of Spatialized Sounds on the Sense of Presence in Auditory Virtual Environments: A Psychological and Physiological Study , 2015, PRESENCE: Teleoperators and Virtual Environments.

[291]  Jim Blascovich,et al.  Using a preamble to increase presence in digital virtual environments , 2017, Virtual Reality.

[292]  Maud Marchal,et al.  Evaluation of direct manipulation using finger tracking for complex tasks in an immersive cube , 2014, Virtual Reality.