Simulated Reference Frame: A Cost-Effective Solution to Improve Spatial Orientation in VR

Virtual Reality (VR) is increasingly used in spatial cognition research, as it offers high experimental control in naturalistic multimodal environments, which is hard to achieve in real-world settings. Although recent technological advances offer a high level of photorealism, locomotion in VR is still restricted because people might not perceive their self-motion as they would in the real world. This might be related to the inability to use embodied spatial orientation processes, which support automatic and obligatory updating of our spatial awareness. Previous research has identified the roles reference frames play in retaining spatial orientation. Here, we propose using visually overlaid rectangular boxes, simulating reference frames in VR, to provide users with a better insight into spatial direction in landmark-free virtual environments. The current mixed-method study investigated how different variations of the visually simulated reference frames might support people in a navigational search task. Performance results showed that the existence of a simulated reference frame yields significant effects on participants completion time and travel distance. Though a simulated CAVE translating with the navigator (one of the simulated reference frames) did not provide significant benefits, the simulated room (another simulated reference frame depicting a rest frame) significantly boosted user performance in the task as well as improved participants preference in the post-experiment evaluation. Results suggest that adding a visually simulated reference frame to VR applications might be a cost-effective solution to the spatial disorientation problem in VR.

[1]  Eugenia M. Kolasinski,et al.  Simulator Sickness in Virtual Environments. , 1995 .

[2]  Timothy P. McNamara,et al.  Do We Need to Walk for Effective Virtual Reality Navigation? Physical Rotations Alone May Suffice , 2010, Spatial Cognition.

[3]  Desney S. Tan,et al.  Physically large displays improve performance on spatial tasks , 2006, TCHI.

[4]  Bernhard E. Riecke,et al.  Moving in a box: Improving spatial orientation in virtual reality using simulated reference frames , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[5]  J Reason,et al.  Motion sickness: Some theoretical and practical considerations. , 1978, Applied ergonomics.

[6]  Bernhard E. Riecke,et al.  Upper Body Leaning can affect Forward Self-Motion Perception in Virtual Environments , 2015, SUI.

[7]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[8]  James Carifio,et al.  Resolving the 50‐year debate around using and misusing Likert scales , 2008, Medical education.

[9]  Behrang Keshavarz,et al.  Validating an Efficient Method to Quantify Motion Sickness , 2011, Hum. Factors.

[10]  Mark H. Draper,et al.  The adaptive effects of virtual interfaces: vestibulo-ocular reflex and simulator sickness , 1998 .

[11]  C C Presson,et al.  Updating after Rotational and Translational Body Movements: Coordinate Structure of Perspective Space , 1994, Perception.

[12]  Timothy P. McNamara,et al.  How Are the Locations of Objects in the Environment Represented in Memory? , 2003, Spatial Cognition.

[13]  Jonathan W. Kelly,et al.  Facilitated pointing to remembered objects in front: Evidence for egocentric retrieval or for spatial priming? , 2009, Psychonomic bulletin & review.

[14]  Anthony E. Richardson,et al.  Spatial knowledge acquisition from maps and from navigation in real and virtual environments , 1999, Memory & cognition.

[15]  Ben D. Lawson,et al.  Motion Sickness Symptomatology and Origins , 2014, Handbook of Virtual Environments, 2nd ed..

[16]  Robert W. Lindeman,et al.  On Your Feet!: Enhancing Vection in Leaning-Based Interfaces through Multisensory Stimuli , 2016, SUI.

[17]  Timothy P. McNamara,et al.  Reference Frames Influence Spatial Memory Development within and Across Sensory Modalities , 2010, Spatial Cognition.

[18]  Bing Wu,et al.  The embodied actor in multiple frames of reference , 2012 .

[19]  J. Rieser Access to knowledge of spatial structure at novel points of observation. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[20]  G. Norman Likert scales, levels of measurement and the “laws” of statistics , 2010, Advances in health sciences education : theory and practice.

[21]  Bernhard E. Riecke,et al.  Can physical motions prevent disorientation in naturalistic VR? , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[22]  R. Klatzky,et al.  PSYCHOLOGICAL SCIENCE Research Article Use of Cognitive Versus Perceptual Heading During Imagined Locomotion Depends on the Response Mode , 2022 .

[23]  T. McNamara,et al.  Where you are affects what you can easily imagine: Environmental geometry elicits sensorimotor interference in remote perspective taking , 2017, Cognition.

[24]  Simon Lessels,et al.  For Efficient Navigational Search, Humans Require Full Physical Movement, but Not a Rich Visual Scene , 2006, Psychological science.

[25]  Thomas A. Furness,et al.  The role of rest frames in vection, presence and motion sickness , 1998 .

[26]  Kristopher J. Blom,et al.  A New Gaming Device and Interaction Method for a First-Person-Shooter , 2005 .

[27]  Jason Jerald,et al.  The VR Book: Human-Centered Design for Virtual Reality , 2015 .

[28]  Kristopher J. Blom,et al.  Intuitive, Hands-free Travel Interfaces for Virtual Environments , 2005 .

[29]  R. Wang Between reality and imagination: When is spatial updating automatic? , 2004, Perception & psychophysics.

[30]  Heinrich H. Bülthoff,et al.  Perceiving simulated ego-motions in virtual reality: comparing large screen displays with HMDs , 2005, IS&T/SPIE Electronic Imaging.

[31]  Carman Neustaedter,et al.  NaviChair: Evaluating an Embodied Interface Using a Pointing Task to Navigate Virtual Reality , 2015, SUI.

[32]  John H. Bailey,et al.  Virtual spaces and real world places: transfer of route knowledge , 1996, Int. J. Hum. Comput. Stud..

[33]  Jack M. Loomis,et al.  Locomotion Mode Affects the Updating of Objects Encountered During Travel: The Contribution of Vestibular and Proprioceptive Inputs to Path Integration , 1998, Presence.

[34]  Roy A. Ruddle,et al.  Movement Around Real and Virtual Cluttered Environments , 2005, Presence: Teleoperators & Virtual Environments.

[35]  Sarah S. Chance,et al.  Spatial Updating of Self-Position and Orientation During Real, Imagined, and Virtual Locomotion , 1998 .

[36]  Changhoon Park,et al.  Effects of rest frames on cybersickness and oscillatory brain activity , 2013, 2013 International Winter Workshop on Brain-Computer Interface (BCI).

[37]  Julie M. Drexler,et al.  Research in visually induced motion sickness. , 2010, Applied ergonomics.

[38]  Kay M. Stanney,et al.  Virtual Environment Usage Protocols , 2014, Handbook of Virtual Environments, 2nd ed..