Spatial updating in virtual reality: the sufficiency of visual information

Robust and effortless spatial orientation critically relies on “automatic and obligatory spatial updating”, a largely automatized and reflex-like process that transforms our mental egocentric representation of the immediate surroundings during ego-motions. A rapid pointing paradigm was used to assess automatic/obligatory spatial updating after visually displayed upright rotations with or without concomitant physical rotations using a motion platform. Visual stimuli displaying a natural, subject-known scene proved sufficient for enabling automatic and obligatory spatial updating, irrespective of concurrent physical motions. This challenges the prevailing notion that visual cues alone are insufficient for enabling such spatial updating of rotations, and that vestibular/proprioceptive cues are both required and sufficient. Displaying optic flow devoid of landmarks during the motion and pointing phase was insufficient for enabling automatic spatial updating, but could not be entirely ignored either. Interestingly, additional physical motion cues hardly improved performance, and were insufficient for affording automatic spatial updating. The results are discussed in the context of the mental transformation hypothesis and the sensorimotor interference hypothesis, which associates difficulties in imagined perspective switches to interference between the sensorimotor and cognitive (to-be-imagined) perspective.

[1]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[2]  R. Shepard,et al.  The time required to prepare for a rotated stimulus , 1973, Memory & cognition.

[3]  J. Dichgans,et al.  Visual-Vestibular Interaction: Effects on Self-Motion Perception and Postural Control , 1978 .

[4]  Albert C. Stevens,et al.  Distortions in judged spatial relations , 1978, Cognitive Psychology.

[5]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[6]  E. Batschelet.  Circular statistics in biology , 1981 .

[7]  B J Frost,et al.  The effect of visual-vestibular conflict on the latency of steady-state visually induced subjective rotation , 1981, Perception & psychophysics.

[8]  D. L. Hintzman,et al.  Orientation in cognitive maps , 1981, Cognitive Psychology.

[9]  J. Jonides,et al.  Evidence of hierarchies in cognitive maps , 1985, Memory & cognition.

[10]  T. McNamara.  Mental representations of spatial relations , 1986, Cognitive Psychology.

[11]  J. Rieser.  Access to knowledge of spatial structure at novel points of observation. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[12]  Bruce Bridgeman,et al.  Perception & control of self-motion , 1991 .

[13]  L. Boer.  Mental rotation in perspective problems. , 1991, Acta psychologica.

[14]  C C Presson,et al.  Updating after Rotational and Translational Body Movements: Coordinate Structure of Perspective Space , 1994, Perception.

[15]  R. D. Easton,et al.  Object-array structure, frames of reference, and retrieval of spatial knowledge. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[16]  J. Philbeck,et al.  Visual Perception of Location and Distance , 1996 .

[17]  T. McNamara,et al.  Viewpoint Dependence in Scene Recognition , 1997 .

[18]  Clark C. Presson,et al.  Orientation Specificity in Representations of Place , 1997 .

[19]  J. Loomis,et al.  Visually Controlled Locomotion: Its Dependence on Optic Flow, Three-Dimensional Space Perception, and Cognition , 1998 .

[20]  T. McNamara,et al.  Mental representations of large and small spatial layouts are orientation dependent. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[21]  Sarah S. Chance,et al.  Spatial Updating of Self-Position and Orientation During Real, Imagined, and Virtual Locomotion , 1998 .

[22]  L. Yardley,et al.  Spatial updating during rotation: the role of vestibular information and mental activity. , 1998, Journal of vestibular research : equilibrium & orientation.

[23]  J. Thomson,et al.  Automatic Spatial Updating during Locomotion without Vision , 1998, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[24]  Jack M. Loomis,et al.  Locomotion Mode Affects the Updating of Objects Encountered During Travel: The Contribution of Vestibular and Proprioceptive Inputs to Path Integration , 1998, Presence.

[25]  Marion A. Eppler,et al.  Development of Visually Guided Locomotion , 1998 .

[26]  Martin J. Farrell,et al.  Mental Rotation and the Automatic Updating of Body-Centered Spatial Relationships , 1998 .

[27]  A Berthoz,et al.  The vestibulo-ocular reflex and angular displacement perception in darkness in humans: adaptation to a virtual environment , 1998, Neuroscience Letters.

[28]  Ranxiao Frances Wang,et al.  Perceiving Real-World Viewpoint Changes , 1998 .

[29]  Ranxiao Frances Wang,et al.  Active and passive scene recognition across views , 1999, Cognition.

[30]  Heinrich H. Bülthoff,et al.  Viewpoint information provided by a familiar environment facilitates object identification , 1999 .

[31]  Ranxiao Frances Wang,et al.  Representing a stable environment by egocentric updating and invariant representations , 1999, Spatial Cogn. Comput..

[32]  F. Bremmer,et al.  The use of optical velocities for distance discrimination and reproduction during visually simulated self motion , 1999, Experimental Brain Research.

[33]  Heinrich H. Bülthoff,et al.  The Perception of Spatial Layout in a Virtual World , 2000, Biologically Motivated Computer Vision.

[34]  R L Klatzky,et al.  Path integration while ignoring irrelevant movement. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[35]  Martin J. Farrell,et al.  The automatic updating of egocentric spatial relationships and its impairment due to right posterior cortical lesions , 2000, Neuropsychologia.

[36]  D R Proffitt,et al.  Updating displays after imagined object and viewer rotations. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[37]  E. Spelke,et al.  Updating egocentric representations in human navigation , 2000, Cognition.

[38]  Mark May.  Kognition im Umraum , 2000 .

[39]  M. de Vega,et al.  Updating spatial layouts mediated by pointing and labelling under physical and imaginary rotation , 2001 .

[40]  William H. Warren,et al.  Optic flow is used to control human walking , 2001, Nature Neuroscience.

[41]  Ranxiao Frances Wang,et al.  Object recognition is mediated by extraretinal information , 2002, Perception & psychophysics.

[42]  M. Sholl,et al.  The role of self-to-object updating in orientation-free performance on spatial-memory tasks. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[43]  Bernhard E. Riecke,et al.  Qualitative Modeling of Spatial Orientation Processes using Logical Propositions: Interconnecting Spatial Presence, Spatial Updating, Piloting, and Spatial Cognition , 2002 .

[44]  E. Spelke,et al.  Human Spatial Representation: Insights from Animals , 2002 .

[45]  Mary Hegarty,et al.  Orientation specificity and spatial updating of memories for layouts. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[46]  Heinrich H. Bülthoff,et al.  Visual Homing Is Possible Without Landmarks: A Path Integration Study in Virtual Reality , 2002, Presence: Teleoperators & Virtual Environments.

[47]  Ranxiao Frances Wang,et al.  Changing perspective within and across environments , 2003, Cognition.

[48]  Heinrich H Bülthoff,et al.  Extrinsic cues aid shape recognition from novel viewpoints. , 2003, Journal of vision.

[49]  Ranxiao Frances Wang,et al.  Human navigation in nested environments. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[50]  Maryjane Wraga,et al.  Thinking outside the body: an advantage for spatial updating during imagined versus physical self-rotation. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[51]  Weimin Mou,et al.  Allocentric and egocentric updating of spatial memories. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[52]  Sarah H. Creem-Regehr,et al.  Spatial updating of virtual displays , 2004 .

[53]  Heinrich H. Bülthoff,et al.  Spatial updating in real and virtual environments: contribution and interaction of visual and vestibular cues , 2004, APGV '04.

[54]  Sarah H. Creem-Regehr,et al.  Spatial updating of virtual displays during self-and display rotation , 2010 .

[55]  M. May,et al.  Imaginal perspective switches in remembered environments: Transformation versus interference accounts , 2004, Cognitive Psychology.

[56]  Heinrich H. Bülthoff,et al.  Visual cues can be sufficient for triggering automatic, reflexlike spatial updating , 2005, TAP.

[57]  Bernhard E. Riecke,et al.  Top-down and multi-modal influences on self-motion perception in virtual reality , 2005 .

[58]  Heinrich H. Bülthoff,et al.  Towards lean and elegant self-motion simulation in virtual reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[59]  Ranxiao Frances Wang,et al.  Beyond imagination: Perspective change problems revisited , 2005 .

[60]  M. Sholl,et al.  Allocentric coding of object-to-object relations in overlearned and novel environments. , 2005, Journal of Experimental Psychology. Learning, Memory and Cognition.

[61]  M. Avraamides,et al.  Locating Targets from Imagined Perspectives: Labeling vs. Pointing , 2005 .

[62]  Heinrich H. Bülthoff,et al.  Perceiving simulated ego-motions in virtual reality: comparing large screen displays with HMDs , 2005, IS&T/SPIE Electronic Imaging.

[63]  F Caniard,et al.  Visually induced linear vection is enhanced by small physical accelerations , 2006 .

[64]  Bernhard E. Riecke,et al.  Using the perceptually oriented approach to optimize spatial presence ego-motion simulation , 2006 .