A High-End Virtual Reality Setup for the Study of Mental Rotations

Mental rotation is the capacity to predict the orientation of an object or the layout of a scene after a change in viewpoint. Previous studies have shown that the cognitive cost of mental rotations is reduced when the viewpoint change results from the observer's motion rather than the object or spatial layout's rotation. The classical interpretation for these findings involves the use of automatic updating mechanisms triggered during self-motion. Nevertheless, little is known about how this process is triggered and particularly how sensory cues combine in order to facilitate mental rotations. The previously existing setups, either real or virtual, did not allow disentangling the different sensory contributions, which motivated the development of a new high-end virtual reality platform overcoming these technical limitations. In the present paper we will start by a didactic review of the literature on mental rotations and expose the current technical limitations. Then we will fully describe the experimental platform that was developed at the Max Planck Institute for Biological Cybernetics in Tbingen. The setup consisted of a cabin mounted on the top of a six degree-of-freedom Stewart platform inside of which was an adjustable seat, a physical table with a screen embedded, and a large projection screen. A 5-PC cluster running Virtools was used to drive the platform and render the two passive stereovision scenes that were displayed on the table and background screens. Finally, we will present the experiment using this setup that allowed replicating the classical advantage found for a moving observer, which validates our setup. We will conclude by discussing the experimental validation and the advantages of such a setup.

[1]  E. Spelke,et al.  Updating egocentric representations in human navigation , 2000, Cognition.

[2]  Simon Lessels,et al.  For Efficient Navigational Search, Humans Require Full Physical Movement, but Not a Rich Visual Scene , 2006, Psychological science.

[3]  Jeffrey M. Zacks,et al.  Imagined Viewer and Object Rotations Dissociated with Event-Related fMRI , 2003, Journal of Cognitive Neuroscience.

[4]  T. McNamara,et al.  Multiple views of spatial memory , 1997 .

[5]  Heinrich H. Bülthoff,et al.  The Perception of Spatial Layout in a Virtual World , 2000, Biologically Motivated Computer Vision.

[6]  Neil Burgess,et al.  Orientational manoeuvres in the dark: dissociating allocentric and egocentric influences on spatial memory , 2004, Cognition.

[7]  T. McNamara,et al.  Viewpoint Dependence in Scene Recognition , 1997 .

[8]  N. Stucchi,et al.  Viewer- and object-centered mental explorations of an imagined environment are not equivalent. , 1997, Brain research. Cognitive brain research.

[9]  D. Proffitt,et al.  Spatial updating of virtual displays during self- and display rotation. , 2004, Memory & cognition.

[10]  Heinrich H Bülthoff,et al.  Extrinsic cues aid shape recognition from novel viewpoints. , 2003, Journal of vision.

[11]  Ranxiao Frances Wang,et al.  Object recognition is mediated by extraretinal information , 2002, Perception & psychophysics.

[12]  Andrew T. Woods,et al.  Visual, haptic and crossmodal recognition of scenes , 2005, Experimental Brain Research.

[13]  Heinrich H. Bülthoff,et al.  A multisensory approach to spatial updating: the case of mental rotations , 2009, Experimental Brain Research.

[14]  Heinrich H. Bülthoff,et al.  Visual Homing Is Possible Without Landmarks: A Path Integration Study in Virtual Reality , 2002, Presence: Teleoperators & Virtual Environments.

[15]  T. McNamara,et al.  Mental representations of large and small spatial layouts are orientation dependent. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[16]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[17]  Sarah S. Chance,et al.  Spatial Updating of Self-Position and Orientation During Real, Imagined, and Virtual Locomotion , 1998 .

[18]  Ranxiao Frances Wang,et al.  Active and passive scene recognition across views , 1999, Cognition.

[19]  S. Kosslyn,et al.  Motor processes in mental rotation , 1998, Cognition.

[20]  A Berthoz,et al.  Updating an object’s orientation and location during nonvisual navigation: A comparison between two processing modes , 1997, Perception & psychophysics.

[21]  D R Proffitt,et al.  Updating displays after imagined object and viewer rotations. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[22]  Ranxiao Frances Wang,et al.  Perceiving Real-World Viewpoint Changes , 1998 .

[23]  Sarah H. Creem-Regehr,et al.  Spatial updating of virtual displays , 2004 .