Orientation-dependent spatial memories for scenes viewed on mobile devices

We examined whether spatial representations for scenes experienced on the screens of mobile devices are orientation dependent and whether the type of movement (physical vs. simulated) during learning affects the encoding and the retrieval of spatial information. Participants studied a spatial layout depicted on a tablet and then carried out perspective-taking trials in which they localized objects from imagined perspectives. Depending on condition, participants either rotated the tablet along with their body or remained stationary and swiped with their finger on the screen to change their viewpoint within the scene. Results showed that participants were faster and more accurate to point to objects from an imagined perspective that was aligned than misaligned to their initial physical orientation during learning, suggesting that they had formed an orientation-dependent representation. Although no differences were found between movement conditions during pointing, participants were faster to encode spatial information with physical than simulated movement.

[1]  Weimin Mou,et al.  Frames of reference in mobile augmented reality displays. , 2004, Journal of experimental psychology. Applied.

[2]  T. McNamara,et al.  Multiple views of spatial memory , 1997 .

[3]  Jonathan W. Kelly,et al.  Multiple systems of spatial memory and action , 2008, Cognitive Processing.

[4]  Jonathan W. Kelly,et al.  Imagined Perspective-Changing Within and Across Novel Environments , 2004, Spatial Cognition.

[5]  J. Rieser,et al.  Sensitivity to Perspective Structure While Walking without Vision , 1986, Perception.

[6]  M. Avraamides,et al.  The protagonist's first perspective influences the encoding of spatial information in narratives , 2016, Quarterly journal of experimental psychology.

[7]  Jonathan W. Kelly,et al.  Sensorimotor alignment effects in the learning environment and in novel environments. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Roberta L Klatzky,et al.  Spatial updating of locations specified by 3-d sound and spatial language. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[9]  J. Rieser Access to knowledge of spatial structure at novel points of observation. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[10]  Weimin Mou,et al.  Allocentric and egocentric updating of spatial memories. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[11]  C C Presson,et al.  Updating after Rotational and Translational Body Movements: Coordinate Structure of Perspective Space , 1994, Perception.

[12]  Timothy P. McNamara,et al.  How Are the Locations of Objects in the Environment Represented in Memory? , 2003, Spatial Cognition.