Visual and haptic representations of scenes are updated with observer movement

Scene recognition has been found to be sensitive to the orientation of the scene with respect to the stationary observer. Recent studies have shown, however, that observer movement can compensate for changes in visual scene orientation, through a process of spatial updating. Here we investigated whether spatial updating in scene recognition is affected by the encoding or learning modality by examining whether observer movement can also compensate for orientation changes in haptic scene recognition. In experiment 1, we replicated previously reported effects of observer movement on visual scene recognition. In experiment 2, we used the same apparatus as in experiment 1 but here participants were required to learn and recognize the scenes using touch alone. We found a cost in recognition performance with changes in scene orientation relative to the stationary observer. However, when participants could move around the scene to recognize the new orientation, then this cost in recognition performance disappeared. Thus, we found that spatial updating applies to recognition in both the visual and haptic modalities, both of which intrinsically encode the spatial properties of a scene.

[1]  H. Bülthoff,et al.  View dependence in scene recognition after active learning , 1999, Memory & cognition.

[2]  Michael F. Young,et al.  Imagery, action, and young children's spatial orientation: it's not being there that counts, it's what one has in mind. , 1994, Child development.

[3]  Heinrich H Bülthoff,et al.  Extrinsic cues aid shape recognition from novel viewpoints. , 2003, Journal of vision.

[4]  Ranxiao Frances Wang,et al.  Active and passive scene recognition across views , 1999, Cognition.

[5]  E. Spelke,et al.  Updating egocentric representations in human navigation , 2000, Cognition.

[6]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[7]  Astrid M L Kappers,et al.  Haptic Perception of Spatial Relations , 1999, Perception.

[8]  Alexander Pollatsek,et al.  Viewpoint-dependent recognition of scenes , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[9]  R. Wang Between reality and imagination: When is spatial updating automatic? , 2004, Perception & psychophysics.

[10]  Marios N. Avraamides,et al.  Spatial updating of environments described in texts , 2003, Cognitive Psychology.

[11]  R. Klatzky,et al.  Learning directions of objects specified by vision, spatial audition, or auditory spatial language. , 2002, Learning & memory.

[12]  J M Findlay,et al.  The Effect of Depth Rotation on Object Identification , 1997, Perception.

[13]  Roberta L. Klatzky,et al.  Encoding, learning, and spatial updating of multiple object locations specified by 3-D sound, spatial language, and vision , 2003, Experimental Brain Research.

[14]  Susanna Millar,et al.  The Müller-Lyer illusion in touch and vision: Implications for multisensory processes , 2002, Perception & psychophysics.

[15]  J. Rieser Access to knowledge of spatial structure at novel points of observation. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[16]  P. Worchel,et al.  Space Perception and Orientation by the Blind , 1951 .

[17]  R. D. Easton,et al.  Object-array structure, frames of reference, and retrieval of spatial knowledge. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[18]  D. H. Warren,et al.  Misaligned Maps Lead to Predictable Errors , 1989, Perception.

[19]  R L Klatzky,et al.  Spatial and movement-based heuristics for encoding pattern information through touch. , 1985, Journal of experimental psychology. General.

[20]  R L Klatzky,et al.  Path completion after haptic exploration without vision: Implications for haptic spatial representations , 1999, Perception & psychophysics.

[21]  Susanna Millar,et al.  External and body-centered frames of reference in spatial memory: Evidence from touch , 2004, Perception & psychophysics.

[22]  I Israël,et al.  Vestibular information contributes to update retinotopic maps. , 1999, Neuroreport.

[23]  Ranxiao Frances Wang,et al.  Representing a stable environment by egocentric updating and invariant representations , 1999, Spatial Cogn. Comput..

[24]  Ranxiao Frances Wang,et al.  Object recognition is mediated by extraretinal information , 2002, Perception & psychophysics.

[25]  T. McNamara,et al.  Viewpoint Dependence in Scene Recognition , 1997 .

[26]  Heinrich H Bülthoff,et al.  Image-based object recognition in man, monkey and machine , 1998, Cognition.

[27]  Ranxiao Frances Wang,et al.  Perceiving Real-World Viewpoint Changes , 1998 .

[28]  Mark Holllns,et al.  Spatial updating in blind and sighted people , 1988, Perception & psychophysics.

[29]  R. Klatzky,et al.  Nonvisual navigation by blind and sighted: assessment of path integration ability. , 1993, Journal of experimental psychology. General.

[30]  Fiona N. Newell,et al.  Visual, haptic and cross-modal recognition of objects and scenes , 2004, Journal of Physiology-Paris.