Journal of Experimental Psychology : Learning , Memory , and Cognition Functional Equivalence of Spatial Images From Touch and Vision : Evidence From Spatial Updating in Blind and Sighted Individuals

This research examined whether visual and haptic map learning yield functionally equivalent spatial images in working memory, as evidenced by similar encoding bias and updating performance. In 3 experiments, participants learned 4-point routes either by seeing or feeling the maps. At test, blindfolded participants made spatial judgments about the maps from imagined perspectives that were either aligned or misaligned with the maps as represented in working memory. Results from Experiments 1 and 2 revealed a highly similar pattern of latencies and errors between visual and haptic conditions. These findings extend the well-known alignment biases for visual map learning to haptic map learning, provide further evidence of haptic updating, and most important, show that learning from the 2 modalities yields very similar performance across all conditions. Experiment 3 found the same encoding biases and updating performance with blind individuals, demonstrating that functional equivalence cannot be due to visual recoding and is consistent with an amodal hypothesis of spatial images.

[1]  Timothy P. McNamara,et al.  Systems of Spatial Reference in Human Memory , 2001, Cognitive Psychology.

[2]  Á. Pascual-Leone,et al.  The metamodal organization of the brain. , 2001, Progress in brain research.

[3]  F. Mast,et al.  Spatial processing in navigation, imagery and perception , 2007 .

[4]  Roberta L Klatzky,et al.  Spatial updating of locations specified by 3-d sound and spatial language. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[5]  P.O. Barber,et al.  Encoding Direction in Manipulatory Space and the Role of Visual Experience , 1988 .

[6]  Hubert D. Zimmer,et al.  Common coding of auditory and visual spatial information in working memory , 2008, Brain Research.

[7]  T. McNamara,et al.  Mental representations of large and small spatial layouts are orientation dependent. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Nicholas A. Giudice,et al.  Evidence for Amodal Representations after Bimodal Learning: Integration of Haptic-Visual Layouts into a Common Spatial Image , 2009, Spatial Cogn. Comput..

[9]  Sarah H. Creem-Regehr,et al.  Spatial updating of virtual displays , 2004 .

[10]  G. S. Marmor,et al.  Mental rotation by the blind: does mental rotation depend on visual imagery? , 1976, Journal of experimental psychology. Human perception and performance.

[11]  Ranxiao Frances Wang,et al.  Object recognition is mediated by extraretinal information , 2002, Perception & psychophysics.

[12]  Roberta L. Klatzky,et al.  Functional Equivalence of Spatial Images Produced by Perception and Spatial Language , 2007 .

[13]  Ranxiao Frances Wang,et al.  Perceiving Real-World Viewpoint Changes , 1998 .

[14]  Mark Holllns,et al.  Spatial updating in blind and sighted people , 1988, Perception & psychophysics.

[15]  Marios N. Avraamides,et al.  Does Body Orientation Matter When Reasoning about Depicted or Described Scenes? , 2008, Spatial Cognition.

[16]  T. McNamara,et al.  Egocentric and geocentric frames of reference in memory of large-scale space , 2003, Psychonomic bulletin & review.

[17]  T. McNamara,et al.  Orientation and perspective dependence in route and survey learning. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[18]  D H Warren,et al.  The Importance of Alignment in Blind Subjects' Use of Tactual Maps , 1989, Perception.

[19]  Fiona N. Newell,et al.  The role of visual experience on the representation and updating of novel haptic scenes , 2007, Brain and Cognition.

[20]  M. Jeanne Sholl,et al.  The role of self-to-object updating in orientation-free performance on spatial-memory tasks. , 2002 .

[21]  Clark C. Presson,et al.  Orientation Specificity in Representations of Place , 1997 .

[22]  J. Rieser,et al.  Sensitivity to Perspective Structure While Walking without Vision , 1986, Perception.

[23]  R W Byrne,et al.  Distances and directions in the cognitive maps of the blind. , 1983, Canadian journal of psychology.

[24]  T. McNamara,et al.  Viewpoint Dependence in Scene Recognition , 1997 .

[25]  Roberta L Klatzky,et al.  Functional equivalence of spatial representations derived from vision and language: evidence from allocentric judgments. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[26]  C. I. Howarth,et al.  The Mental Maps of the Blind: The Role of Previous Visual Experience , 1982 .

[27]  R. Klatzky,et al.  Nonvisual navigation by blind and sighted: assessment of path integration ability. , 1993, Journal of experimental psychology. General.

[28]  Naohide Yamamoto,et al.  Orientation dependence of spatial memory acquired from auditory experience , 2009, Psychonomic bulletin & review.

[29]  David Waller,et al.  Isolating observer-based reference directions in human spatial memory: Head, body, and the self-to-array axis , 2008, Cognition.

[30]  R. Golledge Tactual Strip Maps as Navigational Aids , 1991 .

[31]  Nora S. Newcombe,et al.  Spatial representation and behavior across the life span , 1981 .

[32]  Ranxiao Frances Wang,et al.  Active and passive scene recognition across views , 1999, Cognition.

[33]  J. Rieser,et al.  Mental Processes Mediating Independent Travel: Implications for Orientation and Mobility , 1982 .

[34]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[35]  Andrew T. Woods,et al.  Visual, haptic and crossmodal recognition of scenes , 2005, Experimental Brain Research.

[36]  T. Martin,et al.  Journal of Visual Impairment and Blindness , 2008 .

[37]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[38]  Irwin N. Jankovic,et al.  Principles of spatial problem solving. , 1982 .

[39]  P. Carpenter,et al.  Mental rotation and the frame of reference in blind and sighted individuals , 1978, Perception & psychophysics.

[40]  Christian Casanova,et al.  Vision : from neurons to cognition , 2001 .

[41]  David Waller,et al.  Transient and enduring spatial representations under disorientation and self-rotation. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[42]  S. Ungar,et al.  Mental Rotation of a Tactile Layout by Young Visually Impaired Children , 1995, Perception.

[43]  S. Becker,et al.  Remembering the past and imagining the future: a neural model of spatial memory and imagery. , 2007, Psychological review.

[44]  Naohide Yamamoto,et al.  Visual and proprioceptive representations in spatial memory , 2005, Memory & cognition.

[45]  Jonathan W. Kelly,et al.  Sensorimotor alignment effects in the learning environment and in novel environments. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[46]  Mary Hegarty,et al.  Orientation specificity and spatial updating of memories for layouts. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[47]  David J. Bryant,et al.  Representing Space in Language and Perception , 1997 .

[48]  H. Bülthoff,et al.  Viewpoint Dependence in Visual and Haptic Object Recognition , 2001, Psychological science.

[49]  E. Spelke,et al.  Updating egocentric representations in human navigation , 2000, Cognition.

[50]  Fiona N. Newell,et al.  Visual and haptic representations of scenes are updated with observer movement , 2005, Experimental Brain Research.

[51]  Weimin Mou,et al.  Allocentric and egocentric updating of spatial memories. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[52]  Anthony E. Richardson,et al.  A Comparison of Methods for Estimating Directions in Egocentric Space , 1999, Perception.

[53]  Matt J. Rossano,et al.  Spatial representations acquired from computer models : Cognitive load, orientation specificity and the acquisition of survey knowledge , 1998 .

[54]  Clark C. Presson,et al.  Building spatial representations through primary and secondary learning. , 1984, Journal of experimental psychology. Learning, memory, and cognition.

[55]  Roberta L. Klatzky,et al.  Encoding, learning, and spatial updating of multiple object locations specified by 3-D sound, spatial language, and vision , 2003, Experimental Brain Research.

[56]  Clark C. Presson,et al.  Orientation specificity in spatial memory: what makes a path different from a map of the path? , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[57]  G W Evans,et al.  Cognitive mapping: knowledge of real-world distance and location information. , 1980, Journal of experimental psychology. Human learning and memory.

[58]  M. A. Espinosa,et al.  Comparing Methods for Introducing Blind and Visually Impaired People to Unfamiliar Urban Environments , 1998 .

[59]  M. Sholl,et al.  The role of self-to-object updating in orientation-free performance on spatial-memory tasks. , 2002, Journal of experimental psychology. Learning, memory, and cognition.