The role of visual experience on the representation and updating of novel haptic scenes

We investigated the role of visual experience on the spatial representation and updating of haptic scenes by comparing recognition performance across sighted, congenitally and late blind participants. We first established that spatial updating occurs in sighted individuals to haptic scenes of novel objects. All participants were required to recognise a previously learned haptic scene of novel objects presented across the same or different orientation as learning whilst they either remained in the same position to moved to a new position relative to the scene. Scene rotation incurred a cost in recognition performance in all groups. However, overall haptic scene recognition performance was worse in the congenitally blind group. Moreover, unlike the late blind or sighted groups, the congenitally blind group were unable to compensate for the cost in scene rotation with observer motion. Our results suggest that vision plays an important role in representing and updating spatial information encoded through touch and have important implications for the role of vision in the development of neuronal areas involved in spatial cognition.

[1]  J. Rieser,et al.  How Persons with Visual Impairments Explore Novel Spaces: Strategies of Good and Poor Performers , 1993 .

[2]  Romedi Passini,et al.  Wayfinding without Vision , 1988 .

[3]  Manabu Honda,et al.  Critical Period for Cross-Modal Plasticity in Blind Humans: A Functional MRI Study , 2002, NeuroImage.

[4]  Susanna Millar,et al.  External and body-centered frames of reference in spatial memory: Evidence from touch , 2004, Perception & psychophysics.

[5]  Morton A. Heller,et al.  Touch, representation, and blindness , 2000 .

[6]  Andrew T. Woods,et al.  Visual, haptic and crossmodal recognition of scenes , 2005, Experimental Brain Research.

[7]  T. McNamara,et al.  Viewpoint Dependence in Scene Recognition , 1997 .

[8]  R A Andersen,et al.  Multimodal integration for the representation of space in the posterior parietal cortex. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[9]  Albert Postma,et al.  Delay improves performance on a haptic spatial matching task , 2003, Experimental Brain Research.

[10]  C. Genovese,et al.  Spatial Updating in Human Parietal Cortex , 2003, Neuron.

[11]  J. Juurmaa,et al.  Effect of visual experience on locational judgements after perspective change in small-scale space. , 1994, Scandinavian journal of psychology.

[12]  M. Blades,et al.  Understanding spatial concepts at the geographic scale without the use of vision , 1997 .

[13]  Fiona N. Newell,et al.  Visual and haptic representations of scenes are updated with observer movement , 2005, Experimental Brain Research.

[14]  Jessica Porter,et al.  Brain Mechanisms for Extracting Spatial Information from Smell , 2005, Neuron.

[15]  Brigitte Röder,et al.  Hearing Cheats Touch, but Less in Congenitally Blind Than in Sighted Individuals , 2004, Psychological science.

[16]  M. Heller.  Picture and Pattern Perception in the Sighted and the Blind: The Advantage of the Late Blind , 1989, Perception.

[17]  Torø Graven,et al.  Aspects of object recognition: When touch replaces vision as the dominant sense modality , 2003 .

[18]  Alain Berthoz,et al.  A fronto-parietal system for computing the egocentric spatial frame of reference in humans , 1999, Experimental Brain Research.

[19]  C. Spence,et al.  Confusing the mind by crossing the hands. , 2002, Brain research. Cognitive brain research.

[20]  R N Haber,et al.  Properties of spatial representations: Data from sighted and blind subjects , 1993, Perception & psychophysics.

[21]  P. Haggard,et al.  Noninformative vision improves the spatial resolution of touch in humans , 2001, Current Biology.

[22]  E. Save,et al.  Spatial Firing of Hippocampal Place Cells in Blind Rats , 1998, The Journal of Neuroscience.

[23]  Susan J. Lederman,et al.  Multisensory Activation of the Intraparietal Area When Classifying Grating Orientation: A Functional Magnetic Resonance Imaging Study , 2006, The Journal of Neuroscience.

[24]  Y. Rossetti,et al.  Early visual experience affects memorization and spatial representation of proprioceptive targets , 1996, Neuroreport.

[25]  R. Klatzky,et al.  Learning directions of objects specified by vision, spatial audition, or auditory spatial language. , 2002, Learning & memory.

[26]  J. Rieser,et al.  Sensitivity to Perspective Structure While Walking without Vision , 1986, Perception.

[27]  R W Byrne,et al.  Distances and directions in the cognitive maps of the blind. , 1983, Canadian journal of psychology.

[28]  Neil Burgess,et al.  Orientational manoeuvres in the dark: dissociating allocentric and egocentric influences on spatial memory , 2004, Cognition.

[29]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[30]  B. Milner,et al.  What went where? Impaired object‐location learning in patients with right hippocampal lesions , 2005, Hippocampus.

[31]  C. Spence,et al.  Early Vision Impairs Tactile Perception in the Blind , 2004, Current Biology.

[32]  L. Hyvärinen,et al.  Modification of parietal association cortex and functional blindness after binocular deprivation in young monkeys , 2004, Experimental Brain Research.

[33]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[34]  P. Bach-y-Rita.  Brain mechanisms in sensory substitution , 1972 .

[35]  Sarah H. Creem-Regehr,et al.  Spatial updating of virtual displays , 2004 .

[36]  R. J. Bootsma,et al.  Studies in Perception and Action III , 1995 .

[37]  Bruno Poucet,et al.  Properties of place cell firing after damage to the visual cortex , 2002, The European journal of neuroscience.

[38]  C. Thinus-Blanc,et al.  Representation of space in blind persons: vision as a spatial sense? , 1997, Psychological bulletin.

[39]  Florence Gaunet,et al.  Early-Blind Subjects' Spatial Representation of Manipulatory Space: Exploratory Strategies and Reaction to Change , 1997, Perception.

[40]  E. Save,et al.  Place cells, neocortex and spatial navigation: a short review , 2003, Journal of Physiology-Paris.

[41]  J. Nesbit,et al.  The effect of early visual experience on spatial maze learning in rats. , 1981, Developmental psychobiology.

[42]  M. Heller,et al.  Superior Haptic Perceptual Selectivity in Late-Blind and Very-Low-Vision Subjects , 2003, Perception.

[43]  Roberta L. Klatzky,et al.  Encoding, learning, and spatial updating of multiple object locations specified by 3-D sound, spatial language, and vision , 2003, Experimental Brain Research.

[44]  Ranxiao Frances Wang,et al.  Active and passive scene recognition across views , 1999, Cognition.

[45]  Neil Burgess,et al.  Navigation expertise and the human hippocampus: A structural brain imaging analysis , 2003, Hippocampus.

[46]  Albert Postma,et al.  Multisensory integration mechanisms in haptic space perception , 2004, Experimental Brain Research.

[47]  Barry E Stein,et al.  Visual Experience Is Necessary for the Development of Multisensory Integration , 2004, The Journal of Neuroscience.

[48]  Xiaoping Hu,et al.  Tactile discrimination of grating orientation: fMRI activation patterns , 2005, Human brain mapping.

[49]  A. Postma,et al.  New insights in categorical and coordinate processing of spatial relations , 2006, Neuropsychologia.

[50]  John J. Rieser,et al.  Visual experience, visual field size, and the development of nonvisual sensitivity to the spatial structure of outdoor neighborhoods explored by walking. , 1992, Journal of experimental psychology. General.

[51]  Yves Rossetti,et al.  Effects of Visual Deprivation on Space Representation: Immediate and Delayed Pointing toward Memorised Proprioceptive Targets , 2006, Perception.

[52]  Ranxiao Frances Wang,et al.  Perceiving Real-World Viewpoint Changes , 1998 .

[53]  Mark Holllns,et al.  Spatial updating in blind and sighted people , 1988, Perception & psychophysics.

[54]  John A. King,et al.  Human hippocampus and viewpoint dependence in spatial memory , 2002, Hippocampus.

[55]  R. Klatzky,et al.  Nonvisual navigation by blind and sighted: assessment of path integration ability. , 1993, Journal of experimental psychology. General.

[56]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[57]  B. Milner,et al.  Right hippocampal impairment in the recall of spatial location: Encoding deficit or rapid forgetting? , 1989, Neuropsychologia.