PSYCHOLOGICAL SCIENCE Research Article Neural Synergy Between Kinetic Vision and Touch

Ambiguous visual information often produces unstable visual perception. In four psychophysical experiments, we found that unambiguous tactile information about the direction of rotation of a globe whose three-dimensional structure is ambiguous significantly influences visual perception of the globe. This disambiguation of vision by touch occurs only when the two modalities are stimulated concurrently, however. Using functional magnetic resonance imaging, we discovered that touching the rotating globe, even when not looking at it, reliably activates the middle temporal visual area (MT+), a brain region commonly thought to be crucially involved in registering structure from motion. Considered together, our results show that the brain draws on somatosensory information to resolve visual conflict.

[1]  W. Miles Movement Interpretations of the Silhouette of a Revolving Fan , 1931 .

[2]  Fisichelli Vr Reversible perspective in Lissajous figures; some theoretical considerations. , 1947 .

[3]  V R FISICHELLI Reversible perspective in Lissajous figures; some theoretical considerations. , 1947, The American journal of psychology.

[4]  Ian P. Howard,et al.  An Investigation of a Satiation Process in the Reversible Perspective of Revolving Skeletal Shapes , 1961 .

[5]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[6]  M. Heller Visual and tactual texture perception: Intersensory cooperation , 1982, Perception & psychophysics.

[7]  Robert Malsch,et al.  A Three-Dimensional Motion Aftereffect Produced by Prolonged Adaptation to a Rotation Simulation , 1984, Perception.

[8]  J S Lappin,et al.  Detection of three-dimensional structure in moving optical patterns. , 1984, Journal of experimental psychology. Human perception and performance.

[9]  The Recency Effect in the Perception of Ambiguous Figures , 1985, Perception.

[10]  G. Sperling,et al.  Tradeoffs between stereopsis and proximity luminance covariance as determinants of perceived 3D structure , 1986, Vision Research.

[11]  M Nawrot,et al.  Neural integration of information specifying structure from stereopsis and motion. , 1989, Science.

[12]  J. Maunsell,et al.  Extraretinal representations in area V4 in the macaque monkey , 1991, Visual Neuroscience.

[13]  R. Blake,et al.  The interplay between stereopsis and structure from motion , 1991, Perception & psychophysics.

[14]  M Nawrot,et al.  A neural network model of kinetic depth , 1991, Visual Neuroscience.

[15]  Thomas C. Toppino,et al.  Prime time: Fatigue and set effects in the perception of reversible figures , 1992, Perception & psychophysics.

[16]  R. Blake,et al.  Visual Alchemy: Stereoscopic Adaptation Produces Kinetic Depth from Random Noise , 1993, Perception.

[17]  R. Andersen,et al.  Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  R. Sekuler,et al.  Sound alters visual motion perception , 1997, Nature.

[19]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[20]  R. Andersen,et al.  Encoding of three-dimensional structure-from-motion by primate area MT neurons , 1998, Nature.

[21]  W. Singer,et al.  The constructive nature of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery , 1998, The European journal of neuroscience.

[22]  G. DeAngelis,et al.  Cortical area MT and the perception of stereoscopic depth , 1998, Nature.

[23]  G. DeAngelis,et al.  Organization of Disparity-Selective Neurons in Macaque Area MT , 1999, The Journal of Neuroscience.

[24]  Heinrich H. Bülthoff,et al.  Touch can change visual slant perception , 2000, Nature Neuroscience.

[25]  A. Parker,et al.  Perceptually Bistable Three-Dimensional Figures Evoke High Choice Probabilities in Cortical Area MT , 2001, The Journal of Neuroscience.

[26]  T. Hendler,et al.  Visuo-haptic object-related activation in the ventral visual pathway , 2001, Nature Neuroscience.

[27]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[28]  D. Heeger,et al.  Retinotopy and Functional Subdivision of Human Areas MT and MST , 2002, The Journal of Neuroscience.

[29]  G. Essick,et al.  Tactile motion activates the human middle temporal/V5 (MT/V5) complex , 2002, The European journal of neuroscience.

[30]  C. Spence,et al.  Audiotactile interactions in roughness perception , 2002, Experimental Brain Research.

[31]  J Timothy Petersik,et al.  Buildup and Decay of a Three-Dimensional Rotational Aftereffect Obtained with a Three-Dimensional Figure , 2002, Perception.

[32]  Ravi S. Menon,et al.  Haptic study of three-dimensional objects activates extrastriate visual areas , 2002, Neuropsychologia.

[33]  David A. Leopold,et al.  Stable perception of visually ambiguous patterns , 2002, Nature Neuroscience.

[34]  G. Berkeley Essay Towards a New Theory of Vision , 2004 .

[35]  J. Aloimonos,et al.  On the kinetic depth effect , 1989, Biological Cybernetics.