Touch Influences Visual Perception with a Tight Orientation-Tuning

Stimuli from different sensory modalities are thought to be processed initially in distinct unisensory brain areas prior to convergence in multisensory areas. However, signals in one modality can influence the processing of signals from other modalities and recent studies suggest this cross-modal influence may occur early on, even in ‘unisensory’ areas. Some recent psychophysical studies have shown specific cross-modal effects between touch and vision during binocular rivalry, but these cannot completely rule out a response bias. To test for genuine cross-modal integration of haptic and visual signals, we investigated whether congruent haptic input could influence visual contrast sensitivity compared to incongruent haptic input in three psychophysical experiments using a two-interval, two-alternative forced-choice method to eliminate response bias. The initial experiment demonstrated that contrast thresholds for a visual grating were lower when exploring a haptic grating that shared the same orientation compared to an orthogonal orientation. Two subsequent experiments mapped the orientation and spatial frequency tunings for the congruent haptic facilitation of vision, finding a clear orientation tuning effect but not a spatial frequency tuning. In addition to an increased contrast sensitivity for iso-oriented visual-haptic gratings, we found a significant loss of sensitivity for orthogonally oriented visual-haptic gratings. We conclude that the tactile influence on vision is a result of a tactile input to orientation-tuned visual areas.

[1]  K Sathian,et al.  Visual cortical activity during tactile perception in the sighted and the visually deprived. , 2005, Developmental psychobiology.

[2]  P. Mamassian,et al.  Multisensory processing in review: from physiology to behaviour. , 2010, Seeing and perceiving.

[3]  Scott T. Grafton,et al.  Feeling with the mind's eye , 1997, Neuroreport.

[4]  R. Blake,et al.  Neural bases of binocular rivalry , 2006, Trends in Cognitive Sciences.

[5]  John J. Foxe,et al.  The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. , 2002, Brain research. Cognitive brain research.

[6]  N. Graham Visual Pattern Analyzers , 1989 .

[7]  C. Law,et al.  Reinforcement learning can account for associative and perceptual learning on a visual decision task , 2009, Nature Neuroscience.

[8]  Scott T. Grafton,et al.  Involvement of visual cortex in tactile discrimination of orientation , 1999, Nature.

[9]  D. Goldreich,et al.  Short-Term Visual Deprivation Does Not Enhance Passive Tactile Spatial Acuity , 2011, PloS one.

[10]  P. Haggard,et al.  Visual enhancement of touch in spatial body representation , 2003, Experimental Brain Research.

[11]  Xiaoping Hu,et al.  Object familiarity modulates effective connectivity during haptic shape perception , 2010, NeuroImage.

[12]  David E. J. Linden,et al.  Orientation-specific adaptation to mentally generated lines in human visual cortex , 2009, NeuroImage.

[13]  Manabu Honda,et al.  Critical Period for Cross-Modal Plasticity in Blind Humans: A Functional MRI Study , 2002, NeuroImage.

[14]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[15]  Sensory systems: Do you hear what I see? , 2014, Nature.

[16]  D. Ferster,et al.  Neural mechanisms of orientation selectivity in the visual cortex. , 2000, Annual review of neuroscience.

[17]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[18]  M. Sereno,et al.  Dissociation of Sensitivity to Spatial Frequency in Word and Face Preferential Areas of the Fusiform Gyrus , 2011, Cerebral cortex.

[19]  P. O. Bishop,et al.  Inhibitory and sub-liminal excitatory receptive fields of simple units in cat striate cortex. , 1969, Vision research.

[20]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[21]  Naomi B. Pitskel,et al.  Rapid and Reversible Recruitment of Early Visual Cortex for Touch , 2008, PloS one.

[22]  A. Karni,et al.  The time course of learning a visual skill , 1993, Nature.

[23]  Karl J. Friston,et al.  Different activation patterns in the visual cortex of late and congenitally blind subjects. , 1998, Brain : a journal of neurology.

[24]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[25]  B. Dosher,et al.  The dynamics of perceptual learning: an incremental reweighting model. , 2005, Psychological review.

[26]  K Sathian,et al.  Feeling with the mind's eye: contribution of visual cortex to tactile perception , 2002, Behavioural Brain Research.

[27]  Shinsuke Shimojo,et al.  Touch-induced visual illusion , 2005, Neuroreport.

[28]  Jan Theeuwes,et al.  Early multisensory interactions affect the competition among multiple visual objects , 2011, NeuroImage.

[29]  L. Merabet,et al.  The plastic human brain cortex. , 2005, Annual review of neuroscience.

[30]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[31]  M. Morrone,et al.  Touch disambiguates rivalrous perception at early stages of visual analysis , 2010, Current Biology.

[32]  D. Heeger,et al.  Cross-orientation suppression in human visual cortex. , 2011, Journal of neurophysiology.

[33]  H. Kennedy,et al.  Anatomical Evidence of Multimodal Integration in Primate Striate Cortex , 2002, The Journal of Neuroscience.

[34]  M. Carrasco,et al.  Transient Attention Enhances Perceptual Performance and fMRI Response in Human Visual Cortex , 2005, Neuron.

[35]  H. Burton Visual Cortex Activity in Early and Late Blind People , 2003, The Journal of Neuroscience.

[36]  Kathleen S Rockland,et al.  Multisensory convergence in calcarine visual areas in macaque monkey. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[37]  J. Vroomen,et al.  Sound enhances visual perception: cross-modal effects of auditory organization on vision. , 2000, Journal of experimental psychology. Human perception and performance.

[38]  P. Haggard,et al.  Noninformative vision improves the spatial resolution of touch in humans , 2001, Current Biology.

[39]  Simon Lacey,et al.  Object familiarity modulates the relationship between visual object imagery and haptic shape perception , 2010, NeuroImage.

[40]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[41]  Jan Theeuwes,et al.  Pip and pop: nonspatial auditory signals improve spatial visual search. , 2008, Journal of experimental psychology. Human perception and performance.

[42]  Justin A. Harris,et al.  Vision Merges With Touch in a Purely Tactile Discrimination , 2008, Psychological science.

[43]  Patrick Haggard,et al.  Persistence of visual–tactile enhancement in humans , 2004, Neuroscience Letters.

[44]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[45]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[46]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[47]  J. Duncan,et al.  Top-Down Activation of Shape-Specific Population Codes in Visual Cortex during Mental Imagery , 2009, The Journal of Neuroscience.

[48]  Ankoor S. Shah,et al.  Auditory Cortical Neurons Respond to Somatosensory Stimulation , 2003, The Journal of Neuroscience.

[49]  Natalia Y. Bilenko,et al.  The “Parahippocampal Place Area” Responds Preferentially to High Spatial Frequencies in Humans and Monkeys , 2011, PLoS biology.

[50]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[51]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[52]  G. Orban,et al.  Human perceptual learning in identifying the oblique orientation: retinotopy, orientation specificity and monocularity. , 1995, The Journal of physiology.

[53]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[54]  J. Theeuwes,et al.  Poke and pop: Tactile–visual synchrony increases visual saliency , 2009, Neuroscience Letters.

[55]  D. Burr,et al.  Functional implications of cross-orientation inhibition of cortical visual cells. I. Neurophysiological evidence , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[56]  M. Hallett,et al.  Neural networks for Braille reading by the blind. , 1998 .

[57]  R. Malach,et al.  Early ‘visual’ cortex activation correlates with superior verbal memory performance in the blind , 2003, Nature Neuroscience.

[58]  D. Heeger,et al.  Neuronal activity in human primary visual cortex correlates with perception during binocular rivalry , 2000, Nature Neuroscience.

[59]  P. O. Bishop,et al.  Receptive fields of simple cells in the cat striate cortex , 1973, The Journal of physiology.

[60]  Roger B. H. Tootell,et al.  A Cardinal Orientation Bias in Scene-Selective Visual Cortex , 2012, The Journal of Neuroscience.

[61]  John J. Foxe,et al.  Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. , 2002, Journal of neurophysiology.

[62]  J Driver,et al.  An event-related brain potential study of cross-modal links in spatial attention between vision and touch. , 2000, Psychophysiology.

[63]  S. Kosslyn,et al.  Visual Mental Imagery Activates Topographically Organized Visual Cortex: PET Investigations , 1993, Journal of Cognitive Neuroscience.

[64]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[65]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[66]  Peter Melzer,et al.  Cortical activation during Braille reading is influenced by early visual experience in subjects with severe visual disability: A correlational fMRI study , 2001, Human brain mapping.

[67]  D. Alais,et al.  Touch Interacts with Vision during Binocular Rivalry with a Tight Orientation Tuning , 2013, PloS one.

[68]  M. Carrasco,et al.  Covert attention affects the psychometric function of contrast sensitivity , 2002, Vision Research.

[69]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[70]  I. Ohzawa,et al.  Organization of suppression in receptive fields of neurons in cat visual cortex. , 1992, Journal of neurophysiology.

[71]  Nicholas J. Priebe,et al.  Emergence of Orientation Selectivity in the Mammalian Visual Pathway , 2013, The Journal of Neuroscience.