Vision and Audition Do Not Share Attentional Resources in Sustained Tasks

Our perceptual capacities are limited by attentional resources. One important question is whether these resources are allocated separately to each sense or shared between them. We addressed this issue by asking subjects to perform a double task, either in the same modality or in different modalities (vision and audition). The primary task was a multiple object-tracking task (Pylyshyn and Storm, 1988), in which observers were required to track between 2 and 5 dots for 4 s. Concurrently, they were required to identify either which out of three gratings spaced over the interval differed in contrast or, in the auditory version of the same task, which tone differed in frequency relative to the two reference tones. The results show that while the concurrent visual contrast discrimination reduced tracking ability by about 0.7 d′, the concurrent auditory task had virtually no effect. This confirms previous reports that vision and audition use separate attentional resources, consistent with fMRI findings of attentional effects as early as V1 and A1. The results have clear implications for effective design of instrumentation and forms of audio–visual communication devices.

[1]  D. Spalding The Principles of Psychology , 1873, Nature.

[2]  E Tulving,et al.  Identification of simultaneously presented simple visual and auditory stimuli. , 1967, Acta psychologica.

[3]  P. H. Lindsay,et al.  Quantification of shared capacity processing in auditory and visual discrimination. , 1967, Acta psychologica.

[4]  D. Allport,et al.  On the Division of Attention: A Disproof of the Single Channel Hypothesis , 1972, The Quarterly journal of experimental psychology.

[5]  R. Shiffrin,et al.  Can attention be allocated to sensory modalities? , 1974 .

[6]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[7]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[8]  D Gopher,et al.  On separability of and interference between tracking dimensions in dual-axis tracking. , 1984, Journal of motor behavior.

[9]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[10]  H. Pashler Attentional Limitations in Doing Two Tasks at the Same Time , 1992 .

[11]  H Pashler,et al.  Dual-task interference and the cerebral hemispheres. , 1993, Journal of experimental psychology. Human perception and performance.

[12]  H. Pashler Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[13]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[14]  S. Martens,et al.  Restricted attentional capacity within but not between sensory modalities , 1997, Nature.

[15]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[16]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[17]  A. Bonnel,et al.  Divided attention between simultaneous auditory and visual signals , 1998, Perception & psychophysics.

[18]  W Prinzmetal,et al.  Dividing attention between the color and the shape of objects , 1998, Perception & psychophysics.

[19]  P. Jolicoeur Restricted attentional capacity between sensory modalities , 1999, Psychonomic bulletin & review.

[20]  C. Gilbert,et al.  Attention and primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Lutz Jäncke,et al.  Attention modulates activity in the primary and the secondary auditory cortex: a functional magnetic resonance imaging study in human subjects , 1999, Neuroscience Letters.

[22]  D. Somers,et al.  Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[23]  C. Koch,et al.  Attention activates winner-take-all competition among visual filters , 1999, Nature Neuroscience.

[24]  L. Jäncke,et al.  Attention Modulates the Blood Oxygen Level Dependent Response in the Primary Visual Cortex measured with Functional Magnetic Resonance Imaging , 1999, Naturwissenschaften.

[25]  D. Heeger,et al.  Spatial attention affects brain activity in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[26]  J Driver,et al.  Cross-modal selective attention: On the difficulty of ignoring sounds at the locus of visual attention , 2000, Perception & psychophysics.

[27]  B McElree,et al.  Covert attention accelerates the rate of visual information processing , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[28]  J. Duncan,et al.  Separate and Shared Sources of Dual-Task Cost in Stimulus Identification and Response Selection , 2002, Cognitive Psychology.

[29]  Maria Concetta Morrone,et al.  Color and Luminance Contrasts Attract Independent Attention , 2002, Current Biology.

[30]  Claus Bundesen,et al.  Seeing or hearing? Perceptual independence, modality confusions, and crossmodal congruity effects with focused and divided attention , 2003, Perception & psychophysics.

[31]  M. Crommelinck,et al.  When audition alters vision: an event-related potential study of the cross-modal interactions between faces and voices , 2004, Neuroscience Letters.

[32]  H. Pashler,et al.  Repetition priming in visual search: Episodic retrieval, not feature priming , 2004, Memory & cognition.

[33]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[34]  David Alais,et al.  Separate attentional resources for vision and audition , 2006, Proceedings of the Royal Society B: Biological Sciences.

[35]  D. Alais,et al.  Contour interactions between pairs of Gabors engaged in binocular rivalry reveal a map of the association field , 2006, Vision Research.

[36]  Notger G. Müller,et al.  Competing Neural Responses for Auditory and Visual Decisions , 2007, PloS one.

[37]  M. Carrasco,et al.  PSYCHOLOGICAL SCIENCE Research Article Voluntary Attention Enhances Contrast Appearance , 2022 .

[38]  Emiliano Macaluso,et al.  The costs of monitoring simultaneously two sensory modalities decrease when dividing attention in space , 2010, NeuroImage.

[39]  Alison Davies,et al.  Divided Attention to Ear and Eye1 , 2012 .