Momentary Fluctuations in Allocation of Attention: Cross-modal Effects of Visual Task Load on Auditory Discrimination

Even when our attention is dedicated to an important task, background processes monitor the environment for significant events. The mismatch negativity (MMN) event-related potential is thought to reflect such a monitoring process. Nevertheless, there is continuing debate concerning the susceptibility of the MMN to attentional manipulation. We investigated the trial-by-trial relationship between brain activity related to change detection, reflected in the MMN, and visual psychophysical performance—while varying task difficulty. We find that auditory change detection is indeed “automatic” in that MMN remains robust despite increasing (visual) task load. However, the MMN amplitude and latency are susceptible to both visual load and to momentary attentional fluctuations as reflected in success or failure to identify a following visual target. We conclude that background central auditory processing is sensitive to the demands of a visual task, and fluctuates based on moment-to-moment allocation of attentional resources to the visual task.

[1]  A. Muller-Gass,et al.  “…and were instructed to read a self-selected book while ignoring the auditory stimuli”: The effects of task demands on the mismatch negativity , 2005, Clinical Neurophysiology.

[2]  Nilli Lavie,et al.  Contrasting effects of sensory limits and capacity limits in visual selective attention , 2003, Perception & psychophysics.

[3]  E. Schröger,et al.  Is there pre-attentive memory-based comparison of pitch? , 2001, Psychophysiology.

[4]  I. Winkler,et al.  MMN and attention: competition for deviance detection. , 2003, Psychophysiology.

[5]  K. Alho,et al.  Processing of auditory stimuli during auditory and visual attention as revealed by event-related potentials. , 1994, Psychophysiology.

[6]  K. Shapiro,et al.  Attention to visual pattern information produces the attentional blink in rapid serial visual presentation. , 1994, Journal of experimental psychology. Human perception and performance.

[7]  Aysenil Belger,et al.  Visual task complexity modulates the brain's response to unattended auditory novelty , 2005, Neuroreport.

[8]  Norbert Kathmann,et al.  Stability of the mismatch negativity under different stimulus and attention conditions , 1999, Clinical Neurophysiology.

[9]  Peng Yuan,et al.  The effect of visuospatial attentional load on the processing of irrelevant acoustic distractors , 2006, NeuroImage.

[10]  Kristina M. Visscher,et al.  The neural bases of momentary lapses in attention , 2006, Nature Neuroscience.

[11]  F. Bloom,et al.  Magnetoencephalographic recordings demonstrate attentional modulation of mismatch-related neural activity in human auditory cortex. , 1998, Psychophysiology.

[12]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[13]  Massimiliano Valeriani,et al.  Attentional load of the primary task influences the frontal but not the temporal generators of mismatch negativity. , 2005, Brain research. Cognitive brain research.

[14]  M. Tervaniemi,et al.  Towards Optimal Recording and Analysis of the Mismatch Negativity , 2000, Audiology and Neurotology.

[15]  C Alain,et al.  Effects of visual attentional load on auditory processing , 2000, Neuroreport.

[16]  R. Näätänen,et al.  Attention and mismatch negativity. , 1993, Psychophysiology.

[17]  R. Näätänen.  The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function , 1990, Behavioral and Brain Sciences.

[18]  Barry Fowler,et al.  Effects of a dual task on the N100-P200 complex and the early and late Nd attention waveforms. , 2002, Psychophysiology.

[19]  Gregory McCarthy,et al.  Graded Visual Attention Modulates Brain Responses Evoked by Task-irrelevant Auditory Pitch Changes , 2005, Journal of Cognitive Neuroscience.

[20]  A. Baddeley.  Exploring the Central Executive , 1996 .

[21]  Andreas Kleinschmidt,et al.  The Attentional Blink Modulates Activity in the Early Visual Cortex , 2009, Journal of Cognitive Neuroscience.

[22]  Claude Alain,et al.  Effects of visual attentional load on low-level auditory scene analysis , 2005, Cognitive, affective & behavioral neuroscience.

[23]  Carles Escera,et al.  An electrophysiological and behavioral investigation of involuntary attention towards auditory frequency, duration and intensity changes. , 2002, Brain research. Cognitive brain research.

[24]  K. Alho,et al.  Intermodal selective attention: evidence for processing in tonotopic auditory fields. , 1993, Psychophysiology.

[25]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[26]  R. Näätänen,et al.  Intermodal selective attention. II. Effects of attentional load on processing of auditory and visual stimuli in central space. , 1992, Electroencephalography and clinical neurophysiology.

[27]  A. Dittmann-Balçar,et al.  Attention-dependent allocation of auditory processing resources as measured by mismatch negativity. , 1999, Neuroreport.

[28]  S. Hillyard,et al.  Modulation of early auditory processing during selective listening to rapidly presented tones. , 1991, Electroencephalography and clinical neurophysiology.

[29]  T Fernández,et al.  Primary task demands modulate P3a amplitude. , 2000, Brain research. Cognitive brain research.

[30]  A. Bregman,et al.  Attentional modulation of electrophysiological activity in auditory cortex for unattended sounds within multistream auditory environments , 2005, Cognitive, affective & behavioral neuroscience.

[31]  I. Winkler,et al.  The concept of auditory stimulus representation in cognitive neuroscience. , 1999, Psychological bulletin.

[32]  Ulrich Schall,et al.  Modulation of mismatch negativity by stimulus deviance and modality of attention , 2002, Neuroreport.

[33]  Dominique Morlet,et al.  Mismatch Negativity and N100 in Comatose Patients , 2000, Audiology and Neurotology.

[34]  N. Lavie.  Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[35]  I. Winkler,et al.  Preattentive representation of feature conjunctions for concurrent spatially distributed auditory objects. , 2005, Brain research. Cognitive brain research.

[36]  Mikko Sams,et al.  Visual Processing Affects the Neural Basis of Auditory Discrimination , 2008, Journal of Cognitive Neuroscience.

[37]  Darryl G. Humphrey,et al.  Assessment of mental workload with task-irrelevant auditory probes , 1995, Biological Psychology.

[38]  A. Muller-Gass,et al.  The effect of visual task difficulty and attentional direction on the detection of acoustic change as indexed by the Mismatch Negativity , 2006, Brain Research.

[39]  E. Schröger.  Measurement and interpretation of the mismatch negativity , 1998 .

[40]  R. Näätänen,et al.  Early selective-attention effect on evoked potential reinterpreted. , 1978, Acta psychologica.

[41]  Yue-jia Luo,et al.  A modified oddball paradigm “cross-modal delayed response” and the research on mismatch negativity , 2002, Brain Research Bulletin.