The time-course of auditory and visual distraction effects in a new crossmodal paradigm

Vision often dominates audition when attentive processes are involved (e.g., the ventriloquist effect), yet little is known about the relative potential of the two modalities to initiate a "break through of the unattended". The present study was designed to systematically compare the capacity of task-irrelevant auditory and visual events to withdraw attention from the other modality. Sequences of auditory and visual stimuli were presented with different amounts of temporal offset to determine the presence, strength, and time-course of attentional orienting and reorienting as well as their impact on task-related processing. One of the streams was task-relevant, while crossmodal distraction caused by unexpected events in the other stream was measured by impairments of behavioral task performance and by the N2, P3a, and reorienting negativity (RON) components of the event-related potential (ERP). Unexpected events in the visual modality proved to be somewhat more salient than those in the auditory modality, yet crossmodal interference caused by auditory stimuli was more pronounced. The visual modality was relatively constrained in terms of a critical time-range within which distraction effects could be elicited, while the impact of auditory stimuli on task-related processing extended over a longer time-range. These results are discussed in terms of functional differences between the auditory and visual modalities. Further applications of the new crossmodal protocol are deemed promising in view of the considerable size of the obtained distraction effects.

[1]  C. Frith,et al.  The Role of Working Memory in Visual Selective Attention , 2001, Science.

[2]  N. Cowan,et al.  Interactions between Transient and Long-Term Auditory Memory as Reflected by the Mismatch Negativity , 1996, Journal of Cognitive Neuroscience.

[3]  E. Schröger,et al.  The development of involuntary and voluntary attention from childhood to adulthood: A combined behavioral and event-related potential study , 2006, Clinical Neurophysiology.

[4]  N. Lavie.  Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[5]  F. Perrin,et al.  Spherical splines for scalp potential and current density mapping. , 1989, Electroencephalography and clinical neurophysiology.

[6]  S. Grimm,et al.  Distraction in a visual multi-deviant paradigm: behavioral and event-related potential effects. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[7]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[8]  A. Welford.  THE ‘PSYCHOLOGICAL REFRACTORY PERIOD’ AND THE TIMING OF HIGH‐SPEED PERFORMANCE—A REVIEW AND A THEORY , 1952 .

[9]  Marvin M Chun,et al.  Concurrent working memory load can reduce distraction. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Wim Fias,et al.  Post-error slowing: An orienting account , 2009, Cognition.

[11]  Robert Oostenveld,et al.  The five percent electrode system for high-resolution EEG and ERP measurements , 2001, Clinical Neurophysiology.

[12]  E. Schröger,et al.  Attentional orienting and reorienting is indicated by human event‐related brain potentials , 1998, Neuroreport.

[13]  Rolf Ulrich,et al.  Why jackknifing yields good latency estimates. , 2009, Psychophysiology.

[14]  John Duncan,et al.  Restricted attentional capacity within but not between sensory modalities , 1997, Nature.

[15]  C. Frith,et al.  Processing of irrelevant visual motion during performance of an auditory attention task , 2001, Neuropsychologia.

[16]  Piia Astikainen,et al.  Visual mismatch negativity for changes in orientation – a sensory memory‐dependent response , 2008, The European journal of neuroscience.

[17]  E. Schröger,et al.  Behavioral and electrophysiological effects of task-irrelevant sound change: a new distraction paradigm. , 1998, Brain research. Cognitive brain research.

[18]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[19]  Erich Schröger,et al.  Auditory distraction by duration and location deviants: a behavioral and event-related potential study. , 2003, Brain research. Cognitive brain research.

[20]  Jeffrey R. Binder,et al.  Attentional Modulation in the Detection of Irrelevant Deviance: A Simultaneous ERP/fMRI Study , 2006, Journal of Cognitive Neuroscience.

[21]  Salil H. Patel,et al.  Characterization of N200 and P300: Selected Studies of the Event-Related Potential , 2005, International journal of medical sciences.

[22]  R. Hyman.  Stimulus information as a determinant of reaction time. , 1953, Journal of experimental psychology.

[23]  I. Winkler,et al.  Age-related differences in distraction and reorientation in an auditory task , 2009, Neurobiology of Aging.

[24]  Robert Gray,et al.  A Comparison of Tactile, Visual, and Auditory Warnings for Rear-End Collision Prevention in Simulated Driving , 2008, Hum. Factors.

[25]  Erich Schröger,et al.  Memory trace formation for abstract auditory features and its consequences in different attentional contexts , 2008, Biological Psychology.

[26]  Erich Schröger,et al.  Evidence for the auditory P3a reflecting an automatic process: Elicitation during highly-focused continuous visual attention , 2007, Brain Research.

[27]  On the speed of different senses and nerve transmission by Hirsch (1862) , 1997, Psychological research.

[28]  Carles Escera,et al.  Attention capture by auditory significant stimuli: semantic analysis follows attention switching , 2003, The European journal of neuroscience.

[29]  M. Falkenstein,et al.  Auditory distraction in young and middle-aged adults: a behavioural and event-related potential study , 2005, Journal of Neural Transmission.

[30]  Shaul Hochstein,et al.  Momentary Fluctuations in Allocation of Attention: Cross-modal Effects of Visual Task Load on Auditory Discrimination , 2010, Journal of Cognitive Neuroscience.

[31]  J. Driver,et al.  Crossmodal links in endogenous and exogenous spatial attention: evidence from event-related brain potential studies , 2001, Neuroscience & Biobehavioral Reviews.

[32]  Teemu Rinne,et al.  Distributed cortical networks for focused auditory attention and distraction , 2007, Neuroscience Letters.

[33]  J. Lewald,et al.  Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. , 2003, Brain research. Cognitive brain research.

[34]  Erich Schröger,et al.  Response repetition vs. response change modulates behavioral and electrophysiological effects of distraction. , 2005, Brain research. Cognitive brain research.

[35]  M. Wallace,et al.  Representation and integration of multiple sensory inputs in primate superior colliculus. , 1996, Journal of neurophysiology.

[36]  H G Vaughan,et al.  Differentiation of negative event-related potentials in an auditory discrimination task. , 1990, Electroencephalography and clinical neurophysiology.

[37]  Erich Schröger,et al.  Auditory distraction: event-related potential and behavioral indices , 2000, Clinical Neurophysiology.

[38]  I. Winkler,et al.  Do N1/MMN, P3a, and RON form a strongly coupled chain reflecting the three stages of auditory distraction? , 2008, Biological Psychology.

[39]  Ettore Lettich,et al.  Ten Percent Electrode System for Topographic Studies of Spontaneous and Evoked EEG Activities , 1985 .

[40]  I. Czigler.  Visual mismatch negativity: Violation of nonattended environmental regularities , 2007 .

[41]  E. Schröger,et al.  Bottom-up influences on working memory: behavioral and electrophysiological distraction varies with distractor strength. , 2004, Experimental psychology.

[42]  Geraint Rees,et al.  Brain mechanisms mediating auditory attentional capture in humans. , 2007, Cerebral cortex.

[43]  J Horváth,et al.  Simultaneously active pre-attentive representations of local and global rules for sound sequences in the human brain. , 2001, Brain research. Cognitive brain research.

[44]  R. Näätänen,et al.  Early selective-attention effect on evoked potential reinterpreted. , 1978, Acta psychologica.

[45]  Marc O. Ernst,et al.  Tri-modal integration of visual, tactile and auditory signals for the perception of sequences of events , 2008, Brain Research Bulletin.

[46]  R. Näätänen,et al.  Intermodal selective attention. II. Effects of attentional load on processing of auditory and visual stimuli in central space. , 1992, Electroencephalography and clinical neurophysiology.

[47]  E. Schröger,et al.  A comparison of auditory and visual distraction effects: behavioral and event-related indices. , 2001, Brain research. Cognitive brain research.

[48]  D. Friedman,et al.  The novelty P3: an event-related brain potential (ERP) sign of the brain's evaluation of novelty , 2001, Neuroscience & Biobehavioral Reviews.

[49]  Erich Schröger,et al.  Regularity Extraction and Application in Dynamic Auditory Stimulus Sequences , 2007, Journal of Cognitive Neuroscience.

[50]  Motohiro Kimura,et al.  Involvement of memory-comparison-based change detection in visual distraction. , 2008, Psychophysiology.

[51]  Erich Schröger,et al.  Distraction effects in vision: behavioral and event-related potential indices , 2004, Neuroreport.

[52]  R. Näätänen,et al.  Stimulus deviance and evoked potentials , 1982, Biological Psychology.

[53]  I. Winkler,et al.  Involuntary Attention and Distractibility as Evaluated with Event-Related Brain Potentials , 2000, Audiology and Neurotology.

[54]  Gregory McCarthy,et al.  Graded Visual Attention Modulates Brain Responses Evoked by Task-irrelevant Auditory Pitch Changes , 2005, Journal of Cognitive Neuroscience.

[55]  Stefan Berti,et al.  Examining task-dependencies of different attentional processes as reflected in the P3a and reorienting negativity components of the human event-related brain potential , 2006, Neuroscience Letters.

[56]  K. R. Ridderinkhof,et al.  To P(E) or not to P(E): a P3-like ERP component reflecting the processing of response errors. , 2009, Psychophysiology.

[57]  D. Linden.  The P300: Where in the Brain Is It Produced and What Does It Tell Us? , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[58]  N. Squires,et al.  Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. , 1975, Electroencephalography and clinical neurophysiology.

[59]  Stefan Berti,et al.  Object switching within working memory is reflected in the human event-related brain potential , 2008, Neuroscience Letters.

[60]  Carles Escera,et al.  When Loading Working Memory Reduces Distraction: Behavioral and Electrophysiological Evidence from an Auditory-Visual Distraction Paradigm , 2008, Journal of Cognitive Neuroscience.

[61]  E. Schröger.  The mismatch negativity as a tool to study auditory processing , 2005 .

[62]  Risto Näätänen,et al.  Effects of auditory distraction on electrophysiological brain activity and performance in children aged 8-13 years. , 2004, Psychophysiology.

[63]  R T Knight,et al.  Anatomic bases of event-related potentials and their relationship to novelty detection in humans. , 1998, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[64]  E. Viding,et al.  Load theory of selective attention and cognitive control. , 2004, Journal of experimental psychology. General.

[65]  I. Winkler,et al.  Memory prerequisites of mismatch negativity in the auditory event-related potential (ERP). , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[66]  S. Berti.  Cognitive control after distraction: event-related brain potentials (ERPs) dissociate between different processes of attentional allocation. , 2008, Psychophysiology.

[67]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[68]  C. Escera,et al.  Electrical responses reveal the temporal dynamics of brain events during involuntary attention switching , 2001, The European journal of neuroscience.

[69]  N. Gosselin,et al.  Attentional deficits in patients with obstructive sleep apnea syndrome: An event-related potential study , 2006, Clinical Neurophysiology.

[70]  E. Schröger,et al.  Modulation of involuntary attention by the duration of novel and pitch deviant sounds in children and adolescents , 2007, Biological Psychology.

[71]  Peng Yuan,et al.  The effect of visuospatial attentional load on the processing of irrelevant acoustic distractors , 2006, NeuroImage.

[72]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[73]  Erich Schröger,et al.  Visual distraction: a behavioral and event-related brain potential study in humans , 2006, Neuroreport.

[74]  E. Amenedo,et al.  MMN in the visual modality: a review , 2003, Biological Psychology.

[75]  T Kleinsorge,et al.  Response repetition benefits and costs. , 1999, Acta psychologica.

[76]  P. Bertelson.  Sequential Redundancy and Speed in a Serial Two-Choice Responding Task , 1961 .

[77]  G. Aschersleben,et al.  Automatic visual bias of perceived auditory location , 1998 .

[78]  R. Knight,et al.  Neural Mechanisms of Involuntary Attention to Acoustic Novelty and Change , 1998, Journal of Cognitive Neuroscience.

[79]  C. Escera,et al.  Activation of brain mechanisms of attention switching as a function of auditory frequency change , 2001, Neuroreport.

[80]  I. Winkler.  Interpreting the Mismatch Negativity , 2007 .

[81]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[82]  Stefan Berti,et al.  Distraction of task-relevant information processing by irrelevant changes in auditory, visual, and bimodal stimulus features: a behavioral and event-related potential study. , 2009, Psychophysiology.

[83]  C. Escera,et al.  Role of Mismatch Negativity and Novelty-P3 in Involuntary Auditory Attention , 2007 .

[84]  E. Schröger,et al.  ERP effects of intermodal attention and cross-modal links in spatial attention. , 1998, Psychophysiology.

[85]  Jeff Miller,et al.  Measurement of ERP latency differences: a comparison of single-participant and jackknife-based scoring methods. , 2008, Psychophysiology.