Preattentive Binding of Auditory and Visual Stimulus Features

We investigated the role of attention in feature binding in the auditory and the visual modality. One auditory and one visual experiment used the mismatch negativity (MMN and vMMN, respectively) event-related potential to index the memory representations created from stimulus sequences, which were either task-relevant and, therefore, attended or task-irrelevant and ignored. In the latter case, the primary task was a continuous demanding within-modality task. The test sequences were composed of two frequently occurring stimuli, which differed from each other in two stimulus features (standard stimuli) and two infrequently occurring stimuli (deviants), which combined one feature from one standard stimulus with the other feature of the other standard stimulus. Deviant stimuli elicited MMN responses of similar parameters across the different attentional conditions. These results suggest that the memory representations involved in the MMN deviance detection response encoded the frequently occurring feature combinations whether or not the test sequences were attended. A possible alternative to the memory-based interpretation of the visual results, the elicitation of the McCollough color-contingent aftereffect, was ruled out by the results of our third experiment. The current results are compared with those supporting the attentive feature integration theory. We conclude that (1) with comparable stimulus paradigms, similar results have been obtained in the two modalities, (2) there exist preattentive processes of feature binding, however, (3) conjoining features within rich arrays of objects under time pressure and/or long-term retention of the feature-conjoined memory representations may require attentive processes.

[1]  M. Verbaten,et al.  Detection of visual change: mismatch or rareness? , 2003, Neuroreport.

[2]  Motohiro Kimura,et al.  An ERP study of visual change detection: effects of magnitude of spatial frequency changes on the change-related posterior positivity. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[3]  W. Singer,et al.  Temporal coding in the visual cortex: new vistas on integration in the nervous system , 1992, Trends in Neurosciences.

[4]  J. Polich Detection of change : event-related potential and fMRI findings , 2003 .

[5]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[6]  I. Winkler,et al.  Preattentive extraction of abstract feature conjunctions from auditory stimulation as reflected by the mismatch negativity (MMN). , 2001, Psychophysiology.

[7]  I. Winkler,et al.  Preattentive representation of feature conjunctions for concurrent spatially distributed auditory objects. , 2005, Brain research. Cognitive brain research.

[8]  Motohiro Kimura,et al.  Positive difference in ERPs reflects independent processing of visual changes. , 2005, Psychophysiology.

[9]  D. Deutsch Two-channel listening to musical scales. , 1975, The Journal of the Acoustical Society of America.

[10]  T. Picton,et al.  Mismatch Negativity: Different Water in the Same River , 2000, Audiology and Neurotology.

[11]  J. G. Axford,et al.  Source locations of pattern-specific components of human visual evoked potentials. II. Component of extrastriate cortical origin , 2004, Experimental Brain Research.

[12]  K. Alho,et al.  Intermodal selective attention. I. Effects on event-related potentials to lateralized auditory and visual stimuli. , 1992, Electroencephalography and clinical neurophysiology.

[13]  Motohiro Kimura,et al.  Probability-independent and -dependent ERPs reflecting visual change detection. , 2006, Psychophysiology.

[14]  K. Lehnertz,et al.  Tonotopic organization of the human auditory cortex revealed by transient auditory evoked magnetic fields. , 1988, Electroencephalography and clinical neurophysiology.

[15]  S. Kotz,et al.  Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing , 2006, Trends in Cognitive Sciences.

[16]  Erich Schröger,et al.  Distraction effects in vision: behavioral and event-related potential indices , 2004, Neuroreport.

[17]  A. Tales,et al.  Visual mismatch negativity highlights abnormal preattentive visual processing in Alzheimer's disease , 2006, Neuroreport.

[18]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[19]  A Tales,et al.  Mismatch negativity in the visual modality. , 1999, Neuroreport.

[20]  A Treisman,et al.  Feature binding, attention and object perception. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  E. Amenedo,et al.  MMN in the visual modality: a review , 2003, Biological Psychology.

[22]  A S Bregman,et al.  Auditory streaming is cumulative. , 1978, Journal of experimental psychology. Human perception and performance.

[23]  M. Steinschneider,et al.  Neurophysiological evidence for context-dependent encoding of sensory input in human auditory cortex , 2006, Brain Research.

[24]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[25]  A Kok,et al.  Event-related potentials to conjunctions of spatial frequency and orientation as a function of stimulus parameters and response requirements. , 1993, Electroencephalography and clinical neurophysiology.

[26]  I. Winkler,et al.  Object representation in the human auditory system , 2006, The European journal of neuroscience.

[27]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[28]  R. Näätänen,et al.  Intermodal selective attention. II. Effects of attentional load on processing of auditory and visual stimuli in central space. , 1992, Electroencephalography and clinical neurophysiology.

[29]  Risto Näätänen,et al.  Temporal integration: intentional sound discrimination does not modulate stimulus-driven processes in auditory event synthesis , 2002, Clinical Neurophysiology.

[30]  I. Winkler,et al.  Independent processing of changes in auditory single features and feature conjunctions in humans as indexed by the mismatch negativity , 1999, Neuroscience Letters.

[31]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[32]  B. Scholl Objects and attention: the state of the art , 2001, Cognition.

[33]  R. Näätänen,et al.  Attention and mismatch negativity. , 1993, Psychophysiology.

[34]  D. Jeffreys,et al.  Source locations of pattern-specific components of human visual evoked potentials. I. Component of striate cortical origin , 2004, Experimental Brain Research.

[35]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[36]  F. Perrin,et al.  Separate Representation of Stimulus Frequency, Intensity, and Duration in Auditory Sensory Memory: An Event-Related Potential and Dipole-Model Analysis , 1995, Journal of Cognitive Neuroscience.

[37]  S. Hillyard,et al.  The effects of channel-selective attention on the mismatch negativity wave elicited by deviant tones. , 1991, Psychophysiology.

[38]  E. Yund,et al.  Dichotic competition of simultaneous tone bursts of different frequency. I. Dissociation of pitch from lateralization and loudness. , 1974, Neuropsychologia.

[39]  A. Treisman Visual Attention and the Perception of Features and Objects , 1994 .

[40]  G Mulder,et al.  Event-related potentials during memory search and selective attention to letter size and conjunctions of letter size and color. , 1989, Psychophysiology.

[41]  M Huotilainen,et al.  Changes in acoustic features and their conjunctions are processed by separate neuronal populations , 2001, Neuroreport.

[42]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[43]  J. Cutting Auditory and linguistic processes in speech perception: inferences from six fusions in dichotic listening. , 1976, Psychological review.

[44]  Charlotte Stagg,et al.  Visual mismatch negativity: the detection of stimulus change , 2004, Neuroreport.

[45]  D. Javitt,et al.  The Mismatch Negativity of Event‐Related Potentials as a Probe of Transient Auditory Memory: A Review , 1995, Ear and hearing.

[46]  C. L. M. The Psychology of Attention , 1890, Nature.

[47]  G. Murch Binocular relationships in a size and color orientation specific aftereffect. , 1972, Journal of experimental psychology.

[48]  I. Winkler,et al.  ‘Primitive intelligence’ in the auditory cortex , 2001, Trends in Neurosciences.

[49]  István Czigler,et al.  Visual temporal window of integration as revealed by the visual mismatch negativity event-related potential to stimulus omissions , 2006, Brain Research.

[50]  Refractor Vision , 2000, The Lancet.

[51]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[52]  István Czigler,et al.  Memory-based detection of task-irrelevant visual changes. , 2002, Psychophysiology.

[53]  E. William Yund,et al.  Dichotic competition of simultaneous tone bursts of different frequency—II. Suppression and ear dominance functions , 1975, Neuropsychologia.

[54]  C. F. Stromeyer,et al.  Form-Color Aftereffects in Human Vision , 1978 .

[55]  R. Rafal,et al.  5. Visual attention: converging operations from neurology and psychology , 1996 .

[56]  I. Winkler,et al.  Preattentive auditory context effects , 2003, Cognitive, affective & behavioral neuroscience.

[57]  M. Potter,et al.  Word selection in reading sentences: preceding versus following contexts. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[58]  Jeff Miller,et al.  Storage of feature conjunctions in transient auditory memory. , 1997, Psychophysiology.

[59]  G. Csibra,et al.  Event-related potentials and the identification of deviant visual stimuli. , 1992, Psychophysiology.

[60]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[61]  R Näätänen,et al.  Preattentive processing of spectral, temporal, and structural characteristics of acoustic regularities: a mismatch negativity study. , 2001, Psychophysiology.

[62]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[63]  K. Lehnertz,et al.  Neuromagnetic evidence of an amplitopic organization of the human auditory cortex. , 1989, Electroencephalography and clinical neurophysiology.

[64]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[65]  C. McCollough Color Adaptation of Edge-Detectors in the Human Visual System , 1965, Science.

[66]  E. Vogel,et al.  Electrophysiological Evidence for a Postperceptual Locus of Suppression during the Attentional Blink Time-based Attention and the Attentional Blink , 1998 .

[67]  J. Wolfe Inattentional Amnesia , 2000 .

[68]  R E Pastore,et al.  Evidence for auditory feature integration with spatially distributed items , 2000, Perception & psychophysics.

[69]  Harry S Orbach,et al.  Is there a mismatch negativity during change blindness? , 2006, Neuroreport.

[70]  I. Winkler,et al.  MMN and attention: competition for deviance detection. , 2003, Psychophysiology.

[71]  John Duncan,et al.  Restricted attentional capacity within but not between sensory modalities , 1997, Nature.

[72]  M D Hall,et al.  Illusory conjunctions of pitch and duration in unfamiliar tone sequences. , 2001, Journal of experimental psychology. Human perception and performance.

[73]  Janne Sinkkonen,et al.  The auditory transient 40‐Hz response is insensitive to changes in stimulus features , 1994, Neuroreport.

[74]  I. Winkler,et al.  Top-down effects can modify the initially stimulus-driven auditory organization. , 2002, Brain research. Cognitive brain research.

[75]  C Alain,et al.  Conjoining auditory and visual features during high-rate serial presentation: Processing and conjoining two features can be faster than processing one , 1998, Perception & psychophysics.

[76]  Joseph S. Gati,et al.  Perception of the Mccollough Effect Correlates with Activity in Extrastriate Cortex: A Functional Magnetic Resonance Imaging Study , 1999 .

[77]  I. Winkler,et al.  The concept of auditory stimulus representation in cognitive neuroscience. , 1999, Psychological bulletin.

[78]  W. Ritter,et al.  Feature conjunctions and auditory sensory memory , 1998, Brain Research.

[79]  T. Picton,et al.  The N1 wave of the human electric and magnetic response to sound: a review and an analysis of the component structure. , 1987, Psychophysiology.

[80]  E. Awh,et al.  Evidence for Two Components of Object-Based Selection , 2001, Psychological science.

[81]  Dirk J. Heslenfeld,et al.  Visual Mismatch Negativity. , 2003 .

[82]  A. Treisman,et al.  Visual memory for novel shapes: implicit coding without attention. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[83]  Daniel J. Simons,et al.  Inattentional blindness , 2007, Scholarpedia.

[84]  R. Rauh,et al.  Probability Distributions of Minkowski Distances between Discrete Random Variables , 1993 .

[85]  M. R. Houck,et al.  Conjunction of color and form without attention: evidence from an orientation-contingent color aftereffect. , 1986, Journal of experimental psychology. Human perception and performance.