Fundamental differences in change detection between vision and audition

We compared auditory change detection to visual change detection using closely matched stimuli and tasks in the two modalities. On each trial, participants were presented with a test stimulus consisting of ten elements: pure tones with various frequencies for audition, or dots with various spatial positions for vision. The test stimulus was preceded or followed by a probe stimulus consisting of a single element, and two change-detection tasks were performed. In the “present/absent” task, the probe either matched one randomly selected element of the test stimulus or none of them; participants reported present or absent. In the “direction-judgment” task, the probe was always slightly shifted relative to one randomly selected element of the test stimulus; participants reported the direction of the shift. Whereas visual performance was systematically better in the present/absent task than in the direction-judgment task, the opposite was true for auditory performance. Moreover, whereas visual performance was strongly dependent on selective attention and on the time interval separating the probe from the test stimulus, this was not the case for auditory performance. Our results show that small auditory changes can be detected automatically across relatively long temporal gaps, using an implicit memory system that seems to have no similar counterpart in the visual domain.

[1]  Virginia Best,et al.  Object continuity enhances selective auditory attention , 2008, Proceedings of the National Academy of Sciences.

[2]  M. Turatto,et al.  Change perception in complex auditory scenes , 2008, Perception & psychophysics.

[3]  Ronald A. Rensink,et al.  Change-blindness as a result of ‘mudsplashes’ , 1999, Nature.

[4]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[5]  Pierre L. Divenyi,et al.  Resolution of steady‐state sounds in simulated auditory space , 1989 .

[6]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[7]  W. Singer,et al.  Function and interaction of on and off transients in vision I. Psychophysics , 1974, Experimental Brain Research.

[8]  B. Moore An Introduction to the Psychology of Hearing , 1977 .

[9]  Daniel Pressnitzer,et al.  Tuning properties of the auditory frequency-shift detectors. , 2009, The Journal of the Acoustical Society of America.

[10]  Melissa K. Gregg,et al.  Change deafness and the organizational properties of sounds. , 2008, Journal of experimental psychology. Human perception and performance.

[11]  M. Shadlen,et al.  Microstimulation of visual cortex affects the speed of perceptual decisions , 2003, Nature Neuroscience.

[12]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[13]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[14]  W. Newsome,et al.  Motion selectivity in macaque visual cortex. I. Mechanisms of direction and speed selectivity in extrastriate area MT. , 1986, Journal of neurophysiology.

[15]  S. Shamma On the role of space and time in auditory processing , 2001, Trends in Cognitive Sciences.

[16]  Laurent Demany,et al.  On the binding of successive sounds: perceiving shifts in nonperceived pitches. , 2005, The Journal of the Acoustical Society of America.

[17]  I. Winkler,et al.  ‘Primitive intelligence’ in the auditory cortex , 2001, Trends in Neurosciences.

[18]  K. Reinikainen,et al.  Attentive novelty detection in humans is governed by pre-attentive sensory memory , 1994, Nature.

[19]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[20]  T. Griffiths,et al.  What is an auditory object? , 2004, Nature Reviews Neuroscience.

[21]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[22]  W. Singer,et al.  Function and interaction of on and off transients in vision II. Neurophysiology , 1974, Experimental Brain Research.

[23]  J. Downar,et al.  A multimodal cortical network for the detection of changes in the sensory environment , 2000, Nature Neuroscience.

[24]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[25]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[26]  P. Loui,et al.  Auditory Attention and Filters , 2008 .

[27]  B. Scholl Objects and attention: the state of the art , 2001, Cognition.

[28]  Ronald A. Rensink Change detection. , 2002, Annual review of psychology.

[29]  Dominic W. Massaro,et al.  Sensory and Perceptual Storage , 1996 .

[30]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[31]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[32]  Lars Muckli,et al.  Primary Visual Cortex Activity along the Apparent-Motion Trace Reflects Illusory Perception , 2005, PLoS biology.

[33]  Catherine Semal,et al.  The Role of Memory in Auditory Perception , 2008 .

[34]  Norman M. Weinberger,et al.  Responses of single auditory cortical neurons to tone sequences , 1989, Brain Research.

[35]  Michael S Vitevitch,et al.  Change deafness: the inability to detect changes between two voices. , 2003, Journal of experimental psychology. Human perception and performance.

[36]  C. Schreiner,et al.  Sequence sensitivity of neurons in cat primary auditory cortex. , 2000, Cerebral cortex.

[37]  J. D. Johnson,et al.  Attention and Memory , 1998 .

[38]  M. Kubovy,et al.  Auditory and visual objects , 2001, Cognition.

[39]  W. Newsome,et al.  Motion selectivity in macaque visual cortex. III. Psychophysics and physiology of apparent motion. , 1986, Journal of neurophysiology.

[40]  Jason B. Mattingley,et al.  Directed Attention Eliminates ‘Change Deafness’ in Complex Auditory Scenes , 2005, Current Biology.

[41]  S. Yantis,et al.  Stimulus-driven attentional capture: evidence from equiluminant visual objects. , 1994, Journal of experimental psychology. Human perception and performance.

[42]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[43]  T. Griffiths,et al.  Opinion: What is an auditory object? , 2004 .

[44]  C. Frith,et al.  Neural correlates of change detection and change blindness , 2001, Nature Neuroscience.

[45]  Michael J Kahana,et al.  Auditory Short-Term Memory Behaves Like Visual Short-Term Memory , 2007, PLoS biology.

[46]  D. E. Irwin,et al.  Our Eyes do Not Always Go Where we Want Them to Go: Capture of the Eyes by New Objects , 1998 .

[47]  L. Demany,et al.  An evaluation of psychophysical models of auditory change perception. , 2008, Psychological review.

[48]  Lew B. Stelmach,et al.  Detection of stimulus change: The hypothetical roles of visual transient responses , 1984, Perception & psychophysics.

[49]  D. Poeppel,et al.  Processing Asymmetry of Transitions between Order and Disorder in Human Auditory Cortex , 2007, The Journal of Neuroscience.

[50]  R. Fay,et al.  Auditory perception of sound sources , 2007 .

[51]  P. Cavanagh,et al.  The Spatial Resolution of Visual Attention , 2001, Cognitive Psychology.

[52]  E. Vogel,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Working Memory Represents a Fixed Number of Items Regardless of Complexity , 2022 .

[53]  L. Demany,et al.  Auditory Change Detection: Simple Sounds Are Not Memorized Better Than Complex Sounds , 2008, Psychological science.