Change perception in complex auditory scenes

In four experiments, we examined the role of auditory transients and auditory short-term memory in perceiving changes in a complex auditory scene comprising multiple auditory objects. Participants were presented pairs of complex auditory scenes that were composed of a maximum of four animal calls delivered in free field; participants were instructed to decide whether the two scenes were the same or different (Experiments 1, 2, and 4). Changes to the second scene consisted of either the addition or the deletion of one animal call. Contrary to intuitive predictions based on results from the visual change blindness literature, substantial deafness to the change emerged without regard to whether the scenes were separated by 500 msec of masking white noise or by 500 msec of silence (Experiment 1). In fact, change deafness was not even modulated by having the two scenes presented contiguously (i.e., 0-msec interval) or separated by 500 msec of silence (Experiments 2 and 4). This result suggests that change-related auditory transients played little or no role in change detection in complex auditory scenes. Instead, the main determinant of auditory change perception (and auditory change deafness) appears to have been the capacity of auditory short-term memory (Experiments 3 and 4). Taken together, these findings indicate that the intuitive parallels between visual and auditory change perception should be reconsidered.

[1]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[2]  Michael T. Turvey,et al.  An auditory analogue of the sperling partial report procedure: Evidence for brief auditory storage , 1972 .

[3]  A B Rostron,et al.  Brief auditory storage: a modification of Sperling's paradigm applied to audition. , 1972, Acta psychologica.

[4]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[5]  B G Breitmeyer,et al.  Implications of sustained and transient channels for theories of visual pattern masking, saccadic suppression, and information processing. , 1976, Psychological review.

[6]  J. Jonides Voluntary versus automatic control over the mind's eye's movement , 1981 .

[7]  N. Cowan On short and long auditory stores. , 1984, Psychological bulletin.

[8]  E. Hearst,et al.  Detecting and identifying change: additions versus deletions. , 1986, Journal of experimental psychology. Human perception and performance.

[9]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[10]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[11]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[12]  H. Heffner,et al.  Visual factors in sound localization in mammals , 1992, The Journal of comparative neurology.

[13]  Jon Driver,et al.  Covert Spatial Orienting in Audition: Exogenous and Endogenous Mechanisms , 1994 .

[14]  N. Cowan Attention and Memory: An Integrated Framework , 1995 .

[15]  Ronald A. Rensink,et al.  The Need for Attention to See Changes in Scenes (特集:インフォメ-ションセ-フティ) , 1997 .

[16]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[17]  D. Simons,et al.  CHAPTER 13 – Change Blindness , 2005 .

[18]  J. Driver,et al.  Audiovisual links in exogenous covert spatial orienting , 1997, Perception & psychophysics.

[19]  I. Rock,et al.  Inattentional blindness: Perception without attention. , 1998 .

[20]  W. Ritter,et al.  Attention affects the organization of auditory input associated with the mismatch negativity system , 1998, Brain Research.

[21]  Ronald A. Rensink,et al.  Change-blindness as a result of ‘mudsplashes’ , 1999, Nature.

[22]  Ronald A. Rensink,et al.  Picture Changes During Blinks: Looking Without Seeing and Seeing Without Looking , 2000 .

[23]  Veronika Coltheart,et al.  Detection and Identification of Change in Naturalistic Scenes , 2000 .

[24]  S. Molholm,et al.  Evidence that the mismatch negativity system works on the basis of objects , 2000, Neuroreport.

[25]  Ronald A. Rensink Visual Search for Change: A Probe into the Nature of Attentional Processing , 2000 .

[26]  I. Thornton,et al.  An implicit measure of undetected change. , 2000, Spatial vision.

[27]  I. Winkler,et al.  ‘Primitive intelligence’ in the auditory cortex , 2001, Trends in Neurosciences.

[28]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[29]  M. Kubovy,et al.  Auditory and visual objects , 2001, Cognition.

[30]  Ronald A. Rensink Change detection. , 2002, Annual review of psychology.

[31]  Bruce Bridgeman,et al.  Perceptual conditions necessary to induce change blindness , 2003 .

[32]  Ian M Thornton,et al.  Explicit mechanisms do not account for implicit localization and identification of change: An empirical reply to Mitroff et al. (2002). , 2002, Journal of experimental psychology. Human perception and performance.

[33]  I. Winkler,et al.  Preattentive auditory context effects , 2003, Cognitive, affective & behavioral neuroscience.

[34]  Claude Alain,et al.  Effects of Attentional Load on Auditory Scene Analysis , 2003, Journal of Cognitive Neuroscience.

[35]  Dylan M. Jones,et al.  Does auditory streaming require attention? Evidence from attentional selectivity in short-term memory. , 2003, Journal of experimental psychology. Human perception and performance.

[36]  Michael S Vitevitch,et al.  Change deafness: the inability to detect changes between two voices. , 2003, Journal of experimental psychology. Human perception and performance.

[37]  T. Griffiths,et al.  What is an auditory object? , 2004, Nature Reviews Neuroscience.

[38]  C. Spence,et al.  Exogenous spatial cuing studies of human crossmodal attention and multisensory integration , 2004 .

[39]  B. Bridgeman,et al.  Change perception using visual transients: object substitution and deletion , 2005, Experimental Brain Research.

[40]  Elyse S Sussman,et al.  Integration and segregation in auditory scene analysis. , 2005, The Journal of the Acoustical Society of America.

[41]  E. Sussman,et al.  Organization of sequential sounds in auditory memory , 2005, Neuroreport.

[42]  Jason B. Mattingley,et al.  Directed Attention Eliminates ‘Change Deafness’ in Complex Auditory Scenes , 2005, Current Biology.

[43]  Axel Cleeremans,et al.  Implicit change identification: a replication of Fernandez-Duque and Thornton (2003). , 2006, Journal of experimental psychology. Human perception and performance.

[44]  Hong Z. Tan,et al.  When visual transients impair tactile change detection: A novel case of crossmodal change blindness? , 2006, Neuroscience Letters.

[45]  C. Spence,et al.  The failure to detect tactile change: A tactile analogue of visual change blindness , 2006, Psychonomic bulletin & review.

[46]  C. Umilta,et al.  How automatic are audiovisual links in exogenous spatial attention? , 2007, Neuropsychologia.

[47]  C. Spence,et al.  The suppression of reflexive visual and auditory orienting when attention is otherwise engaged. , 2007, Journal of experimental psychology. Human perception and performance.

[48]  Charles Spence,et al.  Do “mudsplashes” induce tactile change blindness? , 2007, Perception & psychophysics.

[49]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.