The importance of semantics in auditory representations

The purpose of the present study was to examine the nature of auditory representations by manipulating the semantic and physical relationships between auditory objects. On each trial, listeners heard a group of four simultaneous sounds for 1 sec, followed by 350 msec of noise, and then either the same sounds or three of the same plus a new one. Listeners completed a change-detection task and an object-encoding task. For change detection, listeners made a same-different judgment for the two groups of sounds. Object encoding was measured by presenting probe sounds that either were or were not present in the two groups. In Experiments 1 and 3, changing the target to an object that was acoustically different from but semantically the same as the original target resulted in more errors on both tasks than when the target changed to an acoustically and semantically different object. In Experiment 2, comparison of semantic and acoustic effects demonstrated that acoustics provide a weaker cue than semantics for both change detection and object encoding. The results suggest that listeners rely more on semantic information than on physical detail.)

[1]  R. Carlyon.  How the brain separates sounds , 2004, Trends in Cognitive Sciences.

[2]  David E. Irwin,et al.  The role of physical and conceptual properties in preserving object continuity. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[3]  David E. Irwin,et al.  What’s in an object file? Evidence from priming studies , 1996, Perception & psychophysics.

[4]  Timothy F. Brady,et al.  PSYCHOLOGICAL SCIENCE Research Article Statistical Learning Using Real-World Scenes Extracting Categorical Regularities Without Conscious Intent , 2022 .

[5]  Jason B. Mattingley,et al.  Directed Attention Eliminates ‘Change Deafness’ in Complex Auditory Scenes , 2005, Current Biology.

[6]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[7]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[8]  A G Samuel,et al.  More adaptation of speech by nonspeech. , 1984, Journal of experimental psychology. Human perception and performance.

[9]  Ronald A. Rensink,et al.  Change-blindness as a result of ‘mudsplashes’ , 1999, Nature.

[10]  D. Simons,et al.  Failure to detect changes to people during a real-world interaction , 1998 .

[11]  E. C. Cherry.  Some Experiments on the Recognition of Speech, with One and with Two Ears , 1953 .

[12]  J. Henderson,et al.  Incidental visual memory for objects in scenes , 2005 .

[13]  A Pollatsek,et al.  Role of spatial location in integration of pictorial information across saccades. , 1990, Journal of experimental psychology. Human perception and performance.

[14]  Pascal Barone,et al.  Physiology of Thalamus and Cortex , 1992 .

[15]  A S Bregman,et al.  Stream segregation and the illusion of overlap. , 1976, Journal of experimental psychology. Human perception and performance.

[16]  A. Treisman.  Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[17]  Melissa K. Gregg,et al.  Change deafness and the organizational properties of sounds. , 2008, Journal of experimental psychology. Human perception and performance.

[18]  Carrick C. Williams,et al.  To see and remember: Visually specific information is retained in memory from previously attended objects in natural scenes , 2001, Psychonomic bulletin & review.

[19]  Elissa L. Newport,et al.  Adaptation of speech by nonspeech: evidence for complex acoustic cue detectors. , 1979 .

[20]  J. Henderson,et al.  Two representational systems in dynamic visual identification. , 1994, Journal of experimental psychology. General.

[21]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[22]  A. Treisman.  Perceiving and re-perceiving objects. , 1992, The American psychologist.

[23]  Brian Gygi,et al.  Similarity and categorization of environmental sounds , 2007, Perception & psychophysics.

[24]  A. Hollingworth.  Failures of retrieval and comparison constrain change detection in natural scenes. , 2003, Journal of experimental psychology. Human perception and performance.

[25]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[26]  Ronald A. Rensink,et al.  Picture Changes During Blinks: Looking Without Seeing and Seeing Without Looking , 2000 .

[27]  L. V. Noorden.  Temporal coherence in the perception of tone sequences , 1975 .

[28]  J. Grimes.  On the failure to detect changes in scenes across saccades. , 1996 .

[29]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[30]  J. M. Ackroff,et al.  Auditory Induction: Perceptual Synthesis of Absent Sounds , 1972, Science.

[31]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[32]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[33]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[34]  A. Treisman.  Contextual Cues in Selective Listening , 1960 .

[35]  Michael S. Ambinder,et al.  Change blindness , 1997, Trends in Cognitive Sciences.

[36]  W. E. Collins,et al.  Integrating pictorial information across eye movements. , 1984, Journal of experimental psychology. General.

[37]  Michael S Vitevitch,et al.  Change deafness: the inability to detect changes between two voices. , 2003, Journal of experimental psychology. Human perception and performance.

[38]  C. Chabris,et al.  Gorillas in Our Midst: Sustained Inattentional Blindness for Dynamic Events , 1999, Perception.

[39]  Brian Gygi,et al.  How to select stimuli for environmental sound research and where to find them , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[40]  Stephen R Mitroff,et al.  Nothing compares 2 views: Change blindness can occur despite preserved access to the changed information , 2004, Perception & psychophysics.