Similarity and categorization of environmental sounds

Four experiments investigated the acoustical correlates of similarity and categorization judgments of environmental sounds. In Experiment 1, similarity ratings were obtained from pairwise comparisons of recordings of 50 environmental sounds. A three-dimensional multidimensional scaling (MDS) solution showed three distinct clusterings of the sounds, which included harmonic sounds, discrete impact sounds, and continuous sounds. Furthermore, sounds from similar sources tended to be in close proximity to each other in the MDS space. The orderings of the sounds on the individual dimensions of the solution were well predicted by linear combinations of acoustic variables, such as harmonicity, amount of silence, and modulation depth. The orderings of sounds also correlated significantly with MDS solutions for similarity ratings of imagined sounds and for imagined sources of sounds, obtained in Experiments 2 and 3—as was the case for free categorization of the 50 sounds (Experiment 4)—although the categorization data were less well predicted by acoustic features than were the similarity data.

[1]  P. E. Stopp Frequency analysis and periodicity detection in hearing 1971, Plomp and Smoorenburg (Editors). Leiden, Netherlands: Sijthoff Leiden. Cloth, Fl. 60 , 1971 .

[2]  E. Carterette,et al.  Perceptual space for musical structures. , 1974, The Journal of the Acoustical Society of America.

[3]  Gregory W. Cermak,et al.  Multidimensional analyses of judgments about traffic noise , 1976 .

[4]  E. B. Silverman,et al.  A multidimensional scaling analysis of 16 complex sounds , 1976 .

[5]  J. Grey,et al.  Perceptual evaluations of synthesized musical instrument tones , 1977 .

[6]  J. H. Howard,et al.  Psychophysical structure of eight complex underwater sounds. , 1977, The Journal of the Acoustical Society of America.

[7]  J. Grey Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.

[8]  Margaret Jean Intons-Pererson The role of loudness in auditory imagery , 1980 .

[9]  M. J. Intons-Peterson,et al.  The role of loudness in auditory imagery. , 1980, Memory & cognition.

[10]  D. Marr,et al.  Representation and recognition of the movements of shapes , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[11]  James H. Howard,et al.  Perception of Simulated Propeller Cavitation , 1983, Human factors.

[12]  K. Holyoak,et al.  Induction of category distributions: a framework for classification learning. , 1984, Journal of experimental psychology. Learning, memory, and cognition.

[13]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[14]  T. Houtgast,et al.  A review of the MTF concept in room acoustics and its use for estimating speech intelligibility in auditoria , 1985 .

[15]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[16]  Roger A. Kendall,et al.  Perceptual Scaling of Simultaneous Wind Instrument Timbres , 1991 .

[17]  Lawrence W. Barsalou,et al.  Deriving Categories to Achieve Goals , 1991 .

[18]  M. J. Sharps,et al.  Auditory imagery and free recall. , 1992, The Journal of general psychology.

[19]  M. J. Intons-Peterson,et al.  The role of pitch in auditory imagery. , 1992 .

[20]  William W. Gaver What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[21]  Stephen McAdams,et al.  Recognition of sound sources and events , 1993 .

[22]  J. Ballas Common factors in the identification of an assortment of brief everyday sounds. , 1993, Journal of experimental psychology. Human perception and performance.

[23]  M. Watkins,et al.  Similarity as an organising principle in short-term memory. , 1993, Memory.

[24]  C. Krumhansl,et al.  Isolating the dynamic attributes of musical timbre. , 1993, The Journal of the Acoustical Society of America.

[25]  Robert L. Goldstone The role of similarity in categorization: providing a groundwork , 1994, Cognition.

[26]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[27]  G. Soete,et al.  Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes , 1995, Psychological research.

[28]  S. Goldinger Words and voices: episodic traces in spoken word identification and recognition memory. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[29]  Terri L. Bonebright An investigation of data collection methods for auditory stimuli: Paired comparisons versus a computer sorting task , 1996 .

[30]  W. Loh,et al.  SPLIT SELECTION METHODS FOR CLASSIFICATION TREES , 1997 .

[31]  M. J. Sharps,et al.  Category superiority effects and the processing of auditory images. , 1998, The Journal of general psychology.

[32]  M. Marcell,et al.  Confrontation Naming of Environmental Sounds , 2000, Journal of clinical and experimental neuropsychology.

[33]  S. Lakatos A common perceptual space for harmonic and percussive timbres , 2000, Perception & psychophysics.

[34]  Terri L. Bonebright Perceptual structure of everyday sounds: A multidimensional scaling approach , 2001 .

[35]  On the Lack of Association between Basic Auditory Abilities, Speech Processing, and other Cognitive Skills , 2002 .

[36]  Susan Scollie,et al.  Stimulus set effects in the similarity ratings of unfamiliar complex sounds. , 2002, The Journal of the Acoustical Society of America.

[37]  Michael S. Lewicki,et al.  Efficient coding of natural sounds , 2002, Nature Neuroscience.

[38]  Charles S. Watson,et al.  The perceptual dimensionality of environmental sounds , 2003 .

[39]  J. Jenkins,et al.  Identifying the sources of environmental sounds with a varying number of spectral channels , 2003 .

[40]  R. Zatorre,et al.  Behavioral and neural correlates of perceived and imagined musical timbre , 2004, Neuropsychologia.

[41]  E. G. Heinemann A Quantitative Model for Pattern Recognition , 2004 .

[42]  Brian Gygi,et al.  Spectral-temporal factors in the identification of environmental sounds. , 2004, The Journal of the Acoustical Society of America.

[43]  Robert J. Zatorre,et al.  Mental Concerts: Musical Imagery and Auditory Cortex , 2005, Neuron.

[44]  S. McAdams,et al.  Acoustic correlates of timbre space dimensions: a confirmatory study using synthetic tones. , 2005, The Journal of the Acoustical Society of America.

[45]  D. Pisoni,et al.  Influence of voice similarity on talker discrimination in children with normal hearing and children with cochlear implants. , 2005, Journal of speech, language, and hearing research : JSLHR.

[46]  Brian Gygi,et al.  Individual differences in auditory abilities. , 2007, The Journal of the Acoustical Society of America.