The Semantics of Timbre

Because humans lack a sensory vocabulary for auditory experiences, timbral qualities of sounds are often conceptualized and communicated through readily available sensory attributes from different modalities (e.g., bright, warm, sweet) but also through the use of onomatopoeic attributes (e.g., ringing, buzzing, shrill) or nonsensory attributes relating to abstract constructs (e.g., rich, complex, harsh). The analysis of the linguistic description of timbre, or timbre semantics, can be considered as one way to study its perceptual representation empirically. In the most commonly adopted approach, timbre is considered as a set of verbally defined perceptual attributes that represent the dimensions of a semantic timbre space. Previous studies have identified three salient semantic dimensions for timbre along with related acoustic properties. Comparisons with similarity-based multidimensional models confirm the strong link between perceiving timbre and talking about it. Still, the cognitive and neural mechanisms of timbre semantics remain largely unknown and underexplored, especially when one looks beyond the case of acoustic musical instruments.

[1]  P. Walker Cross-sensory correspondences: A Theoretical framework and their relevance to music , 2016 .

[2]  Richard Kronland-Martinet,et al.  Exploring the perceived harshness of cello sounds by morphing and synthesis techniques. , 2017, The Journal of the Acoustical Society of America.

[3]  Dale Purves,et al.  Vocal similarity predicts the relative attraction of musical chords , 2017, Proceedings of the National Academy of Sciences.

[4]  Guillaume Lemaitre,et al.  Listener expertise and sound identification influence the categorization of environmental sounds. , 2010, Journal of experimental psychology. Applied.

[5]  J. Sundberg Perception of Singing , 2013 .

[6]  Martin Thiering Spatial Semiotics and Spatial Mental Models: Figure-Ground Asymmetries in Language , 2014 .

[7]  G. J. Rich,et al.  A preliminary study of tonal volume. , 1916 .

[8]  P. Laukka,et al.  Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening , 2004 .

[9]  Edmund A. Bowles Haut and Bas; The Grouping of Musical Instruments in the Middle Ages , 2017 .

[10]  A. Majid,et al.  The Thickness of Musical Pitch , 2013, Psychological science.

[11]  Christoph Reuter,et al.  Karl Erich Schumann's Principles of Timbre as a Helpful Tool in Stream Segregation Research , 1996, Joint International Conference on Cognitive and Systematic Musicology.

[12]  Jürgen Meyer,et al.  ACOUSTICS AND THE PERFORMANCE OF MUSIC , 2024, Spring Conference 1981.

[13]  Stephen McAdams,et al.  The role of spectral-envelope characteristics in perceptual blending of wind-instrument sounds , 2015 .

[14]  P. E. Doak,et al.  A subjective rating scale for timbre , 1976 .

[15]  Vinoo Alluri,et al.  Exploring Perceptual and Acoustical Correlates of Polyphonic Timbre , 2010 .

[16]  Emily I. Dolan The Orchestral Revolution: Haydn and the Technologies of Timbre , 2013 .

[17]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[18]  Denis Smalley,et al.  Spectromorphology: explaining sound-shapes , 1997, Organised Sound.

[19]  Edward C. Carterette,et al.  Verbal Attributes of Simultaneous Wind Instrument Timbres: I. von Bismarck's Adjectives , 1993 .

[20]  Jan Berg,et al.  Modelling perceptual dimensions of saxophone sounds , 2009 .

[21]  G. Lakoff,et al.  Metaphors We Live By , 1980 .

[22]  C. Osgood The nature and measurement of meaning. , 1952, Psychological bulletin.

[23]  Robert Bell,et al.  PAL: the percussive audio lexicon. An approach to describing the features of percussion instruments and the sounds they produce , 2015 .

[24]  G. Von Bismarck,et al.  Sharpness as an attribute of the timbre of steady sounds , 1974 .

[25]  S. S. Stevens,et al.  The quantification of tonal volume. , 1962, The American journal of psychology.

[26]  Liberty S. Hamilton,et al.  Acoustic structure of the five perceptual dimensions of timbre in orchestral instrument tones. , 2013, The Journal of the Acoustical Society of America.

[27]  Julia Kursell Experiments on Tone Color in Music and Acoustics: Helmholtz, Schoenberg, and Klangfarbenmelodie , 2013, Osiris.

[28]  Joshua D. Reiss,et al.  An Interlanguage Unification of Musical Timbre: Bridging Semantic, Perceptual, and Acoustic Dimensions , 2015 .

[29]  D. M. de Ceuster The Phenomenological Space of Timbre , 2016 .

[30]  Andrew J. Hunt,et al.  Timbral description of musical instruments , 2006 .

[31]  D. Pressnitzer,et al.  What is a melody? On the relationship between pitch and brightness of timbre , 2014, Front. Syst. Neurosci..

[32]  Zohar Eitan,et al.  How music touches: Musical parameters and listeners’ audio-tactile metaphorical mappings , 2011 .

[33]  Brian C J Moore,et al.  Exploring violin sound quality: investigating English timbre descriptors and correlating resynthesized acoustical modifications with perceptual properties. , 2012, The Journal of the Acoustical Society of America.

[34]  Edward C. Carterette,et al.  Perceptual and Acoustical Features of Natural and Synthetic Orchestral Instrument Tones , 1999 .

[35]  Michael Vorländer,et al.  Room Acoustical Parameters as Predictors of Room Acoustical Impression: What Do We Know and What Would We Like to Know? , 2015 .

[36]  Danièle Dubois,et al.  Characterisation of Voice Quality in Western Lyrical Singing: from Teachers' Judgements to Acoustic Descriptions , 2007 .

[37]  Zachary Wallmark Appraising Timbre: Embodiment and Affect at the Threshold of Music and Noise , 2014 .

[38]  Elena Samoylenko,et al.  Systematic Analysis of Verbalizations Produced in Comparing Musical Timbres , 1996 .

[39]  Steffen Lepa,et al.  Sound power and timbre as cues for the dynamic strength of orchestral instruments. , 2018, The Journal of the Acoustical Society of America.

[40]  Toshiyuki Asahi,et al.  Sound retrieval with intuitive verbal expressions , 1998 .

[41]  Caroline Traube An interdisciplinary study of the timbre of the classical guitar , 2004 .

[42]  N. Isshiki,et al.  Differential diagnosis of hoarseness. , 1969, Folia phoniatrica.

[43]  L E Marks,et al.  Interaction among auditory dimensions: Timbre, pitch, and loudness , 1990, Perception & psychophysics.

[44]  Gary P. Scavone,et al.  Effect of task constraints on the perceptual evaluation of violins , 2015 .

[45]  Josh H. McDermott,et al.  Individual Differences Reveal the Basis of Consonance , 2010, Current Biology.

[46]  Tapio Lokki,et al.  Concert hall acoustics: Repertoire, listening position, and individual taste of the listeners influence the qualitative attributes and preferences. , 2016, The Journal of the Acoustical Society of America.

[47]  S McAdams,et al.  Two phase effects in roughness perception. , 1999, The Journal of the Acoustical Society of America.

[48]  S. Koelsch Towards a neural basis of processing musical semantics. , 2011, Physics of life reviews.

[49]  M. Reybrouck From Sound to Music: An Evolutionary Approach to Musical Semantics , 2013, Biosemiotics.

[50]  Shin-ichiro Iwamiya,et al.  A comparison between Japanese and Chinese adjectives which express auditory impressions , 1997 .

[51]  L. N. Solomon Semantic Approach to the Perception of Complex Sounds , 1958 .

[52]  S. Weinzierl,et al.  A measuring instrument for the auditory perception of rooms: The Room Acoustical Quality Inventory (RAQI). , 2018, The Journal of the Acoustical Society of America.

[53]  W. H. Lichte Attributes of complex tones. , 1941 .

[54]  David R. Heise,et al.  Some methodological issues in semantic differential research. , 1969 .

[55]  Pantelis N. Vassilakis,et al.  Psychoacoustic and cognitive aspects of auditory roughness: definitions, models, and applications , 2010, Electronic Imaging.

[56]  R. M. Edwards The perception of trombones , 1978 .

[57]  G. Soete,et al.  Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes , 1995, Psychological research.

[58]  Albrecht Schneider,et al.  "Verschmelzung", Tonal Fusion, and Consonance: Carl Stumpf Revisited , 1996, Joint International Conference on Cognitive and Systematic Musicology.

[59]  Vinoo Alluri,et al.  Effect of Enculturation on the Semantic and Acoustic Correlates of Polyphonic Timbre , 2012 .

[60]  S S Stevens,et al.  The Nature of Tonal Brightness. , 1936, Proceedings of the National Academy of Sciences of the United States of America.

[61]  Daniel Västfjäll,et al.  Analyses of Verbal Descriptions of the Sound Quality of a Flue Organ Pipe , 2001 .

[62]  William Brent Physical and perceptual aspects of percussive timbre , 2010 .

[63]  Stephen McAdams,et al.  Koechlin’s volume: Perception of sound extensity among instrument timbres from different families , 2017 .

[64]  Joe Wolfe,et al.  Brightness scaling of periodic tones , 2017, Attention, perception & psychophysics.

[65]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[66]  Catherine Guastavino,et al.  Perceptual evaluation of violins: A psycholinguistic analysis of preference verbal descriptions by experienced musicians. , 2017, The Journal of the Acoustical Society of America.

[67]  Thomas Porcello,et al.  Speaking of Sound , 2004 .

[68]  Jim Woodhouse,et al.  APERIODICITY IN BOWED-STRING MOTION , 1981 .

[69]  A. de Cheveigné,et al.  The effect of fundamental frequency on the brightness dimension of timbre. , 2007, Journal of the Acoustical Society of America.

[70]  Helmut Haas,et al.  The Influence of a Single Echo on the Audibility of Speech , 1972 .

[71]  Joshua D. Reiss,et al.  An Interlanguage Study of Musical Timbre Semantic Dimensions and Their Acoustic Correlates , 2014 .

[72]  D. Dubois Categories as Acts of Meaning: The Case of Categories in Olfaction and Audition , 1999 .

[73]  Zachary Wallmark A corpus analysis of timbre semantics in orchestration treatises , 2019 .

[74]  Hanna Järveläinen,et al.  The Role of Haptic Cues in Musical Instrument Quality Perception , 2018 .

[75]  Roger A. Kendall,et al.  Verbal Attributes of Simultaneous Wind Instrument Timbres: II. Adjectives Induced from Piston's "Orchestration" , 1993 .

[76]  S. S. Stevens,et al.  LOUDNESS, A PRODUCT OF VOLUME TIMES DENSITY. , 1965, Journal of experimental psychology.

[77]  J. M. Bowsher,et al.  The subjective assessment of trombone quality , 1978 .

[78]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[79]  S. Kirby,et al.  What Sound Does That Taste? Cross-Modal Mappings across Gustation and Audition , 2010, Perception.

[80]  The timbre of sung vowels. , 1988, The Journal of the Acoustical Society of America.