Perceptual and Acoustical Features of Natural and Synthetic Orchestral Instrument Tones

Four experiments were conducted to explore the timbres of natural, continuant orchestral instruments with emulation based on sampling, frequency modulation ( FM) synthesis, and a hybrid consisting of sampling and synthesis techniques combined. Identification of instruments using verbal labels was significantly better for the natural and sampling- based signals than for either FM synthesis or the hybrid technique, a result also found for aural categorization. Perceptual scaling of timbral similarities demonstrated great consistency across a series of independent variables, including musical training, monophonic and stereo presentation, and long versus short signal durations. The first dimension of the classical multidimensional scaling (CMDS) solutions mapped onto long- time- average spectral centroid. The second dimension mapped onto a measure of spectral variability. Little evidence was found for the mapping of attack time or signal duration onto either dimension. A third dimension separated most natural instruments from their emulated counterparts. Experiments using verbal attribute ratings confirmed the correlation of spectral centroid, the first dimension of the perceptual space, and ratings of nasality; the second dimension correlated with spectral variability and modestly correlated with ratings of rich, brilliant, and tremulous. Mismatches of spectral distribution and variability resulted in poor emulations of the natural instruments. Results suggest that further study of centroid and time-variant psychophysical properties is warranted.

[1]  C. Krumhansl,et al.  Isolating the dynamic attributes of musical timbre. , 1993, The Journal of the Acoustical Society of America.

[2]  Gregory J. Sandell,et al.  Roles for Spectral Centroid and Other Factors in Determining "Blended" Instrument Pairings in Orchestration , 1995 .

[3]  R. Plomp,et al.  Effect of phase on the timbre of complex tones. , 1969, The Journal of the Acoustical Society of America.

[4]  Forrest W. Young,et al.  Introduction to Multidimensional Scaling: Theory, Methods, and Applications , 1981 .

[5]  M. Halle,et al.  Preliminaries to Speech Analysis: The Distinctive Features and Their Correlates , 1961 .

[6]  John M. Chowning,et al.  The Synthesis of Complex Audio Spectra by Means of Frequency Modulation , 1973 .

[7]  Edward C. Carterette,et al.  Verbal Attributes of Simultaneous Wind Instrument Timbres: I. von Bismarck's Adjectives , 1993 .

[8]  Roger A. Kendall,et al.  Perceptual Scaling of Simultaneous Wind Instrument Timbres , 1991 .

[9]  E. Carterette,et al.  Verbal Attributes of Simultaneous Wind Instrument Timbres: II. Adjectives Induced from Piston's "Orchestration" , 1993 .

[10]  Edward C. Carterette,et al.  Identification and blend of timbres as a basis for orchestration , 1993 .

[11]  Melville Clark,et al.  A Preliminary Experiment on the Perceptual Basis for Musical Instrument Families , 1964 .

[12]  John W. Gordon,et al.  Perception of Spectral Modifications on Orchestral Instrument Tones , 1978 .

[13]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[14]  Roger A. Kendall,et al.  The Communication of Musical Expression , 1990 .

[15]  J. W. Gordon The perceptual attack time of musical tones. , 1987, The Journal of the Acoustical Society of America.

[16]  Edward C. Carterette,et al.  Convergent methods in psychomusical research based on integrated, interactive computer control , 1992 .

[17]  P. E. Stopp Frequency analysis and periodicity detection in hearing 1971, Plomp and Smoorenburg (Editors). Leiden, Netherlands: Sijthoff Leiden. Cloth, Fl. 60 , 1971 .

[18]  J. F. Corso,et al.  Timbre Cues and the Identification of Musical Instruments , 1962 .

[19]  Roger A. Kendall,et al.  The role of acoustic signal partitions in listener categorization of musical phrases. , 1986 .

[20]  Reinier Plomp,et al.  Aspects of tone sensation , 1976 .

[21]  J. Kruskal Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[22]  David Wessel,et al.  Control of Phrasing and Articulation in Synthesis , 1987, ICMC.

[23]  G. Soete,et al.  Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes , 1995, Psychological research.

[24]  Melville Clark,et al.  Preliminary Experiments on the Aural Significance of Parts of Tones of Orchestral Instruments and on Choral Tones , 1963 .

[25]  J. Kruskal Nonmetric multidimensional scaling: A numerical method , 1964 .

[26]  Edward C. Carterette,et al.  Perceptual space for musical structures. , 1974, The Journal of the Acoustical Society of America.

[27]  L. Wedin,et al.  Dimension analysis of the perception of instrumental timbre. , 1972, Scandinavian journal of psychology.

[28]  M. Halle,et al.  Tenseness and laxness , 1962 .

[29]  Stephen McAdams,et al.  Caractérisation du timbre des sons complexes.II. Analyses acoustiques et quantification psychophysique , 1994 .

[30]  W. H. Lichte Attributes of complex tones. , 1941 .

[31]  G. Von Bismarck,et al.  Sharpness as an attribute of the timbre of steady sounds , 1974 .

[32]  J. Grey Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.