Auditory Representations of Timbre and Pitch

Pitch and timbre are terms developed to describe musical sounds. By convention, pitch is that perceptual property of a sound that can be used to play a melody, while timbre is a rather more vague perceptual property that distinguishes musical sounds of the same pitch. The pitch of an arbitrary sound is quantified as the frequency in hertz (Hz) of a sinusoid with perceptually matching pitch. Thus, one might say that pitch is a perceptual frequency, and timbre is almost everything else (but not including loudness, position, and perhaps a few other well-defined attributes). In general, a sound source achieves a perceptual unity through pitch, and encodes its identity primarily through timbre. For example, any instrument playing middle C will be heard as a sound source with a pitch of 262 Hz, but the timbre of the sound will tell us whether we are hearing a string excited by a bow, or a tube excited by reed, or a vibrating metal bar, or an electronically synthesized buzz.

[1]  Gerald Langner,et al.  Spatial representation of periodicity pitch in the human auditory cortex , 1993 .

[2]  D P Phillips,et al.  Responses of single neurons in posterior field of cat auditory cortex to tonal stimulation. , 1984, Journal of neurophysiology.

[3]  S A Shamma,et al.  Stereausis: binaural processing without neural delays. , 1989, The Journal of the Acoustical Society of America.

[4]  S. Shamma,et al.  Synchrony suppression in complex stimulus responses of a biophysical model of the cochlea. , 1987, The Journal of the Acoustical Society of America.

[5]  E G Wever,et al.  ACTION CURRENTS IN THE AUDITORY NERVE IN RESPONSE TO ACOUSTICAL STIMULATION. , 1930, Proceedings of the National Academy of Sciences of the United States of America.

[6]  N. Suga,et al.  Specificity of combination-sensitive neurons for processing of complex biosonar signals in auditory cortex of the mustached bat. , 1983, Journal of neurophysiology.

[7]  B. Moore An introduction to the psychology of hearing, 3rd ed. , 1989 .

[8]  B. L. Cardozo,et al.  Pitch of the Residue , 1962 .

[9]  M. Sachs,et al.  Encoding of steady-state vowels in the auditory nerve: representation in terms of discharge rate. , 1979, The Journal of the Acoustical Society of America.

[10]  Wolfgang Hess,et al.  Pitch Determination of Speech Signals , 1983 .

[11]  C. Schreiner,et al.  Periodicity coding in the inferior colliculus of the cat. II. Topographical organization. , 1988, Journal of neurophysiology.

[12]  J. Rinzel,et al.  A biophysical model of cochlear processing: intensity dependence of pure tone responses. , 1986, The Journal of the Acoustical Society of America.

[13]  Kuansan Wang,et al.  Modeling the auditory functions in the primary cortex , 1994, Defense, Security, and Sensing.

[14]  Reinier Plomp,et al.  Aspects of tone sensation , 1976 .

[15]  Ronald W. Schafer,et al.  Digital Processing of Speech Signals , 1978 .

[16]  Stephanie Seneff A joint synchrony/mean-rate model of auditory speech processing , 1990 .

[17]  Richard F. Lyon,et al.  A perceptual pitch detector , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[18]  Kuansan Wang,et al.  Auditory representations of acoustic signals , 1992, IEEE Trans. Inf. Theory.

[19]  N. Suga,et al.  Neural basis of amplitude-spectrum representation in auditory cortex of the mustached bat. , 1982, Journal of neurophysiology.

[20]  F. Wightman The pattern-transformation model of pitch. , 1973, The Journal of the Acoustical Society of America.

[21]  S. W. Beet,et al.  Visual representations of speech signals , 1993 .

[22]  Nobuo Suga,et al.  Neural mechanisms of complex-sound processing for echolocation , 1984, Trends in Neurosciences.

[23]  L. A. Westerman,et al.  Rapid and short-term adaptation in auditory nerve responses , 1984, Hearing Research.

[24]  S. Shamma Speech processing in the auditory system. II: Lateral inhibition and the central processing of speech evoked activity in the auditory nerve. , 1985, The Journal of the Acoustical Society of America.

[25]  Shihab A. Shamma Spatial and temporal processing in central auditory networks , 1989 .

[26]  M. Sanders Handbook of Sensory Physiology , 1975 .

[27]  M. Sachs,et al.  Representation of stop consonants in the discharge patterns of auditory-nerve fibers. , 1983, The Journal of the Acoustical Society of America.

[28]  J. L. Goldstein An optimum processor theory for the central formation of the pitch of complex tones. , 1973, The Journal of the Acoustical Society of America.

[29]  Eric Javel,et al.  Physiological and psychophysical correlates of temporal processes in hearing , 1988, Hearing Research.

[31]  C. Daniel Geisler,et al.  The Mechanics and Biophysics of Hearing , 1990 .

[32]  B. Moore An Introduction to the Psychology of Hearing , 1977 .

[33]  Steven Greenberg,et al.  Acoustic transduction in the auditory periphery , 1988 .

[34]  John Lazzaro,et al.  Analog VLSI model of binaural hearing , 1991, IEEE Trans. Neural Networks.

[35]  C E Schreiner,et al.  Functional topography of cat primary auditory cortex: distribution of integrated excitation. , 1990, Journal of neurophysiology.

[36]  William S. Rhode Cochlear partition vibration—Recent views , 1979 .

[37]  W. M. Siebert,et al.  Frequency discrimination in the auditory system: Place or periodicity mechanisms? , 1970 .

[38]  J. Smurzyński,et al.  Pitch identification and discrimination for complex tones with many harmonics , 1990 .

[39]  I. Whitfield,et al.  Auditory cortex and the pitch of complex tones. , 1980, The Journal of the Acoustical Society of America.

[40]  K. N. Stevens,et al.  Autocorrelation Analysis of Speech Sounds , 1950 .

[41]  A. Houtsma Musical pitch of two-tone complexes and predictions by modern pitch theories. , 1979, The Journal of the Acoustical Society of America.

[42]  D. H. Johnson,et al.  The relationship between spike rate and synchrony in responses of auditory-nerve fibers to single tones. , 1980, The Journal of the Acoustical Society of America.

[43]  S. Shamma Speech processing in the auditory system. I: The representation of speech sounds in the responses of the auditory nerve. , 1985, The Journal of the Acoustical Society of America.

[44]  G. Békésy,et al.  Experiments in Hearing , 1963 .

[45]  Peter Cariani,et al.  Coding of the Pitch of Harmonic and Inharmonic Complex Tones in the Interspike Intervals of Auditory-Nerve Fibers. , 1992 .

[46]  Alexander Joseph Book reviewDischarge patterns of single fibers in the cat's auditory nerve: Nelson Yuan-Sheng Kiang, with the assistance of Takeshi Watanabe, Eleanor C. Thomas and Louise F. Clark: Research Monograph no. 35. Cambridge, Mass., The M.I.T. Press, 1965 , 1967 .

[47]  Lloyd Guth,et al.  Repair of the mammalian spinal cord , 1983, Trends in Neurosciences.

[48]  B. Moore Frequency Selectivity in Hearing , 1987 .

[49]  Jonathan Ashmore,et al.  The ear's fast cellular motor , 1993, Current Biology.

[50]  Steven Greenberg,et al.  A Composite Model of the Auditory Periphery for the Processing of Speech (Invited) , 1988 .

[51]  Charles S. Watson,et al.  Auditory Processing of Complex Sounds , 1990 .

[52]  M. Puckette,et al.  Calculation of a "narrowed" autocorrelation function. , 1989, The Journal of the Acoustical Society of America.

[53]  John H. Casseday,et al.  Behavioral Studies of Auditory Discrimination: Central Nervous System , 1975 .

[54]  S. Shamma,et al.  Ripple Analysis in Ferret Primary Auditory Cortex. I. Response Characteristics of Single Units to Sinusoidally Rippled Spectra , 1994 .

[55]  M. Sachs,et al.  Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers. , 1979, The Journal of the Acoustical Society of America.

[56]  F. Wightman Pitch and stimulus fine structure. , 1973, The Journal of the Acoustical Society of America.

[57]  C. Schreiner,et al.  Representation of amplitude modulation in the auditory cortex of the cat. I. The anterior auditory field (AAF) , 1986, Hearing Research.

[58]  B. Delgutte Speech coding in the auditory nerve: II. Processing schemes for vowel-like sounds. , 1984, The Journal of the Acoustical Society of America.

[59]  Mario A. Ruggero,et al.  Two-tone distortion in the basilar membrane of the cochlea , 1991, Nature.

[60]  D. Schwarz,et al.  Spectral response patterns of auditory cortex neurons to harmonic complex tones in alert monkey (Macaca mulatta). , 1990, Journal of neurophysiology.

[61]  Gerald M. Edelman,et al.  Dynamic aspects of neocortical function , 1984 .

[62]  Kuansan Wang,et al.  Self-normalization and noise-robustness in early auditory representations , 1994, IEEE Trans. Speech Audio Process..

[63]  Shihab A. Shamma,et al.  Ripple Analysis in Ferret Primary Auditory Cortex. II. Topographic and Columnar Distribution of Ripple Response Parameters , 1994 .

[64]  Oded Ghitza,et al.  Temporal non-place information in the auditory-nerve firing patterns as a front-end for speech recognition in a noisy environment , 1988 .

[65]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[66]  G. S. Ohm Ueber die Definition des Tones, nebst daran geknüpfter Theorie der Sirene und ähnlicher tonbildender Vorrichtungen , 1843 .

[67]  Richard F. Lyon,et al.  On the importance of time—a temporal representation of sound , 1993 .

[68]  Shihab A. Shamma,et al.  Ripple Analysis in Ferret Primary Auditory Cortex. 3. Prediction of Unit Responses to Arbitrary Spectral Profiles , 1995 .

[69]  Ernst Terhardt,et al.  Calculating virtual pitch , 1979, Hearing Research.

[70]  S. Seneff A joint synchrony/mean-rate model of auditory processing , 1988 .

[71]  Richard F. Lyon A computational model of binaural localization and separation , 1983, ICASSP.

[72]  Richard F. Lyon,et al.  Automatic Gain Control in Cochlear Mechanics , 1990 .

[73]  S. Shamma,et al.  Organization of response areas in ferret primary auditory cortex. , 1993, Journal of neurophysiology.

[74]  R. Patterson,et al.  A pulse ribbon model of monaural phase perception. , 1987, The Journal of the Acoustical Society of America.

[75]  Floyd Ratliff,et al.  Studies on Excitation and Inhibition in the Retina , 1975 .

[76]  Gerald Langner,et al.  Periodicity coding in the auditory system , 1992, Hearing Research.

[77]  J Lazzaro,et al.  Silicon modeling of pitch perception. , 1989, Proceedings of the National Academy of Sciences of the United States of America.