Behavioral / Systems / Cognitive Spatiotemporal Representation of the Pitch of Harmonic Complex Tones in the Auditory Nerve

The pitch of harmonic complex tones plays an important role in speech and music perception and the analysis of auditory scenes, yet traditional rate–place and temporal models for pitch processing provide only an incomplete description of the psychophysical data. To test physiologically a model based on spatiotemporal pitch cues created by the cochlear traveling wave (Shamma, 1985), we recorded from single fibers in the auditory nerve of anesthetized cat in response to harmonic complex tones with missing fundamentals and equal-amplitude harmonics. We used the principle of scaling invariance in cochlear mechanics to infer the spatiotemporal response pattern to a given stimulus from a series of measurements made in a single fiber as a function of fundamental frequency F0. We found that spatiotemporal cues to resolved harmonics are available for F0 values between 350 and 1100 Hz and that these cues are more robust than traditional rate–place cues at high stimulus levels. The lower F0 limit is determined by the limited frequency selectivity of the cochlea, whereas the upper limit is caused by the degradation of phase locking to the stimulus fine structure at high frequencies. The spatiotemporal representation is consistent with the upper F0 limit to the perception of the pitch of complex tones with a missing fundamental, and its effectiveness does not depend on the relative phase between resolved harmonics. The spatiotemporal representation is thus consistent with key trends in human psychophysics.

[1]  M. Liberman,et al.  Auditory-nerve response from cats raised in a low-noise chamber. , 1978, The Journal of the Acoustical Society of America.

[2]  A R Palmer,et al.  The representation of the spectra and fundamental frequencies of steady-state single- and double-vowel sounds in the temporal discharge patterns of guinea pig cochlear-nerve fibers. , 1990, The Journal of the Acoustical Society of America.

[3]  R. Carlyon Comments on "A unitary model of pitch perception" [J. Acoust. Soc. Am. 102, 1811-1820 (1997)]. , 1998, The Journal of the Acoustical Society of America.

[4]  W. Shofner,et al.  Responses of cochlear nucleus units in the chinchilla to iterated rippled noises: analysis of neural autocorrelograms. , 1999, Journal of neurophysiology.

[5]  Bertrand Delgutte,et al.  Phase-locking of auditory-nerve discharges to sinusoidal electric stimulation of the cochlea , 1992, Hearing Research.

[6]  Philip X Joris,et al.  Panoramic Measurements of the Apex of the Cochlea , 2006, The Journal of Neuroscience.

[7]  Laurel H. Carney,et al.  Auditory Phase Opponency: A Temporal Model for Masked Detection at Low Frequencies , 2002 .

[8]  Alain de Cheveigné,et al.  Pitch perception models , 2005 .

[9]  Laurel H. Carney,et al.  Spatiotemporal encoding of sound level: Models for normal encoding and recruitment of loudness , 1994, Hearing Research.

[10]  I. Winter,et al.  Ambiguous Pitch and the Temporal Representation of Inharmonic Iterated Rippled Noise in the Ventral Cochlear Nucleus , 2008, The Journal of Neuroscience.

[11]  G E Loeb,et al.  Spatial cross-correlation , 1983, Biological Cybernetics.

[12]  Gerald Langner,et al.  Periodicity coding in the auditory system , 1992, Hearing Research.

[13]  D. O. Kim,et al.  Cochlear nerve fiber responses: distribution along the cochlear partition. , 1975, The Journal of the Acoustical Society of America.

[14]  S Shamma,et al.  The case of the missing pitch templates: how harmonic templates emerge in the early auditory system. , 2000, The Journal of the Acoustical Society of America.

[15]  L. Robles,et al.  Mechanics of the mammalian cochlea. , 2001, Physiological reviews.

[16]  D. Bendor,et al.  The neuronal representation of pitch in primate auditory cortex , 2005, Nature.

[17]  Robert K Shepherd,et al.  Electrical stimulation of the auditory nerve. I. Correlation of physiological responses with cochlear status , 1997, Hearing Research.

[18]  I. Winter,et al.  Temporal representation of iterated rippled noise as a function of delay and sound level in the ventral cochlear nucleus. , 2001, Journal of neurophysiology.

[19]  R. Meddis,et al.  Virtual pitch and phase sensitivity of a computer model of the auditory periphery. II: Phase sensitivity , 1991 .

[20]  W. S. Rhode Interspike intervals as a correlate of periodicity pitch in cat cochlear nucleus. , 1995, The Journal of the Acoustical Society of America.

[21]  Robert V. Shannon,et al.  Multichannel electrical stimulation of the auditory nerve in man. II. Channel interaction , 1983, Hearing Research.

[22]  B. Delgutte,et al.  Pitch of complex tones: rate-place and interspike interval representations in the auditory nerve. , 2005, Journal of neurophysiology.

[23]  B. L. Cardozo,et al.  Pitch of the Residue , 1962 .

[24]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. II. Pitch shift, pitch ambiguity, phase invariance, pitch circularity, rate pitch, and the dominance region for pitch. , 1996, Journal of neurophysiology.

[25]  I. Whitfield Discharge Patterns of Single Fibers in the Cat's Auditory Nerve , 1966 .

[26]  Robert K. Shepherd,et al.  Electrical stimulation of the auditory nerve III. Response initiation sites and temporal fine structure , 2000, Hearing Research.

[27]  R. Shannon Multichannel electrical stimulation of the auditory nerve in man. I. Basic psychophysics , 1983, Hearing Research.

[28]  S Grossberg,et al.  A spectral network model of pitch perception. , 1995, The Journal of the Acoustical Society of America.

[29]  M. Sachs,et al.  Encoding of steady-state vowels in the auditory nerve: representation in terms of discharge rate. , 1979, The Journal of the Acoustical Society of America.

[30]  L. Carney,et al.  A phenomenological model for the responses of auditory-nerve fibers: I. Nonlinear tuning with compression and suppression. , 2001, The Journal of the Acoustical Society of America.

[31]  Mario A Ruggero,et al.  Unexceptional sharpness of frequency tuning in the human cochlea. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[32]  B. Moore Some Experiments Relating to the Perception of Complex Tones , 1973, The Quarterly journal of experimental psychology.

[33]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[34]  J. E. Rose,et al.  Temporal position of discharges in single auditory nerve fibers within the cycle of a sine-wave stimulus: frequency and intensity effects. , 1971, The Journal of the Acoustical Society of America.

[35]  J. Smurzyński,et al.  Pitch identification and discrimination for complex tones with many harmonics , 1990 .

[36]  E. Javel Coding of AM tones in the chinchilla auditory nerve: implications for the pitch of complex tones. , 1980, The Journal of the Acoustical Society of America.

[37]  J S Buchwald,et al.  Vocalization in the cat and kitten. , 1978, Developmental psychobiology.

[38]  D. Caspary,et al.  Inhibitory inputs modulate discharge rate within frequency receptive fields of anteroventral cochlear nucleus neurons. , 1994, Journal of neurophysiology.

[39]  J. E. Rose,et al.  Some effects of stimulus intensity on response of auditory nerve fibers in the squirrel monkey. , 1971, Journal of neurophysiology.

[40]  Alan R. Palmer,et al.  Variation in the Phase of Response to Low-Frequency Pure Tones in the Guinea Pig Auditory Nerve as Functions of Stimulus Level and Frequency , 2008, Journal of the Association for Research in Otolaryngology.

[41]  F. Wightman The pattern-transformation model of pitch. , 1973, The Journal of the Acoustical Society of America.

[42]  R. Carlyon,et al.  Comparing the fundamental frequencies of resolved and unresolved harmonics: Evidence for two pitch mechanisms? , 1994 .

[43]  F B Simmons,et al.  Electrical stimulation of the auditory nerve in man. , 1966, Archives of otolaryngology.

[44]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. I. Pitch and pitch salience. , 1996, Journal of neurophysiology.

[45]  R. Fay,et al.  Speech Processing in the Auditory System , 2010, Springer Handbook of Auditory Research.

[46]  Christopher A Shera,et al.  Stimulus-frequency-emission group delay: a test of coherent reflection filtering and a window on cochlear tuning. , 2003, The Journal of the Acoustical Society of America.

[47]  N. Kiang,et al.  Tails of tuning curves of auditory-nerve fibers. , 1973, The Journal of the Acoustical Society of America.

[48]  Christopher A Shera,et al.  Revised estimates of human cochlear tuning from otoacoustic and behavioral measurements , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[49]  W. S. Rhode,et al.  Physiological studies on neurons in the dorsal cochlear nucleus of cat. , 1986, Journal of neurophysiology.

[50]  R. Meddis,et al.  A unitary model of pitch perception. , 1997, The Journal of the Acoustical Society of America.

[51]  D. H. Johnson,et al.  The relationship between spike rate and synchrony in responses of auditory-nerve fibers to single tones. , 1980, The Journal of the Acoustical Society of America.

[52]  L H Carney,et al.  Enhancement of neural synchronization in the anteroventral cochlear nucleus. I. Responses to tones at the characteristic frequency. , 1994, Journal of neurophysiology.

[53]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[54]  Andrew J Oxenham,et al.  An autocorrelation model with place dependence to account for the effect of harmonic number on fundamental frequency discrimination. , 2005, The Journal of the Acoustical Society of America.

[55]  Alexander Joseph Book reviewDischarge patterns of single fibers in the cat's auditory nerve: Nelson Yuan-Sheng Kiang, with the assistance of Takeshi Watanabe, Eleanor C. Thomas and Louise F. Clark: Research Monograph no. 35. Cambridge, Mass., The M.I.T. Press, 1965 , 1967 .

[56]  Andrew J. Oxenham,et al.  Estimates of Human Cochlear Tuning at Low Levels Using Forward and Simultaneous Masking , 2003, Journal of the Association for Research in Otolaryngology.

[57]  R. Patterson,et al.  The temporal representation of the delay of iterated rippled noise in the ventral cochlear nucleus of the guinea‐pig , 2001, The Journal of physiology.

[58]  B. Delgutte,et al.  Pitch Representations in the Auditory Nerve: Two Concurrent Complex Tones Chair, Department Committee on Graduate Students , 2022 .

[59]  W. Shofner,et al.  Temporal representation of rippled noise in the anteroventral cochlear nucleus of the chinchilla. , 1991, The Journal of the Acoustical Society of America.

[60]  L. Carney Sensitivities of cells in anteroventral cochlear nucleus of cat to spatiotemporal discharge patterns across primary afferents. , 1990, Journal of neurophysiology.

[61]  E. F. Evans,et al.  Pitch and Cochlear Nerve Fibre Temporal Discharge Patterns , 1938 .

[62]  H. Voigt,et al.  Cross-correlation analysis of inhibitory interactions in dorsal cochlear nucleus. , 1990, Journal of neurophysiology.

[63]  L. Carney,et al.  Temporal coding of resonances by low-frequency auditory nerve fibers: single-fiber responses and a population model. , 1988, Journal of neurophysiology.

[64]  M. Sachs,et al.  Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers. , 1979, The Journal of the Acoustical Society of America.

[65]  William H. Press,et al.  Numerical Recipes in FORTRAN - The Art of Scientific Computing, 2nd Edition , 1987 .

[66]  R. Lavine Phase-locking in response of single neurons in cochlear nucler complex of the cat to low-frequency tonal stimuli. , 1971, Journal of Neurophysiology.

[67]  J S Buchwald,et al.  The effects of articulation on the acoustical structure of feline vocalizations. , 1991, The Journal of the Acoustical Society of America.

[68]  J. Licklider,et al.  A duplex theory of pitch perception , 1951, Experientia.

[69]  Manfred R. Schroeder,et al.  Synthesis of low-peak-factor signals and binary sequences with low autocorrelation (Corresp.) , 1970, IEEE Trans. Inf. Theory.

[70]  Dirk Van Compernolle,et al.  Pitch perception by cochlear implant subjects. , 1987, The Journal of the Acoustical Society of America.

[71]  S. Shamma Speech processing in the auditory system. II: Lateral inhibition and the central processing of speech evoked activity in the auditory nerve. , 1985, The Journal of the Acoustical Society of America.

[72]  Ray Meddis,et al.  Virtual pitch and phase sensitivity of a computer model of the auditory periphery , 1991 .

[73]  J. L. Goldstein An optimum processor theory for the central formation of the pitch of complex tones. , 1973, The Journal of the Acoustical Society of America.

[74]  Cornelia Kopp-Scheinpflug,et al.  Interaction of Excitation and Inhibition in Anteroventral Cochlear Nucleus Neurons That Receive Large Endbulb Synaptic Endings , 2002, The Journal of Neuroscience.

[75]  Andrew J. Oxenham,et al.  Otoacoustic Estimation of Cochlear Tuning: Validation in the Chinchilla , 2010, Journal of the Association for Research in Otolaryngology.

[76]  G. Zweig Basilar membrane motion. , 1976, Cold Spring Harbor symposia on quantitative biology.

[77]  Mario A. Ruggero,et al.  Phase-Locked Responses to Tones of Chinchilla Auditory Nerve Fibers: Implications for Apical Cochlear Mechanics , 2010, Journal of the Association for Research in Otolaryngology.