Pitch of Harmonic Complex Tones: Rate-Place Coding of Resolved Components in Harmonic and Inharmonic Complex Tones in Auditory Midbrain

Harmonic complex tones (HCT) commonly occurring in speech and music evoke a strong pitch at their fundamental frequency (F0), especially when they contain harmonics individually resolved by the cochlea. When all frequency components of an HCT are shifted by the same amount, the pitch of the resulting inharmonic tone (IHCT) also shifts although the envelope repetition rate is unchanged. A rate-place code whereby resolved harmonics are represented by local maxima in firing rates along the tonotopic axis has been characterized in the auditory nerve and primary auditory cortex, but little is known about intermediate processing stages. We recorded single neuron responses to HCT and IHCT with varying F0 and sound level in the inferior colliculus (IC) of unanesthetized rabbits. Many neurons showed peaks in firing rates when a low-numbered harmonic aligned with the neuron’s characteristic frequency, demonstrating “rate-place” coding. The IC rate-place code was most prevalent for F0>800 Hz, was only moderately dependent on sound level over a 40 dB range, and was not sensitive to stimulus harmonicity. A spectral receptive-field model incorporating broadband inhibition better predicted the neural responses than a purely excitatory model, suggesting an enhancement of the rate-place representation by inhibition. Some IC neurons showed facilitation in response to HCT, similar to cortical “harmonic template neurons” (Feng and Wang 2017), but to a lesser degree. Our findings shed light on the transformation of rate-place coding of resolved harmonics along the auditory pathway, and suggest a gradual emergence of harmonic templates from low to high processing centers. Significance statement Harmonic complex tones are ubiquitous in speech and music and produce strong pitch percepts in human listeners when they contain frequency components that are individually resolved by the cochlea. Here, we characterize a “rate-place” code for resolved harmonics in the auditory midbrain that is more robust across sound levels than the peripheral rate-place code and insensitive to the harmonic relationships among frequency components. We use a computational model to show that inhibition may play an important role in shaping the rate-place code. We also show that midbrain auditory neurons can demonstrate similar properties as cortical harmonic template neurons. Our study fills a gap in understanding the transformation in neural representations of resolved harmonics along the auditory pathway.

[1]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[2]  M. Kendall Rank Correlation Methods , 1949 .

[3]  E. D. Boer Pitch of Inharmonic Signals , 1956, Nature.

[4]  B. L. Cardozo,et al.  Pitch of the Residue , 1962 .

[5]  F. Wightman The pattern-transformation model of pitch. , 1973, The Journal of the Acoustical Society of America.

[6]  J. L. Goldstein An optimum processor theory for the central formation of the pitch of complex tones. , 1973, The Journal of the Acoustical Society of America.

[7]  R. Patterson The effects of relative phase and the number of components on residue pitch. , 1973, Journal of the Acoustical Society of America.

[8]  N. Kiang,et al.  Tails of tuning curves of auditory-nerve fibers. , 1973, The Journal of the Acoustical Society of America.

[9]  E. Terhardt Pitch, consonance, and harmony. , 1974, The Journal of the Acoustical Society of America.

[10]  R. Patterson,et al.  Residue pitch as a function of component spacing. , 1976, The Journal of the Acoustical Society of America.

[11]  J. L. Goldstein,et al.  Evidence for a general template in central optimal processing for pitch of complex tones. , 1978, The Journal of the Acoustical Society of America.

[12]  M. Liberman,et al.  Auditory-nerve response from cats raised in a low-noise chamber. , 1978, The Journal of the Acoustical Society of America.

[13]  J. Adams Ascending projections to the inferior colliculus , 1979, The Journal of comparative neurology.

[14]  R. Batra,et al.  Interaural phase-sensitive units in the inferior colliculus of the unanesthetized rabbit: effects of changing frequency. , 1987, Journal of neurophysiology.

[15]  E. Borg,et al.  Eighth nerve fiber firing features in normal-hearing rabbits , 1988, Hearing Research.

[16]  J. Smurzyński,et al.  Pitch identification and discrimination for complex tones with many harmonics , 1990 .

[17]  D. Schwarz,et al.  Spectral response patterns of auditory cortex neurons to harmonic complex tones in alert monkey (Macaca mulatta). , 1990, Journal of neurophysiology.

[18]  L. Demany,et al.  The Upper Limit of "Musical" Pitch , 1990 .

[19]  M. Merchán,et al.  Intrinsic and commissural connections of the rat inferior colliculus , 1992, The Journal of comparative neurology.

[20]  G. Kramer Auditory Scene Analysis: The Perceptual Organization of Sound by Albert Bregman (review) , 2016 .

[21]  R. Carlyon,et al.  The role of resolved and unresolved harmonics in pitch perception and frequency modulation discrimination. , 1994, The Journal of the Acoustical Society of America.

[22]  A. Bregman,et al.  Demonstrations of auditory scene analysis : the perceptual organization of sound , 1995 .

[23]  S Grossberg,et al.  A spectral network model of pitch perception. , 1995, The Journal of the Acoustical Society of America.

[24]  J. Kauer,et al.  Whole-Cell Patch-Clamp Recording Reveals Subthreshold Sound-Evoked Postsynaptic Currents in the Inferior Colliculus of Awake Bats , 1996, The Journal of Neuroscience.

[25]  K. A. Davis,et al.  Single-unit responses in the inferior colliculus of decerebrate cats. I. Classification based on frequency response maps. , 1999, Journal of neurophysiology.

[26]  K. A. Davis,et al.  Single-unit responses in the inferior colliculus of decerebrate cats. II. Sensitivity to interaural level differences. , 1999, Journal of neurophysiology.

[27]  S Shamma,et al.  The case of the missing pitch templates: how harmonic templates emerge in the early auditory system. , 2000, The Journal of the Acoustical Society of America.

[28]  M. Sutter Shapes and level tolerances of frequency tuning curves in primary auditory cortex: quantitative measures and population codes. , 2000, Journal of neurophysiology.

[29]  R. Patterson,et al.  The lower limit of pitch as determined by rate discrimination. , 2000, The Journal of the Acoustical Society of America.

[30]  R. Patterson,et al.  The lower limit of melodic pitch. , 2001, The Journal of the Acoustical Society of America.

[31]  D. Sinex,et al.  Responses of inferior colliculus neurons to harmonic and mistuned complex tones , 2002, Hearing Research.

[32]  C. Schreiner,et al.  Gabor analysis of auditory midbrain receptive fields: spectro-temporal and binaural composition. , 2003, Journal of neurophysiology.

[33]  Joshua G. W. Bernstein,et al.  Pitch discrimination of diotic and dichotic tone complexes: harmonic resolvability or harmonic number? , 2003, The Journal of the Acoustical Society of America.

[34]  A. Oxenham,et al.  Overview : The present and future of pitch , 2005 .

[35]  A. Oxenham,et al.  The psychophysics of pitch , 2005 .

[36]  B. Delgutte,et al.  Pitch of complex tones: rate-place and interspike interval representations in the auditory nerve. , 2005, Journal of neurophysiology.

[37]  M. Malmierca,et al.  Laminar inputs from dorsal cochlear nucleus and ventral cochlear nucleus to the central nucleus of the inferior colliculus: Two patterns of convergence , 2005, Neuroscience.

[38]  Joshua X. Gittelman,et al.  Rethinking Tuning: In Vivo Whole-Cell Recordings of the Inferior Colliculus in Awake Bats , 2007, The Journal of Neuroscience.

[39]  P. Joris,et al.  Comparison of bandwidths in the inferior colliculus and the auditory nerve. I. Measurement using a spectrally manipulated stimulus. , 2007, Journal of neurophysiology.

[40]  D. Sinex,et al.  Responses of inferior colliculus neurons to double harmonic tones. , 2007, Journal of neurophysiology.

[41]  Xiaoqin Wang,et al.  Level Invariant Representation of Sounds by Populations of Neurons in Primary Auditory Cortex , 2008, The Journal of Neuroscience.

[42]  P. Joris,et al.  Comparison of bandwidths in the inferior colliculus and the auditory nerve. I. Measurement using a spectrally manipulated stimulus. , 2007, Journal of neurophysiology.

[43]  B. Delgutte,et al.  Pitch Representations in the Auditory Nerve: Two Concurrent Complex Tones Chair, Department Committee on Graduate Students , 2022 .

[44]  N. Lesica,et al.  Dynamic Spectrotemporal Feature Selectivity in the Auditory Midbrain , 2008, The Journal of Neuroscience.

[45]  A. Palmer,et al.  Responses to Diotic, Dichotic, and Alternating Phase Harmonic Stimuli in the Inferior Colliculus of Guinea Pigs , 2008, Journal of the Association for Research in Otolaryngology.

[46]  B. Delgutte,et al.  Effects of Reverberation on the Directional Sensitivity of Auditory Neurons across the Tonotopic Axis: Influences of Interaural Time and Level Differences , 2010, The Journal of Neuroscience.

[47]  A. Oxenham,et al.  Pitch, harmonicity and concurrent sound segregation: Psychoacoustical and neurophysiological findings , 2010, Hearing Research.

[48]  B. Delgutte,et al.  Neural Coding of Interaural Time Differences with Bilateral Cochlear Implants: Effects of Congenital Deafness , 2010, The Journal of Neuroscience.

[49]  B. Rousseau,et al.  Effects of raised-intensity phonation on inflammatory mediator gene expression in normal rabbit vocal fold , 2010, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[50]  Bertrand Delgutte,et al.  Behavioral / Systems / Cognitive Spatiotemporal Representation of the Pitch of Harmonic Complex Tones in the Auditory Nerve , 2010 .

[51]  P. Joris,et al.  Frequency selectivity in Old-World monkeys corroborates sharp cochlear tuning in humans , 2011, Proceedings of the National Academy of Sciences.

[52]  Yoojin Chung,et al.  Neural ITD coding with bilateral cochlear implants: effect of binaurally coherent jitter. , 2012, Journal of neurophysiology.

[53]  Bertrand Delgutte,et al.  Neural encoding of sound source location in the presence of a concurrent, spatially separated source. , 2012, Journal of neurophysiology.

[54]  E. Young,et al.  Frequency response areas in the inferior colliculus: nonlinearity and binaural interaction , 2013, Front. Neural Circuits.

[55]  C. Micheyl,et al.  Neural Representation of Harmonic Complex Tones in Primary Auditory Cortex of the Awake Monkey , 2013, The Journal of Neuroscience.

[56]  O. Zobay,et al.  Classification of frequency response areas in the inferior colliculus reveals continua not discrete classes , 2013, The Journal of physiology.

[57]  S. Matteson,et al.  Toward a quantitative account of pitch distribution in spontaneous narrative: method and validation. , 2013, The Journal of the Acoustical Society of America.

[58]  J. Schnupp,et al.  Periodotopy in the gerbil inferior colliculus: local clustering rather than a gradient map , 2015, Front. Neural Circuits.

[59]  Xiaoqin Wang,et al.  Harmonic template neurons in primate auditory cortex underlying complex sound processing , 2017, Proceedings of the National Academy of Sciences.

[60]  Jack J. Jiang,et al.  Parameters From the Complete Phonatory Range of an Excised Rabbit Larynx. , 2017, Journal of voice : official journal of the Voice Foundation.

[61]  R. Brette,et al.  On the relation between pitch and level , 2017, Hearing Research.

[62]  W. Hou,et al.  Temporal Coding of Voice Pitch Contours in Mandarin Tones , 2018, Front. Neural Circuits.

[63]  P. Joris,et al.  High-resolution frequency tuning but not temporal coding in the human cochlea , 2018, PLoS Biology.

[64]  S. Kniesburges,et al.  Investigation of phonatory characteristics using ex vivo rabbit larynges. , 2018, The Journal of the Acoustical Society of America.

[65]  Shihab Shamma,et al.  Spectro-temporal templates unify the pitch percepts of resolved and unresolved harmonics. , 2019, The Journal of the Acoustical Society of America.

[66]  Jeff Lin,et al.  Differential Inhibitory Configurations Segregate Frequency Selectivity in the Mouse Inferior Colliculus , 2019, The Journal of Neuroscience.