A two‐path model of auditory modulation detection using temporal fine structure and envelope cues

A model using temporal‐envelope cues was previously developed to explain perceptual interference effects between amplitude modulation and frequency modulation (FM). As that model could not accurately predict FM sensitivity and the interference effects, temporal fine structure (TFS) cues were added to the model. Thus, following the initial stage of the model consisting of a linear filter bank simulating cochlear filtering, processing was split into an ‘envelope path’ based on envelope power cues and a ‘TFS path’ based on a measure of the distribution of time intervals between successive zero‐crossings. This yielded independent detectability indices for envelope and TFS cues, which were optimally combined to produce a single decision statistic. Independent internal noises in the envelope and TFS paths were adjusted to match the data. Simulations indicate that TFS cues are required to account for FM data for young normal‐hearing listeners and that TFS processing is impaired for both older normal‐hearing and hearing‐impaired listeners. The role of TFS was further assessed by relating the monaural FM sensitivity to measures of interaural phase difference, commonly assumed to rely on binaural TFS sensitivity. The model demonstrates that binaural TFS sensitivity is considerably lower than monaural TFS sensitivity. Similar to FM thresholds, interaural phase difference sensitivity declined with age and hearing loss, although higher degradations were observed in binaural temporal processing compared to monaural processing. Overall, this model provides a novel tool to explore the mechanisms involved in FM processing in the normal auditory system and the degradations in FM sensitivity with ageing and hearing loss.

[1]  Brian C J Moore,et al.  The role of time and place cues in the detection of frequency modulation by hearing-impaired listeners. , 2012, The Journal of the Acoustical Society of America.

[2]  R. A. Schmiedt,et al.  Age-related loss of activity of auditory-nerve fibers. , 1996, Journal of neurophysiology.

[3]  Christian Lorenzi,et al.  A cross-linguistic study of speech modulation spectra. , 2017, The Journal of the Acoustical Society of America.

[4]  Stuart Rosen,et al.  The role of auditory and cognitive factors in understanding speech in noise by normal-hearing older listeners , 2014, Front. Aging Neurosci..

[5]  Ray Meddis,et al.  Virtual pitch and phase sensitivity of a computer model of the auditory periphery , 1991 .

[6]  B. Grothe,et al.  Precise inhibition is essential for microsecond interaural time difference coding , 2002, Nature.

[7]  D. Caspary,et al.  Responses of young and aged rat inferior colliculus neurons to sinusoidally amplitude modulated stimuli , 2001, Hearing Research.

[8]  Boris Gourévitch,et al.  Age‐related changes in the guinea pig auditory cortex: relationship with brainstem changes and comparison with tone‐induced hearing loss , 2011, The European journal of neuroscience.

[9]  A. Palmer,et al.  Phase-locking in the cochlear nerve of the guinea-pig and its relation to the receptor potential of inner hair-cells , 1986, Hearing Research.

[10]  M. Sachs,et al.  Classification of unit types in the anteroventral cochlear nucleus: PST histograms and regularity analysis. , 1989, Journal of neurophysiology.

[11]  Georg M Klump,et al.  Boosting GABA improves impaired auditory temporal resolution in the gerbil , 2003, Neuroreport.

[12]  Laurel H. Carney,et al.  Evaluating Auditory Performance Limits: I. One-Parameter Discrimination Using a Computational Model for the Auditory Nerve , 2001, Neural Computation.

[13]  R J Salvi,et al.  Plasticity of response properties of inferior colliculus neurons following acute cochlear damage. , 1996, Journal of neurophysiology.

[14]  Judy R Dubno,et al.  Frequency modulation detection: effects of age, psychophysical method, and modulation waveform. , 2007, The Journal of the Acoustical Society of America.

[15]  Brian C J Moore,et al.  Sensorineural hearing loss enhances auditory sensitivity and temporal integration for amplitude modulation. , 2017, The Journal of the Acoustical Society of America.

[16]  Edward L. Bartlett,et al.  Neural representations of temporally modulated signals in the auditory thalamus of awake primates. , 2007, Journal of neurophysiology.

[17]  Jos J. Eggermont,et al.  Differential effects of age on click-rate and amplitude modulation-frequency coding in primary auditory cortex of the cat , 1993, Hearing Research.

[18]  J. Licklider,et al.  A duplex theory of pitch perception , 1951, Experientia.

[19]  Ray Meddis,et al.  Auditory-nerve first-spike latency and auditory absolute threshold: a computer model. , 2006, The Journal of the Acoustical Society of America.

[20]  W. S. Rhode,et al.  Encoding timing and intensity in the ventral cochlear nucleus of the cat. , 1986, Journal of neurophysiology.

[21]  Christian Lorenzi,et al.  Effects of Age and Hearing Loss on the Relationship Between Discrimination of Stochastic Frequency Modulation and Speech Perception , 2012, Ear and hearing.

[22]  Michael G. Heinz,et al.  Envelope Coding in Auditory Nerve Fibers Following Noise-Induced Hearing Loss , 2010, Journal of the Association for Research in Otolaryngology.

[23]  W. Yost Pitch strength of iterated rippled noise. , 1996, The Journal of the Acoustical Society of America.

[24]  Brian C J Moore,et al.  Mechanisms underlying the detection of frequency modulation. , 2010, The Journal of the Acoustical Society of America.

[25]  D. H. Louage,et al.  Temporal properties of responses to broadband noise in the auditory nerve. , 2004, Journal of neurophysiology.

[26]  T. Dau,et al.  Characterizing frequency selectivity for envelope fluctuations. , 2000, The Journal of the Acoustical Society of America.

[27]  Torsten Dau,et al.  A multi-resolution envelope-power based model for speech intelligibility. , 2013, The Journal of the Acoustical Society of America.

[28]  Robert A Lutfi,et al.  Sample discrimination of frequency by hearing-impaired and normal-hearing listeners. , 2008, The Journal of the Acoustical Society of America.

[29]  Brian C. J. Moore,et al.  The effects of age on temporal fine structure sensitivity in monaural and binaural conditions , 2012, International journal of audiology.

[30]  B. Moore,et al.  Age-group differences in speech identification despite matched audiometrically normal hearing: contributions from auditory temporal processing and cognition , 2015, Front. Aging Neurosci..

[31]  TAKASHI MORIMOTO,et al.  Assessment , modeling , and compensation of inner and outer hair cell damage , 2014 .

[32]  J. Zwislocki,et al.  Just Noticeable Differences in Dichotic Phase , 1956 .

[33]  M. Liberman,et al.  Adding Insult to Injury: Cochlear Nerve Degeneration after “Temporary” Noise-Induced Hearing Loss , 2009, The Journal of Neuroscience.

[34]  M. Semple,et al.  Auditory temporal processing: responses to sinusoidally amplitude-modulated tones in the inferior colliculus. , 2000, Journal of neurophysiology.

[35]  Edward L. Bartlett,et al.  Age-Related Differences in Auditory Processing as Assessed by Amplitude-Modulation Following Responses in Quiet and in Noise , 2010, Front. Ag. Neurosci..

[36]  P. Kanold,et al.  Encoding the timing of inhibitory inputs. , 2005, Journal of neurophysiology.

[37]  B. Wright,et al.  Perceptual learning and generalization resulting from training on an auditory amplitude-modulation detection task. , 2011, The Journal of the Acoustical Society of America.

[38]  Frederick J. Gallun,et al.  Relating age and hearing loss to monaural, bilateral, and binaural temporal sensitivity1 , 2014, Front. Neurosci..

[39]  Steffen Kortlang,et al.  Suprathreshold auditory processing deficits in noise: Effects of hearing loss and age , 2016, Hearing Research.

[40]  Laurent Demany,et al.  Consequences of cochlear damage for the detection of interaural phase differences. , 2005, The Journal of the Acoustical Society of America.

[41]  T. Dau,et al.  A computational model of human auditory signal processing and perception. , 2008, The Journal of the Acoustical Society of America.

[42]  Brian C J Moore,et al.  Detection of frequency modulation by hearing-impaired listeners: effects of carrier frequency, modulation rate, and added amplitude modulation. , 2002, The Journal of the Acoustical Society of America.

[43]  T. Salthouse The processing-speed theory of adult age differences in cognition. , 1996, Psychological review.

[44]  Thomas Biberger,et al.  Envelope and intensity based prediction of psychoacoustic masking and speech intelligibility. , 2016, The Journal of the Acoustical Society of America.

[45]  B C Moore,et al.  Effects of carrier frequency and background noise on the detection of mixed modulation. , 1994, The Journal of the Acoustical Society of America.

[46]  Steffen Kortlang,et al.  Assessment, modeling, and compensation of inner and outer hair cell damage , 2013 .

[47]  Jeremy G. Turner,et al.  Age-related changes in the response properties of cartwheel cells in rat dorsal cochlear nucleus , 2006, Hearing Research.

[48]  N. Lesica,et al.  Impaired Auditory Temporal Selectivity in the Inferior Colliculus of Aged Mongolian Gerbils , 2011, The Journal of Neuroscience.

[49]  Alain de Cheveigné,et al.  Modelling firing regularity in the ventral cochlear nucleus: Mechanisms, and effects of stimulus level and synaptopathy , 2017, Hearing Research.

[50]  Nihaad Paraouty,et al.  Using individual differences to assess modulation-processing mechanisms and age effects , 2017, Hearing Research.

[51]  Brian C J Moore,et al.  The effects of age and cochlear hearing loss on temporal fine structure sensitivity, frequency selectivity, and speech reception in noise. , 2011, The Journal of the Acoustical Society of America.

[52]  Brian C J Moore,et al.  Comparing the effects of age on amplitude modulation and frequency modulation detection. , 2016, The Journal of the Acoustical Society of America.

[53]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[54]  R. Patterson,et al.  A pulse ribbon model of monaural phase perception. , 1987, The Journal of the Acoustical Society of America.

[55]  M. Liberman,et al.  Age-Related Cochlear Synaptopathy: An Early-Onset Contributor to Auditory Functional Decline , 2013, The Journal of Neuroscience.

[56]  Tammo Houtgast,et al.  Predicting speech intelligibility in rooms from the modulation transfer function. Part 4: A ray tracing computer model , 1980 .

[57]  L. Demany,et al.  Detection thresholds for sinusoidal frequency modulation. , 1989, The Journal of the Acoustical Society of America.

[58]  C. Barnes,et al.  Neural plasticity in the ageing brain , 2006, Nature Reviews Neuroscience.

[59]  L. Wiegrebe,et al.  Searching for the time constant of neural pitch extraction. , 2001, The Journal of the Acoustical Society of America.

[60]  B. Kollmeier,et al.  Modeling auditory processing of amplitude modulation. II. Spectral and temporal integration. , 1997, The Journal of the Acoustical Society of America.

[61]  Xiaoqin Wang,et al.  Neural representations of sinusoidal amplitude and frequency modulations in the primary auditory cortex of awake primates. , 2002, Journal of neurophysiology.

[62]  J. Grose,et al.  Processing of Temporal Fine Structure as a Function of Age , 2010, Ear and hearing.

[63]  T Dau,et al.  A quantitative model of the "effective" signal processing in the auditory system. I. Model structure. , 1996, The Journal of the Acoustical Society of America.

[64]  Paul R. Schrater,et al.  Auditory Frequency and Intensity Discrimination Explained Using a Cortical Population Rate Code , 2013, PLoS Comput. Biol..

[65]  A. King,et al.  The effects of age and hearing loss on interaural phase difference discrimination. , 2014, The Journal of the Acoustical Society of America.

[66]  N. Kiang,et al.  Stimulus coding in the auditory nerve and cochlear nucleus. , 1965 .

[67]  T. Salthouse,et al.  Tests of the neural noise hypothesis of age-related cognitive change. , 1985, Journal of gerontology.

[68]  C E Schreiner,et al.  Neural processing of amplitude-modulated sounds. , 2004, Physiological reviews.

[69]  Shihab Shamma,et al.  On the balance of envelope and temporal fine structure in the encoding of speech in the early auditory system. , 2013, The Journal of the Acoustical Society of America.

[70]  T. Houtgast,et al.  Predicting speech intelligibility in rooms from the modulation transfer function, I. General room acoustics , 1980 .

[71]  Michael Wehr,et al.  Disruption of balanced cortical excitation and inhibition by acoustic trauma. , 2008, Journal of neurophysiology.

[72]  Torsten Dau,et al.  Modeling comodulation masking release using an equalization-cancellation mechanism. , 2005, The Journal of the Acoustical Society of America.

[73]  Philip X Joris,et al.  On the limit of neural phase locking to fine structure in humans. , 2013, Advances in experimental medicine and biology.

[74]  R. Meddis,et al.  A unitary model of pitch perception. , 1997, The Journal of the Acoustical Society of America.

[75]  S. Shamma Speech processing in the auditory system. I: The representation of speech sounds in the responses of the auditory nerve. , 1985, The Journal of the Acoustical Society of America.

[76]  Torsten Dau,et al.  Modeling within- and across-channel processes in comodulation masking release. , 2013, The Journal of the Acoustical Society of America.

[77]  L H Carney,et al.  Enhancement of neural synchronization in the anteroventral cochlear nucleus. I. Responses to tones at the characteristic frequency. , 1994, Journal of neurophysiology.

[78]  J. Ostwald,et al.  Temporal Coding of Amplitude and Frequency Modulation in the Rat Auditory Cortex , 1995, The European journal of neuroscience.

[79]  R. G. Klumpp,et al.  Some Measurements of Interaural Time Difference Thresholds , 1956 .

[80]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[81]  R. Rajan,et al.  Plasticity of excitation and inhibition in the receptive field of primary auditory cortical neurons after limited receptor organ damage. , 2001, Cerebral cortex.

[82]  Andrew J. Oxenham,et al.  Assessing the Role of Place and Timing Cues in Coding Frequency and Amplitude Modulation as a Function of Age , 2017, Journal of the Association for Research in Otolaryngology.

[83]  Frederick J. Gallun,et al.  Spectrotemporal modulation sensitivity for hearing-impaired listeners: dependence on carrier center frequency and the relationship to speech intelligibility. , 2014, The Journal of the Acoustical Society of America.

[84]  C. Trahiotis,et al.  Behavioral manifestations of audiometrically-defined "slight" or "hidden" hearing loss revealed by measures of binaural detection. , 2016, The Journal of the Acoustical Society of America.

[85]  D. Bendor,et al.  Neural coding of temporal information in auditory thalamus and cortex , 2008, Neuroscience.

[86]  N. Viemeister Temporal modulation transfer functions based upon modulation thresholds. , 1979, The Journal of the Acoustical Society of America.

[87]  W. S. Rhode,et al.  Encoding of amplitude modulation in the cochlear nucleus of the cat. , 1994, Journal of neurophysiology.

[88]  B C Moore,et al.  Detection of combined frequency and amplitude modulation. , 1992, The Journal of the Acoustical Society of America.

[89]  D. Caspary,et al.  GABAA receptor antagonist bicuculline alters response properties of posteroventral cochlear nucleus neurons. , 1992, Journal of neurophysiology.

[90]  T. Yin,et al.  Responses to amplitude-modulated tones in the auditory nerve of the cat. , 1992, The Journal of the Acoustical Society of America.

[91]  Christian Füllgrabe,et al.  The influence of age and high-frequency hearing loss on sensitivity to temporal fine structure at low frequencies (L). , 2012, The Journal of the Acoustical Society of America.

[92]  B C Moore,et al.  Detection of frequency modulation at low modulation rates: evidence for a mechanism based on phase locking. , 1996, The Journal of the Acoustical Society of America.

[93]  Stephan D Ewert,et al.  The role of short-time intensity and envelope power for speech intelligibility and psychoacoustic masking. , 2017, The Journal of the Acoustical Society of America.

[94]  X Wang,et al.  Temporal discharge patterns evoked by rapid sequences of wide- and narrowband clicks in the primary auditory cortex of cat. , 2000, Journal of neurophysiology.

[95]  N. Durlach Equalization and Cancellation Theory of Binaural Masking‐Level Differences , 1963 .

[96]  M. Liberman,et al.  Noise-induced cochlear neuropathy is selective for fibers with low spontaneous rates. , 2013, Journal of neurophysiology.

[97]  Paul B. Manis,et al.  Transient Potassium Currents Regulate the Discharge Patterns of Dorsal Cochlear Nucleus Pyramidal Cells , 1999, The Journal of Neuroscience.

[98]  C. Schreiner,et al.  Periodicity coding in the inferior colliculus of the cat. I. Neuronal mechanisms. , 1988, Journal of neurophysiology.

[99]  Jayne B Ahlstrom,et al.  Age-related differences in the temporal modulation transfer function with pure-tone carriers. , 2008, The Journal of the Acoustical Society of America.

[100]  M. Leek,et al.  Decision strategies of hearing-impaired listeners in spectral shape discrimination. , 2002, The Journal of the Acoustical Society of America.

[101]  B A Schneider,et al.  Gap detection and the precedence effect in young and old adults. , 1994, The Journal of the Acoustical Society of America.

[102]  Robert D Frisina,et al.  Encoding of amplitude modulation in the gerbil cochlear nucleus: I. A hierarchy of enhancement , 1990, Hearing Research.

[103]  Brian R Glasberg,et al.  Derivation of auditory filter shapes from notched-noise data , 1990, Hearing Research.

[104]  Torsten Dau,et al.  External and internal limitations in amplitude-modulation processing. , 2004, The Journal of the Acoustical Society of America.

[105]  J. E. Rose,et al.  Phase-locked response to low-frequency tones in single auditory nerve fibers of the squirrel monkey. , 1967, Journal of neurophysiology.

[106]  D. Bendor,et al.  Neural coding of temporal information in auditory thalamus and cortex , 2008, Neuroscience.

[107]  Kenneth S Henry,et al.  Distorted Tonotopic Coding of Temporal Envelope and Fine Structure with Noise-Induced Hearing Loss , 2016, The Journal of Neuroscience.

[108]  Philip X. Joris,et al.  In vivo coincidence detection in mammalian sound localization generates phase delays , 2015, Nature Neuroscience.

[109]  Birger Kollmeier,et al.  Revision, extension, and evaluation of a binaural speech intelligibility model. , 2010, The Journal of the Acoustical Society of America.

[110]  Brian C. J. Moore,et al.  Auditory Processing of Temporal Fine Structure:Effects of Age and Hearing Loss , 2014 .

[111]  W M Hartmann,et al.  Theory of frequency modulation detection for low modulation frequencies. , 1980, The Journal of the Acoustical Society of America.

[112]  Andrew J Oxenham,et al.  Using individual differences to test the role of temporal and place cues in coding frequency modulation. , 2015, The Journal of the Acoustical Society of America.

[113]  Stephan D Ewert,et al.  Interactions between amplitude modulation and frequency modulation processing: Effects of age and hearing loss. , 2016, The Journal of the Acoustical Society of America.

[114]  Nathaniel I Durlach,et al.  Application of a short-time version of the Equalization-Cancellation model to speech intelligibility experiments with speech maskers. , 2014, The Journal of the Acoustical Society of America.

[115]  L. Hughes,et al.  Aged-related loss of temporal processing: Altered responses to amplitude modulated tones in rat dorsal cochlear nucleus , 2008, Neuroscience.

[116]  Torsten Dau,et al.  Relations between frequency selectivity, temporal fine-structure processing, and speech reception in impaired hearing. , 2009, The Journal of the Acoustical Society of America.