Temporal Codes for Amplitude Contrast in Auditory Cortex

The encoding of sound level is fundamental to auditory signal processing, and the temporal information present in amplitude modulation is crucial to the complex signals used for communication sounds, including human speech. The modulation transfer function, which measures the minimum detectable modulation depth across modulation frequency, has been shown to predict speech intelligibility performance in a range of adverse listening conditions and hearing impairments, and even for users of cochlear implants. We presented sinusoidal amplitude modulation (SAM) tones of varying modulation depths to awake macaque monkeys while measuring the responses of neurons in the auditory core. Using spike train classification methods, we found that thresholds for modulation depth detection and discrimination in the most sensitive units are comparable to psychophysical thresholds when precise temporal discharge patterns rather than average firing rates are considered. Moreover, spike timing information was also superior to average rate information when discriminating static pure tones varying in level but with similar envelopes. The limited utility of average firing rate information in many units also limited the utility of standard measures of sound level tuning, such as the rate level function (RLF), in predicting cortical responses to dynamic signals like SAM. Response modulation typically exceeded that predicted by the slope of the RLF by large factors. The decoupling of the cortical encoding of SAM and static tones indicates that enhancing the representation of acoustic contrast is a cardinal feature of the ascending auditory pathway.

[1]  T. Houtgast,et al.  The Modulation Transfer Function in Room Acoustics as a Predictor of Speech Intelligibility , 1973 .

[2]  T. Yin,et al.  Responses to amplitude-modulated tones in the auditory nerve of the cat. , 1992, The Journal of the Acoustical Society of America.

[3]  Brian J Malone,et al.  Representation of dynamic interaural phase difference in auditory cortex of awake rhesus macaques. , 2009, Journal of neurophysiology.

[4]  Jean-Marc Edeline,et al.  A Spike-Timing Code for Discriminating Conspecific Vocalizations in the Thalamocortical System of Anesthetized and Awake Guinea Pigs , 2009, The Journal of Neuroscience.

[5]  Bryan E. Pfingst,et al.  A vertical stereotaxic approach to auditory cortex in the unanesthetized monkey , 1980, Journal of Neuroscience Methods.

[6]  Qian-Jie Fu,et al.  Effects of Stimulation Rate, Mode and Level on Modulation Detection by Cochlear Implant Users , 2005, Journal of the Association for Research in Otolaryngology.

[7]  G. Recanzone,et al.  Representation of Con-Specific Vocalizations in the Core and Belt Areas of the Auditory Cortex in the Alert Macaque Monkey , 2008, The Journal of Neuroscience.

[8]  R. Shannon,et al.  Effect of stimulation rate on phoneme recognition by nucleus-22 cochlear implant listeners. , 2000, The Journal of the Acoustical Society of America.

[9]  R. Kay Hearing of modulation in sounds. , 1982, Physiological reviews.

[10]  T. Houtgast,et al.  A review of the MTF concept in room acoustics and its use for estimating speech intelligibility in auditoria , 1985 .

[11]  I. Nelken,et al.  Responses of neurons in primary auditory cortex (A1) to pure tones in the halothane-anesthetized cat. , 2006, Journal of neurophysiology.

[12]  D P Phillips,et al.  Factors shaping the tone level sensitivity of single neurons in posterior field of cat auditory cortex. , 1995, Journal of neurophysiology.

[13]  P. Müller-Preuss,et al.  Auditory responsive cortex in the squirrel monkey: neural responses to amplitude-modulated sounds , 1996, Experimental Brain Research.

[14]  Nima Mesgarani,et al.  Phoneme representation and classification in primary auditory cortex. , 2008, The Journal of the Acoustical Society of America.

[15]  L. Carney,et al.  Neural rate and timing cues for detection and discrimination of amplitude-modulated tones in the awake rabbit inferior colliculus. , 2007, Journal of neurophysiology.

[16]  R. Plomp,et al.  Effect of temporal envelope smearing on speech reception. , 1994, The Journal of the Acoustical Society of America.

[17]  M N Semple,et al.  Focal selectivity for binaural sound pressure level in cat primary auditory cortex: two-way intensity network tuning. , 1993, Journal of neurophysiology.

[18]  Bernhard Ronacher,et al.  Single auditory neurons rapidly discriminate conspecific communication signals , 2003, Nature Neuroscience.

[19]  D. P. Phillips,et al.  Level-dependent representation of stimulus frequency in cat primary auditory cortex , 2004, Experimental Brain Research.

[20]  Yale E Cohen,et al.  Acoustic features of rhesus vocalizations and their representation in the ventrolateral prefrontal cortex. , 2007, Journal of neurophysiology.

[21]  Gerald Langner,et al.  Periodicity coding in the auditory system , 1992, Hearing Research.

[22]  John C Middlebrooks,et al.  Auditory cortex phase locking to amplitude-modulated cochlear implant pulse trains. , 2008, Journal of neurophysiology.

[23]  David B. Moody Detection and discrimination of amplitude-modulated signals by macaque monkeys. , 1994, The Journal of the Acoustical Society of America.

[24]  M Vollmer,et al.  Responses of inferior colliculus neurons to amplitude-modulated intracochlear electrical pulses in deaf cats. , 2000, Journal of neurophysiology.

[25]  Xiaoqin Wang,et al.  Neural representations of sinusoidal amplitude and frequency modulations in the primary auditory cortex of awake primates. , 2002, Journal of neurophysiology.

[26]  J. C. Middlebrooks,et al.  Cortical representation of auditory space: information-bearing features of spike patterns. , 2002, Journal of neurophysiology.

[27]  G. K. Yates,et al.  Cochlear nerve fiber responses to amplitude-modulated stimuli: variations with spontaneous rate and other response characteristics. , 1993, Journal of neurophysiology.

[28]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[29]  G. K. Yates,et al.  Dynamic effects in the input/output relationship of auditory nerve , 1987, Hearing Research.

[30]  Xiaoqin Wang,et al.  Level Invariant Representation of Sounds by Populations of Neurons in Primary Auditory Cortex , 2008, The Journal of Neuroscience.

[31]  Kerry M. M. Walker,et al.  Linking Cortical Spike Pattern Codes to Auditory Perception , 2008, Journal of Cognitive Neuroscience.

[32]  Brian H Scott,et al.  Context-Dependent Adaptive Coding of Interaural Phase Disparity in the Auditory Cortex of Awake Macaques , 2002, The Journal of Neuroscience.

[33]  A. Rees,et al.  Neuronal responses to amplitude-modulated and pure-tone stimuli in the guinea pig inferior colliculus, and their modification by broadband noise. , 1989, The Journal of the Acoustical Society of America.

[34]  J. Goldberg,et al.  Response of binaural neurons of dog superior olivary complex to dichotic tonal stimuli: some physiological mechanisms of sound localization. , 1969, Journal of neurophysiology.

[35]  Brian H Scott,et al.  Dynamic amplitude coding in the auditory cortex of awake rhesus macaques. , 2007, Journal of neurophysiology.

[36]  G M Clark,et al.  The perception of temporal modulations by cochlear implant patients. , 1993, The Journal of the Acoustical Society of America.

[37]  M Pelizzone,et al.  Low-pass filtering in amplitude modulation detection associated with vowel and consonant identification in subjects with cochlear implants. , 1994, The Journal of the Acoustical Society of America.

[38]  Yale E Cohen,et al.  Coding of auditory-stimulus identity in the auditory non-spatial processing stream. , 2008, Journal of neurophysiology.

[39]  D. O. Kim,et al.  Responses of DCN-PVCN neurons and auditory nerve fibers in unanesthetized decerebrate cats to AM and pure tones: Analysis with autocorrelation/power-spectrum , 1990, Hearing Research.

[40]  M. Escabí,et al.  Distinct Roles for Onset and Sustained Activity in the Neuronal Code for Temporal Periodicity and Acoustic Envelope Shape , 2008, The Journal of Neuroscience.

[41]  M. Kilgard,et al.  Cortical activity patterns predict speech discrimination ability , 2008, Nature Neuroscience.

[42]  Ian M. Winter,et al.  Diversity of characteristic frequency rate-intensity functions in guinea pig auditory nerve fibres , 1990, Hearing Research.

[43]  Q. Fu Temporal processing and speech recognition in cochlear implant users , 2002, Neuroreport.

[44]  Kohlrausch,et al.  The influence of carrier level and frequency on modulation and beat-detection thresholds for sinusoidal carriers , 2000, The Journal of the Acoustical Society of America.

[45]  B C Moore,et al.  Temporal modulation transfer functions obtained using sinusoidal carriers with normally hearing and hearing-impaired listeners. , 2001, The Journal of the Acoustical Society of America.

[46]  R. Plomp,et al.  Effect of reducing slow temporal modulations on speech reception. , 1994, The Journal of the Acoustical Society of America.

[47]  R Drullman,et al.  Temporal envelope and fine structure cues for speech intelligibility. , 1994, The Journal of the Acoustical Society of America.

[48]  L Geurts,et al.  Coding of the fundamental frequency in continuous interleaved sampling processors for cochlear implants. , 2001, The Journal of the Acoustical Society of America.

[49]  Charles H. Brown,et al.  Habitat acoustics and primate communication , 1986, American journal of primatology.

[50]  Rajiv Narayan,et al.  Distinct time scales in cortical discrimination of natural sounds in songbirds. , 2006, Journal of neurophysiology.

[51]  S. Rosen Temporal information in speech: acoustic, auditory and linguistic aspects. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[52]  Guglielmo Foffani,et al.  PSTH-based classification of sensory stimuli using ensembles of single neurons , 2004, Journal of Neuroscience Methods.

[53]  S P Bacon,et al.  Amplitude modulation depth discrimination of a sinusoidal carrier: effect of stimulus duration. , 1997, The Journal of the Acoustical Society of America.

[54]  S. R. Jammalamadaka,et al.  Directional Statistics, I , 2011 .

[55]  Benjamin J. Kraus,et al.  Invariance and Sensitivity to Intensity in Neural Discrimination of Natural Sounds , 2008, The Journal of Neuroscience.

[56]  Frédéric E. Theunissen,et al.  The Modulation Transfer Function for Speech Intelligibility , 2009, PLoS Comput. Biol..

[57]  S C McLoon,et al.  Nitric oxide and the developmental remodeling of retinal connections in the brain. , 1996, Progress in brain research.

[58]  Brian H Scott,et al.  Effect of Behavioral Context on Representation of a Spatial Cue in Core Auditory Cortex of Awake Macaques , 2007, The Journal of Neuroscience.

[59]  Jan W. H. Schnupp,et al.  Plasticity of Temporal Pattern Codes for Vocalization Stimuli in Primary Auditory Cortex , 2006, The Journal of Neuroscience.

[60]  C E Schreiner,et al.  Neural processing of amplitude-modulated sounds. , 2004, Physiological reviews.

[61]  Zachary M. Smith,et al.  Chimaeric sounds reveal dichotomies in auditory perception , 2002, Nature.