Applications of Static and Dynamic Iterated Rippled Noise to Evaluate Pitch Encoding in the Human Auditory Brainstem

This paper presents a new application of the dynamic iterated rippled noise (IRN) algorithm by generating dynamic pitch contours representative of those that occur in natural speech in the context of EEG and the frequency following response (FFR). Besides IRN steady state and linear rising stimuli, curvilinear rising stimuli were modeled after pitch contours of natural productions of Mandarin Tone 2. Electrophysiological data on pitch representation at the level of the brainstem, as reflected in FFR, were evaluated for all stimuli, static or dynamic. Autocorrelation peaks were observed corresponding to the fundamental period (tau) as well as spectral bands at the fundamental and its harmonics for both a low and a high iteration step. At the higher iteration step, both spectral and temporal FFR representations were more robust, indicating that both acoustic properties may be utilized for pitch extraction at the level of the brainstem. By applying curvilinear IRN stimuli to elicit FFRs, we can evaluate the effects of temporal degradation on 1) the neural representation of linguistically-relevant pitch features in a target population (e.g. cochlear implant) and 2) the efficacy of signal processing schemes in conventional hearing aids and cochlear implants to recover these features.

[1]  R. Fay,et al.  Pitch : neural coding and perception , 2005 .

[2]  R. Patterson,et al.  Encoding of the temporal regularity of sound in the human brainstem , 2001, Nature Neuroscience.

[3]  W. Yost Pitch of iterated rippled noise. , 1996, The Journal of the Acoustical Society of America.

[4]  J. T. Marsh,et al.  Differential brainstem pathways for the conduction of auditory frequency-following responses. , 1974, Electroencephalography and clinical neurophysiology.

[5]  Alexander L. Francis,et al.  Effects of Language Experience and Stimulus Complexity on the Categorical Perception of Pitch Direction , 2006 .

[6]  Yisheng Xu,et al.  Human frequency-following response: representation of pitch contours in Chinese tones , 2004, Hearing Research.

[7]  R. Patterson,et al.  The Processing of Temporal Pitch and Melody Information in Auditory Cortex , 2002, Neuron.

[8]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[9]  Paul Boersma,et al.  Speak and unSpeak with P RAATRAAT , 2002 .

[10]  Susan Denham,et al.  Pitch detection of dynamic iterated rippled noise by humans and a modified auditory model. , 2005, Bio Systems.

[11]  W A Yost,et al.  Temporal changes in a complex spectral profile. , 1987, The Journal of the Acoustical Society of America.

[12]  J. T. Marsh,et al.  Far-field recorded frequency-following responses: evidence for the locus of brainstem sources. , 1975, Electroencephalography and clinical neurophysiology.

[13]  I. Winter,et al.  Temporal representation of the delay of iterated rippled noise in the dorsal cochlear nucleus. , 2005, Journal of neurophysiology.

[14]  Xiaofeng Ma,et al.  Descending system and plasticity for auditory signal processing: neuroethological data for speech scientists , 2003, Speech Commun..

[15]  Nina Kraus,et al.  Auditory training improves neural timing in the human brainstem , 2005, Behavioural Brain Research.

[16]  P. Cariani,et al.  Encoding of pitch in the human brainstem is sensitive to language experience. , 2005, Brain research. Cognitive brain research.

[17]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[18]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. I. Pitch and pitch salience. , 1996, Journal of neurophysiology.

[19]  Yisheng Xu,et al.  Specificity of experience-dependent pitch representation in the brainstem , 2006, Neuroreport.

[20]  Powen Ru,et al.  Multiresolution spectrotemporal analysis of complex sounds. , 2005, The Journal of the Acoustical Society of America.

[21]  R. Meddis,et al.  A unitary model of pitch perception. , 1997, The Journal of the Acoustical Society of America.

[22]  B. Moore An introduction to the psychology of hearing, 3rd ed. , 1989 .

[23]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. II. Pitch shift, pitch ambiguity, phase invariance, pitch circularity, rate pitch, and the dominance region for pitch. , 1996, Journal of neurophysiology.

[24]  E M Glaser,et al.  The human frequency-following response: its behavior during continuous tone and tone burst stimulation. , 1976, Electroencephalography and clinical neurophysiology.

[25]  W. Shofner,et al.  Responses of cochlear nucleus units in the chinchilla to iterated rippled noises: analysis of neural autocorrelograms. , 1999, Journal of neurophysiology.

[26]  Yi Xu Contextual tonal variations in Mandarin , 1997 .

[27]  S. Shamma,et al.  Analysis of dynamic spectra in ferret primary auditory cortex. I. Characteristics of single-unit responses to moving ripple spectra. , 1996, Journal of neurophysiology.

[28]  W. Shofner,et al.  Temporal representation of rippled noise in the anteroventral cochlear nucleus of the chinchilla. , 1991, The Journal of the Acoustical Society of America.

[29]  W. Shofner Perception of the periodicity strength of complex sounds by the chinchilla , 2002, Hearing Research.

[30]  Steven Greenberg,et al.  Neural temporal coding of low pitch. I. Human frequency-following responses to complex tones , 1987, Hearing Research.

[31]  Jack Gandour,et al.  Tone perception in Far Eastern languages. , 1983 .

[32]  S. Shamma,et al.  Analysis of dynamic spectra in ferret primary auditory cortex. II. Prediction of unit responses to arbitrary dynamic spectra. , 1996, Journal of neurophysiology.

[33]  W. Yost Pitch strength of iterated rippled noise. , 1996, The Journal of the Acoustical Society of America.

[34]  Shangkai Gao,et al.  A novel speech-processing strategy incorporating tonal information for cochlear implants , 2004, IEEE Transactions on Biomedical Engineering.

[35]  Mario Dzemidzic,et al.  Activation of the left planum temporale in pitch processing is shaped by language experience , 2006, Human brain mapping.

[36]  W A Yost Pitch strength of iterated rippled noise when the pitch is ambiguous. , 1997, The Journal of the Acoustical Society of America.

[37]  Roy D. Patterson,et al.  The relative strength of the tone and noise components in iterated rippled noise , 1996 .

[38]  J. Licklider,et al.  A duplex theory of pitch perception , 1951, Experientia.

[39]  Richard S. J. Frackowiak,et al.  Analysis of temporal structure in sound by the human brain , 1998, Nature Neuroscience.