An integrated model of pitch perception incorporating place and temporal pitch codes with application to cochlear implant research

&NA; Although the neural mechanisms underlying pitch perception are not yet fully understood, there is general agreement that place and temporal representations of pitch are both used by the auditory system. This paper describes a neural network model of pitch perception that integrates both codes of pitch and explores the contributions of, and the interactions between, the two representations in simulated pitch ranking trials in normal and cochlear implant hearing. The model can replicate various psychophysical observations including the perception of the missing fundamental pitch and sensitivity to pitch interval sizes. As a case study, the model was used to investigate the efficiency of pitch perception cues in a novel sound processing scheme, Stimulation based on Auditory Modelling (SAM), that aims to improve pitch perception in cochlear implant hearing. Results showed that enhancement of the pitch perception cues would lead to better pitch ranking scores in the integrated model only if the place and temporal pitch cues were consistent. HighlightsPlace and temporal representations of pitch were integrated in a model of pitch perception.The contribution of and interaction between the two pitch representations were investigated.The temporal representation of pitch compensated for eliminated place cues in simulated normal hearing.Improved pitch perception in cochlear implant hearing required temporal cues that were consistent with place cues.

[1]  Dennis H. Klatt,et al.  Software for a cascade/parallel formant synthesizer , 1980 .

[2]  Christopher Turner,et al.  Accuracy of Cochlear Implant Recipients on Pitch Perception, Melody Recognition, and Speech Reception in Noise , 2007, Ear and hearing.

[3]  Lawrence T. Cohen.  Practical model description of peripheral neural excitation in cochlear implant recipients: 5. Refractory recovery and facilitation , 2009, Hearing Research.

[4]  Lawrence T. Cohen,et al.  Practical model description of peripheral neural excitation in cochlear implant recipients: 4. Model development at low pulse rates: General model and application to individuals , 2009, Hearing Research.

[5]  Peter Husar,et al.  Making Use of Auditory Models for Better Mimicking of Normal Hearing Processes With Cochlear Implants: The SAM Coding Strategy , 2013, IEEE Transactions on Biomedical Circuits and Systems.

[6]  Ian C. Bruce,et al.  Can homeostatic plasticity in deafferented primary auditory cortex lead to travelling waves of excitation? , 2011, Journal of Computational Neuroscience.

[7]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[8]  Andrew J Oxenham,et al.  Correct tonotopic representation is necessary for complex pitch perception. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Hugh J. McDermott,et al.  Pitch discrimination and melody recognition by cochlear implant users , 2004 .

[10]  Hugh J. McDermott,et al.  Pitch ranking ability of cochlear implant recipients: a comparison of sound-processing strategies. , 2005, The Journal of the Acoustical Society of America.

[11]  B. Moore,et al.  Frequency discrimination as a function of frequency, measured in several ways. , 1995, The Journal of the Acoustical Society of America.

[12]  Clemens Zierhofer,et al.  Electric-acoustic pitch comparisons in single-sided-deaf cochlear implant users: Frequency-place functions and rate pitch , 2014, Hearing Research.

[13]  R. Fay,et al.  Pitch : neural coding and perception , 2005 .

[14]  Xin Luo,et al.  Pitch contour identification with combined place and temporal cues using cochlear implants. , 2012, The Journal of the Acoustical Society of America.

[15]  Brett A. Swanson,et al.  Pitch perception with cochlear implants , 2008 .

[16]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[17]  C. Hansel,et al.  Synaptic Plasticity: Cerebellum , 2009 .

[18]  David B. Grayden,et al.  Application of a pitch perception model to investigate the effect of stimulation field spread on the pitch ranking abilities of cochlear implant recipients , 2014, Hearing Research.

[19]  Lawrence T. Cohen,et al.  Practical model description of peripheral neural excitation in cochlear implant recipients: 1. Growth of loudness and ECAP amplitude with current , 2009, Hearing Research.

[20]  M. White,et al.  A stochastic model of the electrically stimulated auditory nerve: pulse-train response , 1999, IEEE Transactions on Biomedical Engineering.

[21]  Blake S. Wilson,et al.  Speech processors for cochlear prostheses , 1988, Proc. IEEE.

[22]  Muhammad S A Zilany,et al.  Modeling auditory-nerve responses for high sound pressure levels in the normal and impaired auditory periphery. , 2006, The Journal of the Acoustical Society of America.

[23]  D. D. Greenwood.  A cochlear frequency-position function for several species--29 years later. , 1990, The Journal of the Acoustical Society of America.

[24]  Hugh J. McDermott,et al.  Pitch ranking of complex tones by normally hearing subjects and cochlear implant users , 2007, Hearing Research.

[25]  F. Giaccai.  [Frequency discrimination]. , 1972, JFORL. Journal francais d'oto-rhino-laryngologie; audiophonologie et chirurgie maxillo-faciale.

[26]  T. Harczos.  Cochlear implant electrode stimulation strategy based on a human auditory model , 2015 .

[27]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. I. Pitch and pitch salience. , 1996, Journal of neurophysiology.

[28]  R. Zatorre,et al.  Pitch perception of complex tones and human temporal-lobe function. , 1988, The Journal of the Acoustical Society of America.

[29]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[30]  Stuart Rosen,et al.  Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. , 2004, The Journal of the Acoustical Society of America.

[31]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. II. Pitch shift, pitch ambiguity, phase invariance, pitch circularity, rate pitch, and the dominance region for pitch. , 1996, Journal of neurophysiology.

[32]  María G. Cisneros-Solís,et al.  MEDICAL ANNUAL , 1958, Journal of The Royal Naval Medical Service.

[33]  Lawrence T. Cohen,et al.  Practical model description of peripheral neural excitation in cochlear implant recipients: 2. Spread of the effective stimulation field (ESF), from ECAP and FEA , 2009, Hearing Research.

[34]  G. Clark,et al.  Psychophysical studies evaluating the feasibility of a speech processing strategy for a multiple-channel cochlear implant. , 1983, The Journal of the Acoustical Society of America.

[35]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[36]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[37]  Graeme M. Clark,et al.  Pitch comparisons of acoustically and electrically evoked auditory sensations , 1996, Hearing Research.

[38]  Jan Wouters,et al.  Better place-coding of the fundamental frequency in cochlear implants. , 2004, The Journal of the Acoustical Society of America.

[39]  R. Carlyon,et al.  Limitations on rate discrimination. , 2002, The Journal of the Acoustical Society of America.

[40]  D J Van Tasell,et al.  Electrode ranking of "place pitch" and speech recognition in electrical hearing. , 1995, The Journal of the Acoustical Society of America.

[41]  Lawrence T. Cohen,et al.  Practical model description of peripheral neural excitation in cochlear implant recipients: 3. ECAP during bursts and loudness as function of burst duration , 2009, Hearing Research.

[42]  M. Dorman,et al.  Central Auditory System Development and Plasticity After Cochlear Implantation , 2011 .

[43]  V. Han,et al.  Synaptic plasticity in a cerebellum-like structure depends on temporal order , 1997, Nature.

[44]  David B. Grayden,et al.  Learning Pitch with STDP: A Computational Model of Place and Temporal Pitch Perception Using Spiking Neural Networks , 2016, PLoS Comput. Biol..