Simple spectral transformations capture the contribution of peripheral processing to cortical responses to natural sounds

Processing in the sensory periphery involves various mechanisms that enable the detection and discrimination of sensory information. Despite their biological complexity, could these processing steps sub-serve a relatively simple transformation of sensory inputs, which are then transmitted to the CNS? Here we explored both biologically-detailed and very simple models of the auditory periphery to find the appropriate input to a phenomenological model of auditory cortical responses to natural sounds. We examined a range of cochlear models, from those involving detailed biophysical characteristics of the cochlea and auditory nerve to very pared-down spectrogram-like approximations of the information processing in these structures. We tested the capacity of these models to predict the time-course of single-unit neural responses recorded in the ferret primary auditory cortex, when combined with a linear non-linear encoding model. We show that a simple model based on a log-spaced, log-scaled power spectrogram with Hill-function compression performs as well as biophysically-detailed models of the cochlea and the auditory nerve. These findings emphasize the value of using appropriate simple models of the periphery when building encoding models of sensory processing in the brain, and imply that the complex properties of the auditory periphery may together result in a simpler than expected functional transformation of the inputs.

[1]  Mee Young Park,et al.  L1‐regularization path algorithm for generalized linear models , 2007 .

[2]  Laurel H Carney,et al.  Updated parameters and expanded simulation options for a model of the auditory periphery. , 2014, The Journal of the Acoustical Society of America.

[3]  Andrew J King,et al.  A dynamic network model of temporal receptive fields in primary auditory cortex , 2019, PLoS Comput. Biol..

[4]  Thane Fremouw,et al.  Sound representation methods for spectro-temporal receptive field estimation , 2006, Journal of Computational Neuroscience.

[5]  C. Schreiner,et al.  Nonlinear Spectrotemporal Sound Analysis by Neurons in the Auditory Midbrain , 2002, The Journal of Neuroscience.

[6]  Lee M. Miller,et al.  Spectrotemporal receptive fields in the lemniscal auditory thalamus and cortex. , 2002, Journal of neurophysiology.

[7]  Sarah Verhulst,et al.  Computational modeling of the human auditory periphery: Auditory-nerve responses, evoked potentials and hearing loss , 2017, Hearing Research.

[8]  A. Aertsen,et al.  Prediction of the responses of auditory neurons in the midbrain of the grass frog based on the spectro-temporal receptive field , 1983, Hearing Research.

[9]  Neil C. Rabinowitz,et al.  Contrast Gain Control in Auditory Cortex , 2011, Neuron.

[10]  Tim Jürgens,et al.  A computer model of the auditory periphery and its application to the study of hearing. , 2013, Advances in experimental medicine and biology.

[11]  M. Merzenich,et al.  Optimizing sound features for cortical neurons. , 1998, Science.

[12]  Christian J Sumner,et al.  Auditory nerve fibre responses in the ferret , 2012, The European journal of neuroscience.

[13]  Ray Meddis,et al.  A revised model of the inner-hair cell and auditory-nerve complex. , 2002, The Journal of the Acoustical Society of America.

[14]  Eero P. Simoncelli,et al.  Article Sound Texture Perception via Statistics of the Auditory Periphery: Evidence from Sound Synthesis , 2022 .

[15]  Andrew J. King,et al.  Linear processing of spatial cues in primary auditory cortex , 2001, Nature.

[16]  L. Carney,et al.  Power-Law Dynamics in an Auditory-Nerve Model Can Account for Neural Adaptation to Sound-Level Statistics , 2010, The Journal of Neuroscience.

[17]  Alan R Palmer,et al.  Phase-locked responses to pure tones in the primary auditory cortex , 2002, Hearing Research.

[18]  Ian C. Bruce,et al.  A phenomenological model of the synapse between the inner hair cell and auditory nerve: Implications of limited neurotransmitter release sites , 2017, Hearing Research.

[19]  Ray Meddis,et al.  A nonlinear filter-bank model of the guinea-pig cochlear nerve: rate responses. , 2003, The Journal of the Acoustical Society of America.

[20]  K. Sen,et al.  Spectral-temporal Receptive Fields of Nonlinear Auditory Neurons Obtained Using Natural Sounds , 2022 .

[21]  J. Eggermont,et al.  Spectrotemporal receptive fields in anesthetized cat primary auditory cortex are context dependent. , 2009, Cerebral cortex.

[22]  B. Willmore,et al.  Incorporating Midbrain Adaptation to Mean Sound Level Improves Models of Auditory Cortical Processing , 2016, The Journal of Neuroscience.

[23]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[24]  Christian J Sumner,et al.  Mammalian behavior and physiology converge to confirm sharper cochlear tuning in humans , 2018, Proceedings of the National Academy of Sciences.

[25]  C. Atencio,et al.  Cooperative Nonlinearities in Auditory Cortical Neurons , 2008, Neuron.

[26]  A. Saremi,et al.  Effect of metabolic presbyacusis on cochlear responses: a simulation approach using a physiologically-based model. , 2013, The Journal of the Acoustical Society of America.

[27]  Laurel H. Carney,et al.  Quantifying the Information in Auditory-Nerve Responses for Level Discrimination , 2003, Journal of the Association for Research in Otolaryngology.

[28]  M. B. Sachs,et al.  Rate versus level functions for auditory‐nerve fibers in cats: Bandlimited noise bursts , 1978 .

[29]  S. David,et al.  Rapid Synaptic Depression Explains Nonlinear Modulation of Spectro-Temporal Tuning in Primary Auditory Cortex by Natural Stimuli , 2009, The Journal of Neuroscience.

[30]  Jonathan Z. Simon,et al.  Robust Spectrotemporal Reverse Correlation for the Auditory System: Optimizing Stimulus Design , 2000, Journal of Computational Neuroscience.

[31]  Robert Oostenveld,et al.  Neuronal Oscillations with Non-sinusoidal Morphology Produce Spurious Phase-to-Amplitude Coupling and Directionality , 2016, Front. Comput. Neurosci..

[32]  Laurel H Carney,et al.  A phenomenological model of the synapse between the inner hair cell and auditory nerve: long-term adaptation with power-law dynamics. , 2009, The Journal of the Acoustical Society of America.

[33]  A. R. Palmer,et al.  Location of cells giving phase-locked responses to pure tones in the primary auditory cortex , 2011, Hearing Research.

[34]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[35]  Kuansan Wang,et al.  Self-normalization and noise-robustness in early auditory representations , 1994, IEEE Trans. Speech Audio Process..

[36]  A. Aertsen,et al.  A comparison of the Spectro-Temporal sensitivity of auditory neurons to tonal and natural stimuli , 1981, Biological Cybernetics.

[37]  Powen Ru,et al.  Multiresolution spectrotemporal analysis of complex sounds. , 2005, The Journal of the Acoustical Society of America.

[38]  Andrew J. King,et al.  Network Receptive Field Modeling Reveals Extensive Integration and Multi-feature Selectivity in Auditory Cortical Neurons , 2016, PLoS Comput. Biol..

[39]  Mladen Russo,et al.  Robust Cochlear-Model-Based Speech Recognition , 2019, Comput..

[40]  Richard F. Lyon,et al.  A computational model of filtering, detection, and compression in the cochlea , 1982, ICASSP.

[41]  Christian J. Sumner,et al.  Changes in Neuronal Representations of Consonants in the Ascending Auditory System and Their Role in Speech Recognition , 2018, Front. Neurosci..

[42]  M. Sahani,et al.  The Consequences of Response Nonlinearities for Interpretation of Spectrotemporal Receptive Fields , 2008, The Journal of Neuroscience.

[43]  Adam M. Croom Auditory Neuroscience: Making Sense of Sound , 2014 .

[44]  J. Fritz,et al.  Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex , 2003, Nature Neuroscience.

[45]  K. Wang,et al.  Auditory analysis of spectro-temporal information in acoustic signals , 1995 .

[46]  Ray Meddis,et al.  Auditory-nerve first-spike latency and auditory absolute threshold: a computer model. , 2006, The Journal of the Acoustical Society of America.

[47]  Richard F Lyon,et al.  Cascades of two-pole-two-zero asymmetric resonators are good models of peripheral auditory function. , 2011, The Journal of the Acoustical Society of America.

[48]  Sarah M. N. Woolley,et al.  A Generalized Linear Model for Estimating Spectrotemporal Receptive Fields from Responses to Natural Sounds , 2011, PloS one.

[49]  Tomaso Poggio,et al.  From Understanding Computation to Understanding Neural Circuitry , 1976 .

[50]  E. Lopez-Poveda,et al.  A computational algorithm for computing nonlinear auditory frequency selectivity. , 2001, The Journal of the Acoustical Society of America.

[51]  A R Palmer,et al.  Phase‐locked responses to pure tones in guinea pig auditory cortex , 2000, Neuroreport.

[52]  Christoph E Schreiner,et al.  Spectrotemporal structure of receptive fields in areas AI and AAF of mouse auditory cortex. , 2003, Journal of neurophysiology.