The Consequences of Response Nonlinearities for Interpretation of Spectrotemporal Receptive Fields

Neurons in the central auditory system are often described by the spectrotemporal receptive field (STRF), conventionally defined as the best linear fit between the spectrogram of a sound and the spike rate it evokes. An STRF is often assumed to provide an estimate of the receptive field of a neuron, i.e., the spectral and temporal range of stimuli that affect the response. However, when the true stimulus–response function is nonlinear, the STRF will be stimulus dependent, and changes in the stimulus properties can alter estimates of the sign and spectrotemporal extent of receptive field components. We demonstrate analytically and in simulations that, even when uncorrelated stimuli are used, interactions between simple neuronal nonlinearities and higher-order structure in the stimulus can produce STRFs that show contributions from time–frequency combinations to which the neuron is actually insensitive. Only when spectrotemporally independent stimuli are used does the STRF reliably indicate features of the underlying receptive field, and even then it provides only a conservative estimate. One consequence of these observations, illustrated using natural stimuli, is that a stimulus-induced change in an STRF could arise from a consistent but nonlinear neuronal response to stimulus ensembles with differing higher-order dependencies. Thus, although the responses of higher auditory neurons may well involve adaptation to the statistics of different stimulus ensembles, stimulus dependence of STRFs alone, or indeed of any overly constrained stimulus–response mapping, cannot demonstrate the nature or magnitude of such effects.

[1]  N. Suga,et al.  Cortical neurons sensitive to combinations of information-bearing elements of biosonar signals in the mustache bat. , 1978, Science.

[2]  E. de Boer,et al.  On cochlear encoding: potentialities and limitations of the reverse-correlation technique. , 1978, The Journal of the Acoustical Society of America.

[3]  J. J. Eggermont,et al.  Quantitative characterisation procedure for auditory neurons based on the spectro-temporal receptive field , 1983, Hearing Research.

[4]  A. Aertsen,et al.  Prediction of the responses of auditory neurons in the midbrain of the grass frog based on the spectro-temporal receptive field , 1983, Hearing Research.

[5]  G Palm,et al.  Volterra representation and Wiener-like identification of nonlinear systems: scope and limitations , 1985, Quarterly Reviews of Biophysics.

[6]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[7]  Jonathan G. Fiscus,et al.  Darpa Timit Acoustic-Phonetic Continuous Speech Corpus CD-ROM {TIMIT} | NIST , 1993 .

[8]  J. Eggermont Wiener and Volterra analyses applied to the auditory system , 1993, Hearing Research.

[9]  S. Shamma,et al.  Analysis of dynamic spectra in ferret primary auditory cortex. I. Characteristics of single-unit responses to moving ripple spectra. , 1996, Journal of neurophysiology.

[10]  S. Shamma,et al.  Analysis of dynamic spectra in ferret primary auditory cortex. II. Prediction of unit responses to arbitrary dynamic spectra. , 1996, Journal of neurophysiology.

[11]  Christoph E. Schreiner,et al.  Perturbative M-Sequences for Auditory Systems Identification , 1997, NIPS.

[12]  C. Schreiner,et al.  Spectral envelope coding in cat primary auditory cortex: linear and non‐linear effects of stimulus characteristics , 1998, The European journal of neuroscience.

[13]  M. Merzenich,et al.  Optimizing sound features for cortical neurons. , 1998, Science.

[14]  C. Schreiner,et al.  Organization of inhibitory frequency receptive fields in cat primary auditory cortex. , 1999, Journal of neurophysiology.

[15]  K. Sen,et al.  Spectral-temporal Receptive Fields of Nonlinear Auditory Neurons Obtained Using Natural Sounds , 2022 .

[16]  L. Abbott,et al.  Divisive inhibition in recurrent networks , 2000, Network.

[17]  Andrew J. King,et al.  Linear processing of spatial cues in primary auditory cortex , 2001, Nature.

[18]  Maneesh Sahani,et al.  How Linear are Auditory Cortical Responses? , 2002, NIPS.

[19]  Lee M. Miller,et al.  Spectrotemporal receptive fields in the lemniscal auditory thalamus and cortex. , 2002, Journal of neurophysiology.

[20]  I. Nelken,et al.  Responses of Neurons in Cat Primary Auditory Cortex to Bird Chirps: Effects of Temporal and Spectral Context , 2002, The Journal of Neuroscience.

[21]  C. Schreiner,et al.  Nonlinear Spectrotemporal Sound Analysis by Neurons in the Auditory Midbrain , 2002, The Journal of Neuroscience.

[22]  Alan R. Palmer,et al.  Spectrotemporal Receptive Field Properties of Single Units in the Primary, Dorsocaudal and Ventrorostral Auditory Cortex of the Guinea Pig , 2002, Audiology and Neurotology.

[23]  M. Merzenich,et al.  Changes of AI receptive fields with sound density. , 2002, Journal of neurophysiology.

[24]  C. Schreiner,et al.  Gabor analysis of auditory midbrain receptive fields: spectro-temporal and binaural composition. , 2003, Journal of neurophysiology.

[25]  Xiaoqin Wang,et al.  Auditory Cortical Responses Elicited in Awake Primates by Random Spectrum Stimuli , 2003, The Journal of Neuroscience.

[26]  Xiaoqin Wang,et al.  Spectral integration in A1 of awake primates: neurons with single- and multipeaked tuning characteristics. , 2003, Journal of neurophysiology.

[27]  A. Zador,et al.  Balanced inhibition underlies tuning and sharpens spike timing in auditory cortex , 2003, Nature.

[28]  Christoph E Schreiner,et al.  Spectrotemporal structure of receptive fields in areas AI and AAF of mouse auditory cortex. , 2003, Journal of neurophysiology.

[29]  A. Aertsen,et al.  Spectro-temporal receptive fields of auditory neurons in the grassfrog , 1980, Biological Cybernetics.

[30]  A. Aertsen,et al.  Spectro-temporal receptive fields of auditory neurons in the grassfrog , 1980, Biological Cybernetics.

[31]  Spectro-temporal receptive fields of auditory neurons in the grassfrog , 2004, Biological Cybernetics.

[32]  William Bialek,et al.  Analyzing Neural Responses to Natural Signals: Maximally Informative Dimensions , 2002, Neural Computation.

[33]  Jonathan Z. Simon,et al.  Robust Spectrotemporal Reverse Correlation for the Auditory System: Optimizing Stimulus Design , 2000, Journal of Computational Neuroscience.

[34]  A. Aertsen,et al.  A comparison of the Spectro-Temporal sensitivity of auditory neurons to tonal and natural stimuli , 1981, Biological Cybernetics.

[35]  Eero P. Simoncelli,et al.  To appear in: The New Cognitive Neurosciences, 3rd edition Editor: M. Gazzaniga. MIT Press, 2004. Characterization of Neural Responses with Stochastic Stimuli , 2022 .

[36]  J. Eggermont,et al.  Stimulus dependence of spectro-temporal receptive fields in cat primary auditory cortex , 2004, Hearing Research.

[37]  Christian K. Machens,et al.  Linearity of Cortical Receptive Fields Measured with Natural Sounds , 2004, The Journal of Neuroscience.

[38]  H. Sompolinsky,et al.  Adaptation without parameter change: Dynamic gain control in motion detection , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Eero P. Simoncelli,et al.  Spatiotemporal Elements of Macaque V1 Receptive Fields , 2005, Neuron.

[40]  Jonathan Z. Simon,et al.  Stimulus-invariant processing and spectrotemporal reverse correlation in primary auditory cortex , 2005, Journal of Computational Neuroscience.

[41]  J. Fritz,et al.  Active listening: Task-dependent plasticity of spectrotemporal receptive fields in primary auditory cortex , 2005, Hearing Research.

[42]  Xiaoqin Wang,et al.  Sustained firing in auditory cortex evoked by preferred stimuli , 2005, Nature.

[43]  Eero P. Simoncelli,et al.  Spike-triggered neural characterization. , 2006, Journal of vision.

[44]  D. Depireux,et al.  Response adaptation to broadband sounds in primary auditory cortex of the awake ferret , 2006, Hearing Research.

[45]  Katherine I. Nagel,et al.  Temporal Processing and Adaptation in the Songbird Auditory Forebrain , 2006, Neuron.

[46]  Sarah M. N. Woolley,et al.  Stimulus-Dependent Auditory Tuning Results in Synchronous Population Coding of Vocalizations in the Songbird Midbrain , 2006, The Journal of Neuroscience.

[47]  Michael S. Lewicki,et al.  Efficient auditory coding , 2006, Nature.

[48]  Richard Webb Cartography: A popular perspective , 2006, Nature.

[49]  M. Sahani,et al.  Nonlinearities and Contextual Influences in Auditory Cortical Responses Modeled with Multilinear Spectrotemporal Methods , 2008, The Journal of Neuroscience.

[50]  B. Batlogg,et al.  Auditory Spatial Receptive Fields Created by Multiplication , 2022 .