Nonlinearities and Contextual Influences in Auditory Cortical Responses Modeled with Multilinear Spectrotemporal Methods

The relationship between a sound and its neural representation in the auditory cortex remains elusive. Simple measures such as the frequency response area or frequency tuning curve provide little insight into the function of the auditory cortex in complex sound environments. Spectrotemporal receptive field (STRF) models, despite their descriptive potential, perform poorly when used to predict auditory cortical responses, showing that nonlinear features of cortical response functions, which are not captured by STRFs, are functionally important. We introduce a new approach to the description of auditory cortical responses, using multilinear modeling methods. These descriptions simultaneously account for several nonlinearities in the stimulus–response functions of auditory cortical neurons, including adaptation, spectral interactions, and nonlinear sensitivity to sound level. The models reveal multiple inseparabilities in cortical processing of time lag, frequency, and sound level, and suggest functional mechanisms by which auditory cortical neurons are sensitive to stimulus context. By explicitly modeling these contextual influences, the models are able to predict auditory cortical responses more accurately than are STRF models. In addition, they can explain some forms of stimulus dependence in STRFs that were previously poorly understood.

[1]  K. Narendra,et al.  An iterative method for the identification of nonlinear systems using a Hammerstein model , 1966 .

[2]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[3]  B. Moore An Introduction to the Psychology of Hearing , 1977 .

[4]  Vasilis Z. Marmarelis,et al.  Analysis of Physiological Systems , 1978, Computers in Biology and Medicine.

[5]  B C Moore Mechanism and frequency distribution of two-tone suppression in forward masking. , 1980, The Journal of the Acoustical Society of America.

[6]  D P Phillips,et al.  Responses of single neurons in physiologically defined primary auditory cortex (AI) of the cat: frequency tuning and responses to intensity. , 1981, Journal of neurophysiology.

[7]  W. Jesteadt,et al.  Forward masking as a function of frequency, masker level, and signal delay. , 1982, The Journal of the Acoustical Society of America.

[8]  J. Friedman,et al.  Estimating Optimal Transformations for Multiple Regression and Correlation. , 1985 .

[9]  The neural coding of simple and complex sounds in the auditory cortex , 1989 .

[10]  Norman M. Weinberger,et al.  Responses of single auditory cortical neurons to tone sequences , 1989, Brain Research.

[11]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[12]  Thomas G. Dietterich,et al.  In Advances in Neural Information Processing Systems 12 , 1991, NIPS 1991.

[13]  C. Schreiner,et al.  Physiology and topography of neurons with multipeaked tuning curves in cat primary auditory cortex. , 1991, Journal of neurophysiology.

[14]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[15]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[16]  Michael S. Lewicki,et al.  Bayesian Modeling and Classification of Neural Signals , 1993, Neural Computation.

[17]  R. Harshman,et al.  PARAFAC: parallel factor analysis , 1994 .

[18]  Michael B. Calford,et al.  Monaural inhibition in cat auditory cortex. , 1995, Journal of neurophysiology.

[19]  S. Shamma,et al.  Analysis of dynamic spectra in ferret primary auditory cortex. I. Characteristics of single-unit responses to moving ripple spectra. , 1996, Journal of neurophysiology.

[20]  S. Shamma,et al.  Analysis of dynamic spectra in ferret primary auditory cortex. II. Prediction of unit responses to arbitrary dynamic spectra. , 1996, Journal of neurophysiology.

[21]  C. Schreiner,et al.  Time course of forward masking tuning curves in cat primary auditory cortex. , 1997, Journal of neurophysiology.

[22]  M. Merzenich,et al.  Optimizing sound features for cortical neurons. , 1998, Science.

[23]  P. Paatero The Multilinear Engine—A Table-Driven, Least Squares Program for Solving Multilinear Problems, Including the n-Way Parallel Factor Analysis Model , 1999 .

[24]  William Bialek,et al.  Adaptive Rescaling Maximizes Information Transmission , 2000, Neuron.

[25]  K. Sen,et al.  Spectral-temporal Receptive Fields of Nonlinear Auditory Neurons Obtained Using Natural Sounds , 2022 .

[26]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[27]  M. Sutter Shapes and level tolerances of frequency tuning curves in primary auditory cortex: quantitative measures and population codes. , 2000, Journal of neurophysiology.

[28]  Philip H Smith,et al.  Fundamental differences between the thalamocortical recipient layers of the cat auditory and visual cortices , 2001, The Journal of comparative neurology.

[29]  S A Shamma,et al.  Spectro-temporal response field characterization with dynamic ripples in ferret primary auditory cortex. , 2001, Journal of neurophysiology.

[30]  Israel Nelken,et al.  Relating cluster and population responses to natural sounds and tonal stimuli in cat primary auditory cortex , 2001, Hearing Research.

[31]  A Fishbach,et al.  Auditory edge detection: a neural model for physiological and psychoacoustical responses to amplitude transients. , 2001, Journal of neurophysiology.

[32]  Maneesh Sahani,et al.  How Linear are Auditory Cortical Responses? , 2002, NIPS.

[33]  Lee M. Miller,et al.  Spectrotemporal receptive fields in the lemniscal auditory thalamus and cortex. , 2002, Journal of neurophysiology.

[34]  Maneesh Sahani,et al.  Evidence Optimization Techniques for Estimating Stimulus-Response Functions , 2002, NIPS.

[35]  I. Nelken,et al.  Responses of Neurons in Cat Primary Auditory Cortex to Bird Chirps: Effects of Temporal and Spectral Context , 2002, The Journal of Neuroscience.

[36]  M. Merzenich,et al.  Changes of AI receptive fields with sound density. , 2002, Journal of neurophysiology.

[37]  I. Nelken,et al.  Processing of low-probability sounds by cortical neurons , 2003, Nature Neuroscience.

[38]  Christoph E Schreiner,et al.  Spectrotemporal structure of receptive fields in areas AI and AAF of mouse auditory cortex. , 2003, Journal of neurophysiology.

[39]  A. Aertsen,et al.  Spectro-temporal receptive fields of auditory neurons in the grassfrog , 1980, Biological Cybernetics.

[40]  A. Aertsen,et al.  Spectro-temporal receptive fields of auditory neurons in the grassfrog , 1980, Biological Cybernetics.

[41]  M. J. Korenberg,et al.  The identification of nonlinear biological systems: Wiener and Hammerstein cascade models , 1986, Biological Cybernetics.

[42]  Spectro-temporal receptive fields of auditory neurons in the grassfrog , 2004, Biological Cybernetics.

[43]  J. Eggermont,et al.  Stimulus dependence of spectro-temporal receptive fields in cat primary auditory cortex , 2004, Hearing Research.

[44]  Christian K. Machens,et al.  Linearity of Cortical Receptive Fields Measured with Natural Sounds , 2004, The Journal of Neuroscience.

[45]  Demetri Terzopoulos,et al.  Multilinear independent components analysis , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[46]  E. Young,et al.  Nonlinear modeling of auditory-nerve rate responses to wideband stimuli. , 2005, Journal of neurophysiology.

[47]  H. Sompolinsky,et al.  Adaptation without parameter change: Dynamic gain control in motion detection , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[48]  J. Eggermont,et al.  Cross-correlation and joint spectro-temporal receptive field properties in auditory cortex. , 2005, Journal of neurophysiology.

[49]  A. Zador,et al.  Synaptic Mechanisms of Forward Suppression in Rat Auditory Cortex , 2005, Neuron.

[50]  I. Dean,et al.  Neural population coding of sound level adapts to stimulus statistics , 2005, Nature Neuroscience.

[51]  Edward L. Bartlett,et al.  Long-lasting modulation by stimulus context in primate auditory cortex. , 2005, Journal of neurophysiology.

[52]  Jennifer F. Linden,et al.  Fitting linear models to non-linear spectrotemporal receptive fields , 2006 .

[53]  Sarah M. N. Woolley,et al.  Stimulus-Dependent Auditory Tuning Results in Synchronous Population Coding of Vocalizations in the Songbird Midbrain , 2006, The Journal of Neuroscience.

[54]  Thane Fremouw,et al.  Sound representation methods for spectro-temporal receptive field estimation , 2006, Journal of Computational Neuroscience.

[55]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[56]  Jonathan Z. Simon,et al.  Temporal Symmetry in Primary Auditory Cortex: Implications for Cortical Connectivity , 2006, Neural Computation.

[57]  M. Sahani,et al.  The Consequences of Response Nonlinearities for Interpretation of Spectrotemporal Receptive Fields , 2008, The Journal of Neuroscience.

[58]  L. Paninski,et al.  Inferring input nonlinearities in neural encoding models , 2008, Network.