The Essential Complexity of Auditory Receptive Fields

Encoding properties of sensory neurons are commonly modeled using linear finite impulse response (FIR) filters. For the auditory system, the FIR filter is instantiated in the spectro-temporal receptive field (STRF), often in the framework of the generalized linear model. Despite widespread use of the FIR STRF, numerous formulations for linear filters are possible that require many fewer parameters, potentially permitting more efficient and accurate model estimates. To explore these alternative STRF architectures, we recorded single-unit neural activity from auditory cortex of awake ferrets during presentation of natural sound stimuli. We compared performance of > 1000 linear STRF architectures, evaluating their ability to predict neural responses to a novel natural stimulus. Many were able to outperform the FIR filter. Two basic constraints on the architecture lead to the improved performance: (1) factorization of the STRF matrix into a small number of spectral and temporal filters and (2) low-dimensional parameterization of the factorized filters. The best parameterized model was able to outperform the full FIR filter in both primary and secondary auditory cortex, despite requiring fewer than 30 parameters, about 10% of the number required by the FIR filter. After accounting for noise from finite data sampling, these STRFs were able to explain an average of 40% of A1 response variance. The simpler models permitted more straightforward interpretation of sensory tuning properties. They also showed greater benefit from incorporating nonlinear terms, such as short term plasticity, that provide theoretical advances over the linear model. Architectures that minimize parameter count while maintaining maximum predictive power provide insight into the essential degrees of freedom governing auditory cortical function. They also maximize statistical power available for characterizing additional nonlinear properties that limit current auditory models.

[1]  S. David,et al.  Rapid Synaptic Depression Explains Nonlinear Modulation of Spectro-Temporal Tuning in Primary Auditory Cortex by Natural Stimuli , 2009, The Journal of Neuroscience.

[2]  Jean Liénard,et al.  A biologically constrained model of the whole basal ganglia addressing the paradoxes of connections and selection , 2013, Journal of Computational Neuroscience.

[3]  Maneesh Sahani,et al.  Equating information-theoretic and likelihood-based methods for neural dimensionality reduction , 2013, 1308.3542.

[4]  Richard F. Lyon,et al.  Practical Gammatone-Like Filters for Auditory Processing , 2006, EURASIP J. Audio Speech Music. Process..

[5]  Katherine I. Nagel,et al.  Organizing Principles of Spectro-Temporal Encoding in the Avian Primary Auditory Area Field L , 2008, Neuron.

[6]  L. Paninski,et al.  Inferring input nonlinearities in neural encoding models , 2008, Network.

[7]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[8]  Powen Ru,et al.  Multiresolution spectrotemporal analysis of complex sounds. , 2005, The Journal of the Acoustical Society of America.

[9]  Mijung Park,et al.  Bayesian inference for low rank spatiotemporal neural receptive fields , 2013, NIPS.

[10]  John Hallam,et al.  From Animals to Animats 10 , 2008 .

[11]  Katherine I. Nagel,et al.  Biophysical mechanisms underlying olfactory receptor neuron dynamics , 2010, Nature Neuroscience.

[12]  S. Baccus,et al.  Linking the Computational Structure of Variance Adaptation to Biophysical Mechanisms , 2012, Neuron.

[13]  S. David,et al.  Integration over Multiple Timescales in Primary Auditory Cortex , 2013, The Journal of Neuroscience.

[14]  J. Eggermont Wiener and Volterra analyses applied to the auditory system , 1993, Hearing Research.

[15]  J. P. Jones,et al.  The two-dimensional spectral structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[16]  Hod Lipson,et al.  The evolutionary origins of modularity , 2012, Proceedings of the Royal Society B: Biological Sciences.

[17]  I. Ohzawa,et al.  Functional Micro-Organization of Primary Visual Cortex: Receptive Field Analysis of Nearby Neurons , 1999, The Journal of Neuroscience.

[18]  Jonathan Z. Simon,et al.  Robust Spectrotemporal Reverse Correlation for the Auditory System: Optimizing Stimulus Design , 2000, Journal of Computational Neuroscience.

[19]  G. DeAngelis,et al.  Spatiotemporal receptive field organization in the lateral geniculate nucleus of cats and kittens. , 1997, Journal of neurophysiology.

[20]  J. Eggermont,et al.  Comparison of LFP-Based and Spike-Based Spectro-Temporal Receptive Fields and Cross-Correlation in Cat Primary Auditory Cortex , 2011, PloS one.

[21]  M. Carandini,et al.  Functional Mechanisms Shaping Lateral Geniculate Responses to Artificial and Natural Stimuli , 2008, Neuron.

[22]  Jean-Marc Edeline,et al.  Bursts in the medial geniculate body: a comparison between anesthetized and unanesthetized states in guinea pig , 2003, Experimental Brain Research.

[23]  Ione Fine,et al.  Population receptive field estimates of human auditory cortex , 2015, NeuroImage.

[24]  Charles Gide,et al.  Cours d'économie politique , 1911 .

[25]  A. Shamsai,et al.  Multi-objective Optimization , 2017, Encyclopedia of Machine Learning and Data Mining.

[26]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[27]  Josh H McDermott,et al.  Recovering sound sources from embedded repetition , 2011, Proceedings of the National Academy of Sciences.

[28]  Jonathan Z. Simon,et al.  Temporal Symmetry in Primary Auditory Cortex: Implications for Cortical Connectivity , 2006, Neural Computation.

[29]  M. Merzenich,et al.  Optimizing sound features for cortical neurons. , 1998, Science.

[30]  Shihab A Shamma,et al.  Task reward structure shapes rapid receptive field plasticity in auditory cortex , 2012, Proceedings of the National Academy of Sciences.

[31]  H. Versnel,et al.  Spectrotemporal Response Properties of Core Auditory Cortex Neurons in Awake Monkey , 2015, PloS one.

[32]  Liam Paninski,et al.  Spatiotemporal receptive fields of barrel cortex revealed by reverse correlation of synaptic input , 2014, Nature Neuroscience.

[33]  Maneesh Sahani,et al.  Evidence Optimization Techniques for Estimating Stimulus-Response Functions , 2002, NIPS.

[34]  Nadja Schinkel-Bielefeld,et al.  Inferring the role of inhibition in auditory processing of complex natural stimuli. , 2012, Journal of neurophysiology.

[35]  Alexander Borst,et al.  Quantifying variability in neural responses and its application for the validation of model predictions , 2004, Network.

[36]  J. Fritz,et al.  Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex , 2003, Nature Neuroscience.

[37]  A. Zador,et al.  Long-lasting context dependence constrains neural encoding models in rodent auditory cortex. , 2008, Journal of neurophysiology.

[38]  Enrique Alba,et al.  Today/future importance analysis , 2010, GECCO '10.

[39]  Jonathan Z. Simon,et al.  Stimulus-invariant processing and spectrotemporal reverse correlation in primary auditory cortex , 2005, Journal of Computational Neuroscience.

[40]  D. A. Depireux,et al.  Dynamics of phase-independent spectro-temporal tuning in primary auditory cortex of the awake ferret , 2012, Neuroscience.

[41]  Craig A. Atencio,et al.  Spectrotemporal Processing in Spectral Tuning Modules of Cat Primary Auditory Cortex , 2012, PloS one.

[42]  Yuwei Cui,et al.  Inferring Nonlinear Neuronal Computation Based on Physiologically Plausible Inputs , 2013, PLoS Comput. Biol..

[43]  K. Sen,et al.  Spectral-temporal Receptive Fields of Nonlinear Auditory Neurons Obtained Using Natural Sounds , 2022 .

[44]  M. Hoen,et al.  Using auditory classification images for the identification of fine acoustic cues used in speech perception , 2013, Front. Hum. Neurosci..

[45]  Maneesh Sahani,et al.  How Linear are Auditory Cortical Responses? , 2002, NIPS.

[46]  Neil C. Rabinowitz,et al.  Spectrotemporal Contrast Kernels for Neurons in Primary Auditory Cortex , 2012, The Journal of Neuroscience.

[47]  A. Aertsen,et al.  The Spectro-Temporal Receptive Field , 1981, Biological Cybernetics.

[48]  J. Gallant,et al.  Complete functional characterization of sensory neurons by system identification. , 2006, Annual review of neuroscience.

[49]  S. Shamma,et al.  Analysis of dynamic spectra in ferret primary auditory cortex. I. Characteristics of single-unit responses to moving ripple spectra. , 1996, Journal of neurophysiology.

[50]  S. David,et al.  Estimating sparse spectro-temporal receptive fields with natural stimuli , 2007, Network.

[51]  Julie E. Elie,et al.  Neural processing of natural sounds , 2014, Nature Reviews Neuroscience.

[52]  Thane Fremouw,et al.  Sound representation methods for spectro-temporal receptive field estimation , 2006, Journal of Computational Neuroscience.

[53]  Lee M. Miller,et al.  Spectrotemporal receptive fields in the lemniscal auditory thalamus and cortex. , 2002, Journal of neurophysiology.

[54]  H. Scheich,et al.  Learning-induced dynamic receptive field changes in primary auditory cortex of the unanaesthetized Mongolian gerbil , 1997, Journal of Comparative Physiology A.

[55]  S. David,et al.  Emergent Selectivity for Task-Relevant Stimuli in Higher-Order Auditory Cortex , 2014, Neuron.

[56]  Sarah M. N. Woolley,et al.  A Generalized Linear Model for Estimating Spectrotemporal Receptive Fields from Responses to Natural Sounds , 2011, PloS one.

[57]  Concha Bielza,et al.  Optimizing Brain Networks Topologies Using Multi-objective Evolutionary Computation , 2011, Neuroinformatics.

[58]  Jean Liénard,et al.  Multi-objective Evolutionary Algorithms to Investigate Neurocomputational Issues: The Case Study of Basal Ganglia Models , 2010, SAB.

[59]  Duane Q Nykamp,et al.  Full identification of a linear-nonlinear system via cross-correlation analysis. , 2002, Journal of vision.

[60]  Henry Markram,et al.  A Novel Multiple Objective Optimization Framework for Constraining Conductance-Based Neuron Models by Experimental Data , 2007, Front. Neurosci..

[61]  Eero P. Simoncelli,et al.  Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Encoding Model , 2004, Neural Computation.

[62]  C. Atencio,et al.  Receptive field dimensionality increases from the auditory midbrain to cortex. , 2012, Journal of neurophysiology.

[63]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.

[64]  Christian K. Machens,et al.  Linearity of Cortical Receptive Fields Measured with Natural Sounds , 2004, The Journal of Neuroscience.

[65]  J. Gallant,et al.  Predicting neuronal responses during natural vision , 2005, Network.

[66]  N. C. Singh,et al.  Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli , 2001 .

[67]  Mijung Park,et al.  Receptive Field Inference with Localized Priors , 2011, PLoS Comput. Biol..

[68]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[69]  Stéphane Doncieux,et al.  Importing the computational neuroscience toolbox into neuro-evolution-application to basal ganglia , 2010, GECCO '10.

[70]  H. Akaike A new look at the statistical model identification , 1974 .

[71]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[72]  Futoshi Asano,et al.  Detection and Separation of Speech Events in Meeting Recordings Using a Microphone Array , 2007, EURASIP J. Audio Speech Music. Process..

[73]  Matthias Bethge,et al.  Beyond GLMs: A Generative Mixture Modeling Approach to Neural System Identification , 2012, PLoS Comput. Biol..

[74]  I. Nelken,et al.  Sensitivity to Complex Statistical Regularities in Rat Auditory Cortex , 2012, Neuron.

[75]  C. Atencio,et al.  Cooperative Nonlinearities in Auditory Cortical Neurons , 2008, Neuron.

[76]  Stephen V. David,et al.  Cortical Membrane Potential Signature of Optimal States for Sensory Signal Detection , 2015, Neuron.

[77]  Eric D Young,et al.  Effects of stimulus spectral contrast on receptive fields of dorsal cochlear nucleus neurons. , 2007, Journal of neurophysiology.

[78]  I. Nelken,et al.  Functional organization of ferret auditory cortex. , 2005, Cerebral cortex.

[79]  Jean-Baptiste Mouret,et al.  On the Relationships between Generative Encodings, Regularity, and Learning Abilities when Evolving Plastic Artificial Neural Networks , 2013, PloS one.

[80]  J. Ostwald,et al.  Anesthesia changes frequency tuning of neurons in the rat primary auditory cortex. , 2001, Journal of neurophysiology.

[81]  Michael M Merzenich,et al.  Perceptual Learning Directs Auditory Cortical Map Reorganization through Top-Down Influences , 2006, The Journal of Neuroscience.

[82]  S. A. Shamma,et al.  MANTA—an open-source, high density electrophysiology recording suite for MATLAB , 2013, Front. Neural Circuits.

[83]  J. DiCarlo,et al.  Structure of Receptive Fields in Area 3b of Primary Somatosensory Cortex in the Alert Monkey , 1998, The Journal of Neuroscience.