Diverse cortical codes for scene segmentation in primate auditory cortex.

The temporal coherence of amplitude fluctuations is a critical cue for segmentation of complex auditory scenes. The auditory system must accurately demarcate the onsets and offsets of acoustic signals. We explored how and how well the timing of onsets and offsets of gated tones are encoded by auditory cortical neurons in awake rhesus macaques. Temporal features of this representation were isolated by presenting otherwise identical pure tones of differing durations. Cortical response patterns were diverse, including selective encoding of onset and offset transients, tonic firing, and sustained suppression. Spike train classification methods revealed that many neurons robustly encoded tone duration despite substantial diversity in the encoding process. Excellent discrimination performance was achieved by neurons whose responses were primarily phasic at tone offset and by those that responded robustly while the tone persisted. Although diverse cortical response patterns converged on effective duration discrimination, this diversity significantly constrained the utility of decoding models referenced to a spiking pattern averaged across all responses or averaged within the same response category. Using maximum likelihood-based decoding models, we demonstrated that the spike train recorded in a single trial could support direct estimation of stimulus onset and offset. Comparisons between different decoding models established the substantial contribution of bursts of activity at sound onset and offset to demarcating the temporal boundaries of gated tones. Our results indicate that relatively few neurons suffice to provide temporally precise estimates of such auditory "edges," particularly for models that assume and exploit the heterogeneity of neural responses in awake cortex.

[1]  J. C. Hall,et al.  Sound duration selectivity in the pallid bat inferior colliculus , 1999, Hearing Research.

[2]  J. Rauschecker,et al.  Analogues of simple and complex cells in rhesus monkey auditory cortex , 2013, Proceedings of the National Academy of Sciences.

[3]  M. Scherg,et al.  Neuromagnetic Correlates of Streaming in Human Auditory Cortex , 2005, The Journal of Neuroscience.

[4]  Valentin Dragoi,et al.  Correlated Variability in Laminar Cortical Circuits , 2012, Neuron.

[5]  Albert S. Feng,et al.  Neural analysis of temporally patterned sounds in the frog's thalamus: Processing of pulse duration and pulse repetition rate , 1986, Neuroscience Letters.

[6]  Alexander J. Sadovsky,et al.  Mouse Visual Neocortex Supports Multiple Stereotyped Patterns of Microcircuit Activity , 2014, The Journal of Neuroscience.

[7]  Ellen Covey,et al.  Decoding stimulus duration from neural responses in the auditory midbrain. , 2014, Journal of neurophysiology.

[8]  Yu Sato,et al.  Neural and Behavioral Discrimination of Sound Duration by Cats , 2009, The Journal of Neuroscience.

[9]  Guglielmo Foffani,et al.  PSTH-based classification of sensory stimuli using ensembles of single neurons , 2004, Journal of Neuroscience Methods.

[10]  Brian H Scott,et al.  Dynamic amplitude coding in the auditory cortex of awake rhesus macaques. , 2007, Journal of neurophysiology.

[11]  Haim Sompolinsky,et al.  Implications of Neuronal Diversity on Population Coding , 2006, Neural Computation.

[12]  J. H. Casseday,et al.  Monaural and Binaural Inhibition Underlying Duration-Tuned Neurons in the Inferior Colliculus , 2014, The Journal of Neuroscience.

[13]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[14]  B. Grothe,et al.  Duration tuning in the mouse auditory midbrain. , 2000, Journal of neurophysiology.

[15]  Andrew R. Dykstra,et al.  Functional imaging of auditory scene analysis , 2014, Hearing Research.

[16]  Shreejoy J Tripathy,et al.  Intermediate intrinsic diversity enhances neural population coding , 2013, Proceedings of the National Academy of Sciences.

[17]  Brian H Scott,et al.  Transformation of temporal processing across auditory cortex of awake macaques. , 2011, Journal of neurophysiology.

[18]  Mounya Elhilali,et al.  Temporal coherence and the streaming of complex sounds. , 2013, Advances in experimental medicine and biology.

[19]  Robert C. Liu,et al.  Subset of thin spike cortical neurons preserve the peripheral encoding of stimulus onsets. , 2010, Journal of neurophysiology.

[20]  Christoph E Schreiner,et al.  Auditory Cortical Local Subnetworks Are Characterized by Sharply Synchronous Activity , 2013, The Journal of Neuroscience.

[21]  J. H. Casseday,et al.  Neural tuning for sound duration: role of inhibitory mechanisms in the inferior colliculus. , 1994, Science.

[22]  W. Yost Auditory image perception and analysis: The basis for hearing , 1991, Hearing Research.

[23]  M. A. Bee,et al.  The cocktail party problem: what is it? How can it be solved? And why should animal behaviorists study it? , 2008, Journal of comparative psychology.

[24]  R. Kulesza,et al.  Neurons in the medial nucleus of the trapezoid body and superior paraolivary nucleus of the rat may play a role in sound duration coding. , 2006, Journal of neurophysiology.

[25]  G. Recanzone,et al.  Spatial and temporal processing of single auditory cortical neurons and populations of neurons in the macaque monkey , 2011, Hearing Research.

[26]  J. Rauschecker,et al.  The role of auditory cortex in the formation of auditory streams , 2007, Hearing Research.

[27]  Xiaoqin Wang,et al.  Sustained firing in auditory cortex evoked by preferred stimuli , 2005, Nature.

[28]  Alexander V. Galazyuk,et al.  Encoding of sound duration by neurons in the auditory cortex of the little brown bat, Myotis lucifugus , 1997, Journal of Comparative Physiology A.

[29]  A S Feng,et al.  Temporal coding in the frog auditory midbrain: the influence of duration and rise-fall time on the processing of complex amplitude-modulated stimuli. , 1992, Journal of neurophysiology.

[30]  Marc A Heiser,et al.  Spectral Context Affects Temporal Processing in Awake Auditory Cortex , 2013, The Journal of Neuroscience.

[31]  Guang-Di Chen,et al.  Effects of stimulus duration on responses of neurons in the chinchilla inferior colliculus , 1998, Hearing Research.

[32]  A. Berrebi,et al.  Encoding of temporal features of auditory stimuli in the medial nucleus of the trapezoid body and superior paraolivary nucleus of the rat , 2008, Neuroscience.

[33]  Min Wu,et al.  Encoding repetition rate and duration in the inferior colliculus of the big brown bat, Eptesicus fuscus , 1991, Journal of Comparative Physiology A.

[34]  Nathaniel N Urban,et al.  Disrupting information coding via block of 4-AP-sensitive potassium channels. , 2014, Journal of neurophysiology.

[35]  Stefano Panzeri,et al.  Reading spike timing without a clock: intrinsic decoding of spike trains , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  Brandon Aubie,et al.  Duration Tuning across Vertebrates , 2012, The Journal of Neuroscience.

[37]  Sarah M N Woolley,et al.  Discrimination of communication vocalizations by single neurons and groups of neurons in the auditory midbrain. , 2010, Journal of neurophysiology.

[38]  Christoph Kapfer,et al.  Auditory response properties in the superior paraolivary nucleus of the gerbil. , 2002, Journal of neurophysiology.

[39]  T. Rammsayer,et al.  The effects of type of interval, sensory modality, base duration, and psychophysical task on the discrimination of brief time intervals , 2014, Attention, perception & psychophysics.

[40]  J. H. Casseday,et al.  Neural tuning to sound duration in the inferior colliculus of the big brown bat, Eptesicus fuscus. , 1997, Journal of neurophysiology.

[41]  M S Malmierca,et al.  Duration selective neurons in the inferior colliculus of the rat: topographic distribution and relation of duration sensitivity to other response properties. , 2006, Journal of neurophysiology.

[42]  Brice Bathellier,et al.  Temporal asymmetries in auditory coding and perception reflect multi-layered nonlinearities , 2016, Nature Communications.

[43]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[44]  Jufang He OFF responses in the auditory thalamus of the guinea pig. , 2002, Journal of neurophysiology.

[45]  Brian H Scott,et al.  Effect of Behavioral Context on Representation of a Spatial Cue in Core Auditory Cortex of Awake Macaques , 2007, The Journal of Neuroscience.

[46]  Xiaoqin Wang,et al.  Cortical Processing of Dynamic Sound Envelope Transitions , 2010, The Journal of Neuroscience.

[47]  Brian H Scott,et al.  Context-Dependent Adaptive Coding of Interaural Phase Disparity in the Auditory Cortex of Awake Macaques , 2002, The Journal of Neuroscience.

[48]  G. Recanzone Response profiles of auditory cortical neurons to tones and noise in behaving macaque monkeys , 2000, Hearing Research.

[49]  Valentin Dragoi,et al.  Efficient coding in heterogeneous neuronal populations , 2008, Proceedings of the National Academy of Sciences.

[50]  Ellen Covey,et al.  Temporal Masking Reveals Properties of Sound-Evoked Inhibition in Duration-Tuned Neurons of the Inferior Colliculus , 2003, The Journal of Neuroscience.

[51]  A. Pouget,et al.  Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations , 2004, Nature Neuroscience.

[52]  Robin A. A. Ince,et al.  Neural Codes Formed by Small and Temporally Precise Populations in Auditory Cortex , 2013, The Journal of Neuroscience.

[53]  I. Nelken,et al.  Responses of neurons in primary auditory cortex (A1) to pure tones in the halothane-anesthetized cat. , 2006, Journal of neurophysiology.

[54]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[55]  Shihab Shamma,et al.  Temporal coherence versus harmonicity in auditory stream formation. , 2013, The Journal of the Acoustical Society of America.

[56]  Brian J Malone,et al.  Encoding frequency contrast in primate auditory cortex. , 2014, Journal of neurophysiology.

[57]  A. Magnusson,et al.  Sound Rhythms Are Encoded by Postinhibitory Rebound Spiking in the Superior Paraolivary Nucleus , 2011, The Journal of Neuroscience.

[58]  C. Plack,et al.  Perceived continuity and pitch perception. , 2000, The Journal of the Acoustical Society of America.

[59]  Brian J Malone,et al.  Representation of dynamic interaural phase difference in auditory cortex of awake rhesus macaques. , 2009, Journal of neurophysiology.

[60]  Hiroaki Wagatsuma,et al.  Context-Dependent Adaptive Behavior Generated in the Theta Phase Coding Network , 2007, ICONIP.

[61]  S. Shamma,et al.  Temporal Coherence in the Perceptual Organization and Cortical Representation of Auditory Scenes , 2009, Neuron.

[62]  A. Magnusson,et al.  Development of on-off spiking in superior paraolivary nucleus neurons of the mouse. , 2013, Journal of neurophysiology.

[63]  B E Pfingst,et al.  Characteristics of neurons in auditory cortex of monkeys performing a simple auditory task. , 1981, Journal of neurophysiology.

[64]  H. D. Potter,et al.  Patterns of acoustically evoked discharges of neurons in the mesencephalon of the bullfrog. , 1965, Journal of neurophysiology.

[65]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[66]  Mitchell Steinschneider,et al.  Temporally dynamic frequency tuning of population responses in monkey primary auditory cortex , 2009, Hearing Research.

[67]  Z. Fuzessery Response selectivity for multiple dimensions of frequency sweeps in the pallid bat inferior colliculus. , 1994, Journal of neurophysiology.

[68]  A. Feng,et al.  Neural basis of sound pattern recognition in anurans , 1990, Progress in Neurobiology.

[69]  T. Hashikawa,et al.  Temporal Integration and Duration Tuning in the Dorsal Zone of Cat Auditory Cortex , 1997, The Journal of Neuroscience.

[70]  M. Kössl,et al.  Ambiguities in sound-duration selectivity by neurons in the inferior colliculus of the bat Molossus molossus from Cuba. , 2004, Journal of neurophysiology.

[71]  Peter Heil,et al.  Coding of temporal onset envelope in the auditory system , 2003, Speech Commun..

[72]  S. Shamma,et al.  Segregation of complex acoustic scenes based on temporal coherence , 2013, eLife.

[73]  Julio C. Hechavarría,et al.  Duration tuning in the inferior colliculus of the mustached bat. , 2011, Journal of neurophysiology.

[74]  W. Bialek,et al.  The Neural Basis for Combinatorial Coding in a Cortical Population Response , 2008, The Journal of Neuroscience.

[75]  A Fishbach,et al.  Auditory edge detection: a neural model for physiological and psychoacoustical responses to amplitude transients. , 2001, Journal of neurophysiology.

[76]  Paul R. Schrater,et al.  Auditory Frequency and Intensity Discrimination Explained Using a Cortical Population Rate Code , 2013, PLoS Comput. Biol..

[77]  Z. Wollberg,et al.  Tuning properties of auditory cortex cells in the awake squirrel monkey , 2004, Experimental Brain Research.

[78]  Brian J Malone,et al.  Temporal Codes for Amplitude Contrast in Auditory Cortex , 2010, The Journal of Neuroscience.

[79]  G. Spirou,et al.  Physiological response properties of neurons in the superior paraolivary nucleus of the rat. , 2003, Journal of neurophysiology.

[80]  M. R. Petersen,et al.  Auditory duration discrimination in Old World monkeys (Macaca, Cercopithecus) and humans. , 1987, The Journal of the Acoustical Society of America.

[81]  Ellen Covey,et al.  Duration selectivity of neurons in the inferior colliculus of the big brown bat: tolerance to changes in sound level. , 2005, Journal of neurophysiology.

[82]  Tonotopic organization and encoding features of single units in inferior colliculus of horseshoe bats: functional implications for prey identification. , 1981, Journal of neurophysiology.

[83]  R. R. Capranica,et al.  Neural adaptations for processing the two-note call of the Puerto Rican treefrog, Eleutherodactylus coqui. , 1980, Brain, behavior and evolution.

[84]  Mitchell Steinschneider,et al.  Neural Correlates of Auditory Scene Analysis Based on Inharmonicity in Monkey Primary Auditory Cortex , 2010, The Journal of Neuroscience.

[85]  J F Mejias,et al.  Optimal heterogeneity for coding in spiking neural networks. , 2012, Physical review letters.

[86]  N. Logothetis,et al.  Millisecond encoding precision of auditory cortex neurons , 2010, Proceedings of the National Academy of Sciences.

[87]  K. Harris,et al.  Population coding of tone stimuli in auditory cortex: dynamic rate vector analysis , 2009, The European journal of neuroscience.

[88]  Eero P. Simoncelli,et al.  Efficient Sensory Encoding and Bayesian Inference with Heterogeneous Neural Populations , 2014, Neural Computation.

[89]  Jan W. H. Schnupp,et al.  Plasticity of Temporal Pattern Codes for Vocalization Stimuli in Primary Auditory Cortex , 2006, The Journal of Neuroscience.

[90]  D. Butts,et al.  Tuning Curves, Neuronal Variability, and Sensory Coding , 2006, PLoS biology.

[91]  DeLiang Wang,et al.  Auditory Segmentation Based on Onset and Offset Analysis , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[92]  N. Logothetis,et al.  Neurons with Stereotyped and Rapid Responses Provide a Reference Frame for Relative Temporal Coding in Primate Auditory Cortex , 2012, The Journal of Neuroscience.

[93]  A S Bregman,et al.  Resetting the pitch-analysis system. 2. Role of sudden onsets and offsets in the perception of individual components in a cluster of overlapping tones. , 1994, The Journal of the Acoustical Society of America.

[94]  M. Chait,et al.  Brain Bases for Auditory Stimulus-Driven Figure–Ground Segregation , 2011, The Journal of Neuroscience.

[95]  J. Wang,et al.  Response characteristics of primary auditory cortex neurons underlying perceptual asymmetry of ramped and damped sounds , 2014, Neuroscience.

[96]  Ling Qin,et al.  Comparison between offset and onset responses of primary auditory cortex ON-OFF neurons in awake cats. , 2007, Journal of neurophysiology.

[97]  Andrew J Oxenham,et al.  Cortical FMRI activation to sequences of tones alternating in frequency: relationship to perceived rate and streaming. , 2007, Journal of neurophysiology.

[98]  D. Ringach Population coding under normalization , 2010, Vision Research.

[99]  S M Abel,et al.  Duration discrimination of noise and tone bursts. , 1972, The Journal of the Acoustical Society of America.

[100]  T. Kitama,et al.  Time course of tonal frequency-response-area of primary auditory cortex neurons in alert cats , 2003, Neuroscience Research.

[101]  Matthias H Hennig,et al.  The Sound of Silence: Ionic Mechanisms Encoding Sound Termination , 2011, Neuron.

[102]  D. P. Phillips,et al.  Central auditory onset responses, and temporal asymmetries in auditory perception , 2002, Hearing Research.

[103]  N. Urban,et al.  Intrinsic biophysical diversity decorrelates neuronal firing while increasing information content , 2010, Nature Neuroscience.

[104]  S. Rumpel,et al.  Discrete Neocortical Dynamics Predict Behavioral Categorization of Sounds , 2012, Neuron.

[105]  Paul F. M. J. Verschure,et al.  Decoding a Temporal Population Code , 2004, Neural Computation.

[106]  Brandon Aubie,et al.  Duration tuning in the auditory midbrain of echolocating and non-echolocating vertebrates , 2011, Journal of Comparative Physiology A.

[107]  Gary J. Rose,et al.  Time computations in anuran auditory systems , 2014, Front. Physiol..

[108]  M. Escabí,et al.  Distinct Roles for Onset and Sustained Activity in the Neuronal Code for Temporal Periodicity and Acoustic Envelope Shape , 2008, The Journal of Neuroscience.

[109]  M. Sutter,et al.  Spectrotemporal organization of excitatory and inhibitory receptive fields of cat posterior auditory field neurons. , 2001, Journal of neurophysiology.

[110]  M. Wehr,et al.  Nonoverlapping Sets of Synapses Drive On Responses and Off Responses in Auditory Cortex , 2010, Neuron.

[111]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[112]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.