Single neurons may encode simultaneous stimuli by switching between activity patterns

How the brain preserves information about multiple simultaneous items is poorly understood. We report that single neurons can represent multiple stimuli by interleaving signals across time. We record single units in an auditory region, the inferior colliculus, while monkeys localize 1 or 2 simultaneous sounds. During dual-sound trials, we find that some neurons fluctuate between firing rates observed for each single sound, either on a whole-trial or on a sub-trial timescale. These fluctuations are correlated in pairs of neurons, can be predicted by the state of local field potentials prior to sound onset, and, in one monkey, can predict which sound will be reported first. We find corroborating evidence of fluctuating activity patterns in a separate dataset involving responses of inferotemporal cortex neurons to multiple visual stimuli. Alternation between activity patterns corresponding to each of multiple items may therefore be a general strategy to enhance the brain processing capacity, potentially linking such disparate phenomena as variable neural firing, neural oscillations, and limits in attentional/memory capacity.The neural mechanisms through which neurons represent simultaneously presented stimuli are not well understood. Here the authors demonstrate that the two stimuli are alternately encoded through fluctuations in the activity patterns of single neurons.

[1]  A. Treves,et al.  Theta-paced flickering between place-cell maps in the hippocampus , 2011, Nature.

[2]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[3]  Rufin van Rullen,et al.  Theta-Gamma Coding Meets Communication-through-Coherence: Neuronal Oscillatory Multiplexing Theories Reconciled , 2016, PLoS Comput. Biol..

[4]  David McAlpine,et al.  Sound localization and delay lines – do mammals fit the model? , 2003, Trends in Neurosciences.

[5]  A. Holcombe,et al.  Splitting attention reduces temporal resolution from 7 Hz for tracking one object to <3 Hz when tracking three. , 2013, Journal of vision.

[6]  George L. Gerstein,et al.  Identification of functionally related neural assemblies , 1978, Brain Research.

[7]  P. Alku,et al.  A Population Rate Code of Auditory Space in the Human Cortex , 2009, PloS one.

[8]  J. Lisman,et al.  The Theta-Gamma Neural Code , 2013, Neuron.

[9]  R. Saunders,et al.  Rhythmic neural spiking and attentional sampling arising from cortical receptive field interactions , 2018, bioRxiv.

[10]  Terry T Takahashi,et al.  The role of envelope shape in the localization of multiple sound sources and echoes in the barn owl. , 2013, Journal of neurophysiology.

[11]  Nathaniel T. Greene,et al.  Effects of Reward and Behavioral Context on Neural Activity in the Primate Inferior Colliculus , 2022 .

[12]  J. Berger,et al.  The Intrinsic Bayes Factor for Model Selection and Prediction , 1996 .

[13]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[14]  R. Yuste,et al.  Linear Summation of Excitatory Inputs by CA1 Pyramidal Neurons , 1999, Neuron.

[15]  R. Desimone,et al.  Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4 , 1999, The Journal of Neuroscience.

[16]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[17]  Hannu Tiitinen,et al.  The neural code for interaural time difference in human auditory cortex. , 2010, The Journal of the Acoustical Society of America.

[18]  J. Kelly,et al.  Sound localization after unilateral lesions of inferior colliculus in the ferret (Mustela putorius). , 1994, Journal of neurophysiology.

[19]  C. Keller,et al.  Localization and Identification of Concurrent Sounds in the Owl's Auditory Space Map , 2005, The Journal of Neuroscience.

[20]  Tatiana A. Engel,et al.  Selective modulation of cortical state during spatial attention , 2016, Science.

[21]  E. Izhikevich,et al.  Thalamo-cortical interactions modeled by weakly connected oscillators: could the brain use FM radio principles? , 1998, Bio Systems.

[22]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[23]  S. Raghavachari,et al.  Gating of Human Theta Oscillations by a Working Memory Task , 2001, The Journal of Neuroscience.

[24]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[25]  R. VanRullen,et al.  The Phase of Ongoing EEG Oscillations Predicts Visual Perception , 2009, The Journal of Neuroscience.

[26]  E. Brown,et al.  Analysis of LFP phase predicts sensory response of barrel cortex. , 2006, Journal of neurophysiology.

[27]  David A. Bulkin,et al.  Systematic mapping of the monkey inferior colliculus reveals enhanced low frequency sound representation. , 2011, Journal of neurophysiology.

[28]  D. Sparks,et al.  Saccades to remembered targets exhibit enhanced orbital position effects in monkeys , 2001, Vision Research.

[29]  Dimitri M. Kullmann,et al.  Oscillatory multiplexing of population codes for selective communication in the mammalian brain , 2014, Nature Reviews Neuroscience.

[30]  L. Aitkin,et al.  Is the inferior colliculus and obligatory relay in the cat auditory system? , 1984, Neuroscience Letters.

[31]  J. Movshon,et al.  Spatial summation in the receptive fields of simple cells in the cat's striate cortex. , 1978, The Journal of physiology.

[32]  Jennifer M. Groh,et al.  Two models for transforming auditory signals from head-centered to eye-centered coordinates , 1993, Biological Cybernetics.

[33]  R. Reid,et al.  Precisely correlated firing in cells of the lateral geniculate nucleus , 1996, Nature.

[34]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[35]  M. Meister Multineuronal codes in retinal signaling. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[36]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[37]  W. Jenkins,et al.  Sound localization: effects of unilateral lesions in central auditory system. , 1982, Journal of neurophysiology.

[38]  Jude F. Mitchell,et al.  Spatial Attention Decorrelates Intrinsic Activity Fluctuations in Macaque Area V4 , 2009, Neuron.

[39]  Brian S. Nelson,et al.  Object localization in cluttered acoustical environments , 2008, Biological Cybernetics.

[40]  Jennifer M Groh,et al.  A Rate Code for Sound Azimuth in Monkey Auditory Cortex: Implications for Human Neuroimaging Studies , 2008, The Journal of Neuroscience.

[41]  J. Berger The case for objective Bayesian analysis , 2006 .

[42]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[43]  R H Wurtz,et al.  Organization of monkey superior colliculus: intermediate layer cells discharging before eye movements. , 1976, Journal of neurophysiology.

[44]  T. Stanford,et al.  Multisensory versus unisensory integration: contrasting modes in the superior colliculus. , 2007, Journal of neurophysiology.

[45]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[46]  Hannah E Smithson,et al.  Different aberrations raise contrast thresholds for single-letter identification in line with their effect on cross-correlation-based confusability. , 2013, Journal of vision.

[47]  B. Grothe,et al.  Mechanisms of sound localization in mammals. , 2010, Physiological reviews.

[48]  C. Olson,et al.  Low-frequency oscillations arising from competitive interactions between visual stimuli in macaque inferotemporal cortex. , 2005, Journal of neurophysiology.

[49]  Akinori F. Ebihara Normalization Among Heterogeneous Population Confers Stimulus Discriminability on the Macaque Face Patch Neurons , 2015 .

[50]  Nicolas Brunel,et al.  Sensory neural codes using multiplexed temporal scales , 2010, Trends in Neurosciences.

[51]  Catherine Tallon-Baudry,et al.  The roles of gamma-band oscillatory synchrony in human visual cognition. , 2009, Frontiers in bioscience.

[52]  G. Recanzone,et al.  Effects of stimulus azimuth and intensity on the single-neuron activity in the auditory cortex of the alert macaque monkey. , 2006, Journal of neurophysiology.

[53]  Christoph Kayser,et al.  A Precluding But Not Ensuring Role of Entrained Low-Frequency Oscillations for Auditory Perception , 2012, The Journal of Neuroscience.

[54]  J. Groh,et al.  Different Stimuli, Different Spatial Codes: A Visual Map and an Auditory Rate Code for Oculomotor Space in the Primate Superior Colliculus , 2014, PloS one.

[55]  Jennifer M. Groh,et al.  A Monotonic Code for Sound Azimuth in Primate Inferior Colliculus , 2003, Journal of Cognitive Neuroscience.

[56]  Virginia Best,et al.  Separation of concurrent broadband sound sources by human listeners. , 2004, The Journal of the Acoustical Society of America.

[57]  D R Perrott,et al.  Discrimination of the spatial distribution of concurrently active sound sources: some experiments with stereophonic arrays. , 1984, The Journal of the Acoustical Society of America.

[58]  Doris Y. Tsao,et al.  Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing System , 2010, Science.

[59]  J. Adams Ascending projections to the inferior colliculus , 1979, The Journal of comparative neurology.

[60]  P. Fries,et al.  Attention Samples Stimuli Rhythmically , 2012, Current Biology.

[61]  Yale E Cohen,et al.  Auditory saccades from different eye positions in the monkey: implications for coordinate transformations. , 2004, Journal of neurophysiology.

[62]  C H Keller,et al.  Representation of multiple sound sources in the owl's auditory space map , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[63]  Go Ashida,et al.  Sound localization: Jeffress and beyond , 2011, Current Opinion in Neurobiology.

[64]  R. Moore,et al.  Ascending projections of the inferior colliculus in the cat , 1963 .

[65]  Markus Siegel,et al.  Phase-dependent neuronal coding of objects in short-term memory , 2009, Proceedings of the National Academy of Sciences.

[66]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[67]  Andy MacLeod,et al.  Making space for IT , 2005 .

[68]  R. VanRullen,et al.  Spontaneous EEG oscillations reveal periodic sampling of visual attention , 2010, Proceedings of the National Academy of Sciences.

[69]  P. Scheuerpfluga,et al.  Multisensory Versus Unisensory Integration : Contrasting Modes in the Superior Colliculus , 2016 .

[70]  D. Robinson Eye movements evoked by collicular stimulation in the alert monkey. , 1972, Vision research.

[71]  D. Perrott Concurrent minimum audible angle: a re-examination of the concept of auditory spatial acuity. , 1984, The Journal of the Acoustical Society of America.

[72]  J. Lisman,et al.  The θ-γ neural code. , 2013, Neuron.

[73]  R. Litovsky,et al.  Functional role of the human inferior colliculus in binaural hearing , 2002, Hearing Research.

[74]  R. VanRullen,et al.  Ongoing EEG Phase as a Trial-by-Trial Predictor of Perceptual and Attentional Variability , 2011, Front. Psychology.

[75]  Stefan Treue,et al.  Neurons in Primate Visual Cortex Alternate between Responses to Multiple Stimuli in Their Receptive Field , 2016, Front. Comput. Neurosci..