Collective Activity of Many Bistable Assemblies Reproduces Characteristic Dynamics of Multistable Perception

The timing of perceptual decisions depends on both deterministic and stochastic factors, as the gradual accumulation of sensory evidence (deterministic) is contaminated by sensory and/or internal noise (stochastic). When human observers view multistable visual displays, successive episodes of stochastic accumulation culminate in repeated reversals of visual appearance. Treating reversal timing as a “first-passage time” problem, we ask how the observed timing densities constrain the underlying stochastic accumulation. Importantly, mean reversal times (i.e., deterministic factors) differ enormously between displays/observers/stimulation levels, whereas the variance and skewness of reversal times (i.e., stochastic factors) keep characteristic proportions of the mean. What sort of stochastic process could reproduce this highly consistent “scaling property?” Here we show that the collective activity of a finite population of bistable units (i.e., a generalized Ehrenfest process) quantitatively reproduces all aspects of the scaling property of multistable phenomena, in contrast to other processes under consideration (Poisson, Wiener, or Ornstein-Uhlenbeck process). The postulated units express the spontaneous dynamics of attractor assemblies transitioning between distinct activity states. Plausible candidates are cortical columns, or clusters of columns, as they are preferentially connected and spontaneously explore a restricted repertoire of activity states. Our findings suggests that perceptual representations are granular, probabilistic, and operate far from equilibrium, thereby offering a suitable substrate for statistical inference. SIGNIFICANCE STATEMENT Spontaneous reversals of high-level perception, so-called multistable perception, conform to highly consistent and characteristic statistics, constraining plausible neural representations. We show that the observed perceptual dynamics would be reproduced quantitatively by a finite population of distinct neural assemblies, each with locally bistable activity, operating far from the collective equilibrium (generalized Ehrenfest process). Such a representation would be consistent with the intrinsic stochastic dynamics of neocortical activity, which is dominated by preferentially connected assemblies, such as cortical columns or clusters of columns. We predict that local neuron assemblies will express bistable dynamics, with spontaneous active-inactive transitions, whenever they contribute to high-level perception.

[1]  Brendon O. Watson,et al.  Internal Dynamics Determine the Cortical Response to Thalamic Stimulation , 2005, Neuron.

[2]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[3]  J. Braun,et al.  Perceptual reversals need no prompting by attention. , 2007, Journal of vision.

[4]  Nava Rubin,et al.  Dynamical characteristics common to neuronal competition models. , 2007, Journal of neurophysiology.

[5]  K. Harris,et al.  Laminar Structure of Spontaneous and Sensory-Evoked Population Activity in Auditory Cortex , 2009, Neuron.

[6]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[7]  K. Shapiro,et al.  The contingent negative variation (CNV) event-related potential (ERP) predicts the attentional blink , 2008 .

[8]  D. Bub,et al.  The face of race: Revealing the visual prototype of Black and White faces in Caucasian subjects , 2010 .

[9]  Nicholas A. Steinmetz,et al.  Diverse coupling of neurons to populations in sensory cortex , 2015, Nature.

[10]  Viktor K. Jirsa,et al.  Neuronal Dynamics and Brain Connectivity , 2007 .

[11]  Richard H. A. H. Jacobs,et al.  The time course of binocular rivalry reveals a fundamental role of noise. , 2006, Journal of vision.

[12]  Philip L. Smith,et al.  An integrated theory of attention and decision making in visual signal detection. , 2009, Psychological review.

[13]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[14]  N. Logothetis,et al.  Visual competition , 2002, Nature Reviews Neuroscience.

[15]  K. Dill,et al.  Principles of maximum entropy and maximum caliber in statistical physics , 2013 .

[16]  H. Risken Fokker-Planck Equation , 1984 .

[17]  R. Blake,et al.  Temporal perturbations of binocular rivalry , 1990, Perception & psychophysics.

[18]  Jaime de la Rocha,et al.  How do neurons work together? Lessons from auditory cortex , 2011, Hearing Research.

[19]  J. Aloimonos,et al.  On the kinetic depth effect , 1989, Biological Cybernetics.

[20]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[21]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[22]  D. Wolpert,et al.  Changing your mind: a computational mechanism of vacillation , 2009, Nature.

[23]  Joshua B. Tenenbaum,et al.  Multistability and Perceptual Inference , 2012, Neural Computation.

[24]  Samuel Karlin,et al.  Ehrenfest urn models , 1965 .

[25]  Alexander Pastukhov,et al.  Cumulative history quantifies the role of neural adaptation in multistable perception. , 2011, Journal of vision.

[26]  A. Borsellino,et al.  Reversal time distribution in the perception of visual ambiguous stimuli , 1972, Kybernetik.

[27]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[28]  C. Bundesen,et al.  Recent developments in a computational theory of visual attention (TVA) , 2015, Vision Research.

[29]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[30]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[31]  J Timothy Petersik,et al.  Buildup and Decay of a Three-Dimensional Rotational Aftereffect Obtained with a Three-Dimensional Figure , 2002, Perception.

[32]  Chuang Liu,et al.  The Logic of Thermostatistical Physics , 2001 .

[33]  M. Hollins,et al.  The effect of contrast on the completeness of binocular rivalry suppression , 1980, Perception & psychophysics.

[34]  Massimo Riani,et al.  Stochastic Models and Fluctuations in Reversal Time of Ambiguous Figures , 1977, Perception.

[35]  A. Pouget,et al.  Variance as a Signature of Neural Computations during Decision Making , 2011, Neuron.

[36]  M. V. von Grünau,et al.  Ambiguous plaids: switching between coherence and transparency. , 1993, Spatial vision.

[37]  S. Ferraina,et al.  Heterogeneous Attractor Cell Assemblies for Motor Planning in Premotor Cortex , 2013, The Journal of Neuroscience.

[38]  Gustavo Deco,et al.  Computational significance of transient dynamics in cortical networks , 2007, The European journal of neuroscience.

[39]  A. Grinvald,et al.  Linking spontaneous activity of single cortical neurons and the underlying functional architecture. , 1999, Science.

[40]  Susan Denham,et al.  Multistability in auditory stream segregation: a predictive coding view , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[41]  R. Sundareswara,et al.  Perceptual multistability predicted by search model for Bayesian decisions. , 2008, Journal of vision.

[42]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[43]  P. Walker Stochastic properties of binocular rivalry alternations , 1975 .

[44]  R Fox,et al.  Stochastic properties of stabilized-image binocular rivalry alternations. , 1971, Journal of experimental psychology.

[45]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[47]  F W Campbell,et al.  Monocular alternation: a method for the investigation of pattern vision. , 1972, The Journal of physiology.

[48]  Yee-Joon Kim,et al.  Stochastic resonance in binocular rivalry , 2006, Vision Research.

[49]  David R. Cox,et al.  The Theory of Stochastic Processes , 1967, The Mathematical Gazette.

[50]  D. McCormick,et al.  Rapid Neocortical Dynamics: Cellular and Network Mechanisms , 2009, Neuron.

[51]  Nava Rubin,et al.  Balance between noise and adaptation in competition models of perceptual bistability , 2009, Journal of Computational Neuroscience.

[52]  R. van Ee,et al.  Percept-choice sequences driven by interrupted ambiguous stimuli: a low-level neural model. , 2007, Journal of vision.

[53]  Karl J. Friston,et al.  Predictive coding explains binocular rivalry: An epistemological review , 2008, Cognition.

[54]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[55]  Roger H. S. Carpenter,et al.  Analysing the detail of saccadic reaction time distributions , 2012 .

[56]  Q. Summerfield Book Review: Auditory Scene Analysis: The Perceptual Organization of Sound , 1992 .

[57]  Carson C. Chow,et al.  A Spiking Neuron Model for Binocular Rivalry , 2004, Journal of Computational Neuroscience.

[58]  Barbara Anne Dosher,et al.  Depth from motion , 1995 .

[59]  Jonathan W. Pillow,et al.  Single-trial spike trains in parietal cortex reveal discrete steps during decision-making , 2015, Science.

[60]  Geraint Rees,et al.  A Neural Basis for Percept Stabilization in Binocular Rivalry , 2008, Journal of Cognitive Neuroscience.

[61]  G. Kramer Auditory Scene Analysis: The Perceptual Organization of Sound by Albert Bregman (review) , 2016 .

[62]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[63]  Amilcare Porporato,et al.  First passage time statistics of Brownian motion with purely time dependent drift and diffusion , 2010, 1009.0557.

[64]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[65]  Kung Yao,et al.  Perceptual dominance time distributions in multistable visual perception , 2004, Biological Cybernetics.

[66]  Satoru Miyauchi,et al.  Discrete stochastic process underlying perceptual rivalry , 2003, Neuroreport.

[67]  F. Tong,et al.  Can attention selectively bias bistable perception? Differences between binocular rivalry and ambiguous figures. , 2004, Journal of vision.

[68]  Randolph Blake,et al.  What causes alternations in dominance during binocular rivalry? , 2010, Attention, perception & psychophysics.

[69]  Randolph Blake,et al.  Visual Sensitivity Underlying Changes in Visual Consciousness , 2010, Current Biology.

[70]  H. Haken Cooperative phenomena in systems far from thermal equilibrium and in nonphysical systems , 1975 .

[71]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[72]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[73]  Paul M Bays,et al.  Working memory retrieval as a decision process. , 2014, Journal of vision.

[74]  I. Fujita,et al.  Organization of horizontal axons in the inferior temporal cortex and primary visual cortex of the macaque monkey. , 2005, Cerebral cortex.

[75]  D. Amit The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[76]  W. Newsome,et al.  Choosing the greater of two goods: neural currencies for valuation and decision making , 2005, Nature Reviews Neuroscience.

[77]  Roger Ratcliff,et al.  The diffusion model is not a deterministic growth model: comment on Jones and Dzhafarov (2014). , 2014, Psychological review.

[78]  Hugh R Wilson,et al.  Minimal physiological conditions for binocular rivalry and rivalry memory , 2007, Vision Research.

[79]  M. Shadlen,et al.  Decision Making as a Window on Cognition , 2013, Neuron.

[80]  A. Angelucci,et al.  Contribution of feedforward, lateral and feedback connections to the classical receptive field center and extra-classical receptive field surround of primate V1 neurons. , 2006, Progress in brain research.

[81]  Campbell Fw,et al.  Monocular alternation: a method for the investigation of pattern vision. , 1972 .

[82]  Paul Miller,et al.  Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles , 2007, Proceedings of the National Academy of Sciences.

[83]  V. Mountcastle The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[84]  Karen R Dobkins,et al.  The face inversion effect in infants is driven by high, and not low, spatial frequencies. , 2014, Journal of vision.

[85]  Kingshuk Ghosh,et al.  Teaching the principles of statistical dynamics. , 2006, American journal of physics.

[86]  M. M. Taylor,et al.  Stochastic processes in reversing figure perception , 1974 .

[87]  Xiao-Jing Wang Neural dynamics and circuit mechanisms of decision-making , 2012, Current Opinion in Neurobiology.

[88]  T. Alderweireld,et al.  A Theory for the Term Structure of Interest Rates , 2004, cond-mat/0405293.

[89]  J. Lund,et al.  Anatomical substrates for functional columns in macaque monkey primary visual cortex. , 2003, Cerebral cortex.

[90]  Hugh R Wilson,et al.  Computational evidence for a rivalry hierarchy in vision , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[91]  David A. Leopold,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[92]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[93]  Jochen Braun,et al.  Attractors and noise: Twin drivers of decisions and multistability , 2010, NeuroImage.

[94]  A. Grinvald,et al.  Interaction of sensory responses with spontaneous depolarization in layer 2/3 barrel cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[95]  Jochen Braun,et al.  Stochastic accumulation by cortical columns may explain the scalar property of multistable perception. , 2014, Physical review letters.

[96]  M Nawrot,et al.  Neural integration of information specifying structure from stereopsis and motion. , 1989, Science.

[97]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[98]  G. Rees,et al.  The Neural Bases of Multistable Perception , 2022 .

[99]  R. Douglas,et al.  From Neural Arbors to Daisies , 2010, Cerebral cortex.

[100]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[101]  G. Buzsáki,et al.  Sequential structure of neocortical spontaneous activity in vivo , 2007, Proceedings of the National Academy of Sciences.

[102]  Dov Sagi,et al.  Motion-induced blindness in normal observers , 2001, Nature.

[103]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[104]  Philip L. Smith,et al.  Stochastic Dynamic Models of Response Time and Accuracy: A Foundational Primer. , 2000, Journal of mathematical psychology.

[105]  Carson C. Chow,et al.  Role of mutual inhibition in binocular rivalry. , 2011, Journal of neurophysiology.

[106]  Aapo Hyvärinen,et al.  Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior , 2002, NIPS.

[107]  N. Logothetis,et al.  Multistable phenomena: changing views in perception , 1999, Trends in Cognitive Sciences.

[108]  Anirvan S. Nandy,et al.  The nature of letter crowding as revealed by first- and second-order classification images. , 2007, Journal of Vision.

[109]  Raymond van Ee,et al.  Distributions of alternation rates in various forms of bistable perception. , 2005, Journal of vision.

[110]  Carson C. Chow,et al.  Competitive dynamics in cortical responses to visual stimuli. , 2005, Journal of neurophysiology.

[111]  Robert Fox,et al.  Stochastic properties of binocular rivalry alternations , 1967 .

[112]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[113]  Nava Rubin,et al.  Alternation rate in perceptual bistability is maximal at and symmetric around equi-dominance. , 2010, Journal of vision.

[114]  D. Snodderly,et al.  Organization of striate cortex of alert, trained monkeys (Macaca fascicularis): ongoing activity, stimulus selectivity, and widths of receptive field activating regions. , 1995, Journal of neurophysiology.

[115]  Jeremy M. Wolfe,et al.  Reversing ocular dominance and suppression in a single flash , 1984, Vision Research.

[116]  Raymond van Ee,et al.  Stochastic variations in sensory awareness are driven by noisy neuronal adaptation: evidence from serial correlations in perceptual bistability. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[117]  D. Tank,et al.  Persistent neural activity: prevalence and mechanisms , 2004, Current Opinion in Neurobiology.

[118]  Frank Tong,et al.  The Functional Impact of Mental Imagery on Conscious Perception , 2008, Current Biology.

[119]  Jochen Braun,et al.  Bistable Perception Modeled as Competing Stochastic Integrations at Two Levels , 2009, PLoS Comput. Biol..

[120]  Luigi M. Ricciardi,et al.  On the parameter estimation for diffusion models of single neuron's activities , 1995, Biological Cybernetics.

[121]  Randolph Blake,et al.  The Role of Frontal and Parietal Brain Areas in Bistable Perception , 2011, The Journal of Neuroscience.

[122]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[123]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[124]  J. Rinzel,et al.  Noise-induced alternations in an attractor network model of perceptual bistability. , 2007, Journal of neurophysiology.

[125]  Naftali Tishby,et al.  Cortical activity flips among quasi-stationary states. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[126]  W J Levelt,et al.  Note on the distribution of dominance times in binocular rivalry. , 1967, British journal of psychology.