Characterising switching behaviour in perceptual multi-stability

When people experience an unchanging sensory input for a long period of time, their perception tends to switch stochastically and unavoidably between alternative interpretations of the sensation; a phenomenon known as perceptual bi-stability or multi-stability. The huge variability in the experimental data obtained in such paradigms makes it difficult to distinguish typical patterns of behaviour, or to identify differences between switching patterns. Here we propose a new approach to characterising switching behaviour based upon the extraction of transition matrices from the data, which provide a compact representation that is well-understood mathematically. On the basis of this representation we can characterise patterns of perceptual switching, visualise and simulate typical switching patterns, and calculate the likelihood of observing a particular switching pattern. The proposed method can support comparisons between different observers, experimental conditions and even experiments. We demonstrate the insights offered by this approach using examples from our experiments investigating multi-stability in auditory streaming. However, the methodology is generic and thus widely applicable in studies of multi-stability in any domain.

[1]  Susan L. Denham,et al.  Stability of Perceptual Organisation in Auditory Streaming , 2010 .

[2]  I. Winkler,et al.  Event-related brain potentials reveal multiple stages in the perceptual organization of sound. , 2005, Brain research. Cognitive brain research.

[3]  Pascal Mamassian,et al.  Temporal dynamics in bistable perception. , 2005, Journal of vision.

[4]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[5]  L. V. Noorden Temporal coherence in the perception of tone sequences , 1975 .

[6]  Alexander Pastukhov,et al.  A short-term memory of multi-stable perception. , 2008, Journal of vision.

[7]  Hermann Ney,et al.  On structuring probabilistic dependences in stochastic language modelling , 1994, Comput. Speech Lang..

[8]  Nava Rubin,et al.  Alternation rate in perceptual bistability is maximal at and symmetric around equi-dominance. , 2010, Journal of vision.

[9]  R. M. Warren,et al.  Illusory changes in repeated words: differences between young adults and the aged. , 1961, The American journal of psychology.

[10]  S. R. Lehky An Astable Multivibrator Model of Binocular Rivalry , 1988, Perception.

[11]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[12]  Carson C. Chow,et al.  A Spiking Neuron Model for Binocular Rivalry , 2004, Journal of Computational Neuroscience.

[13]  Nava Rubin,et al.  The dynamics of bi-stable alternation in ambiguous motion displays: a fresh look at plaids , 2003, Vision Research.

[14]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[15]  J. Hupé,et al.  Temporal Dynamics of Auditory and Visual Bistability Reveal Common Principles of Perceptual Organization , 2006, Current Biology.

[16]  Stuart Anstis,et al.  Adaptation to auditory streaming of frequency-modulated tones. , 1985 .

[17]  W. Levelt On binocular rivalry , 1965 .

[18]  Susan Denham,et al.  Multistability in auditory stream segregation: a predictive coding view , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[19]  Alexandra Bendixen,et al.  Regular patterns stabilize auditory streams. , 2010, The Journal of the Acoustical Society of America.

[20]  J. Rinzel,et al.  Noise-induced alternations in an attractor network model of perceptual bistability. , 2007, Journal of neurophysiology.

[21]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[22]  I. Nelken,et al.  Modeling the auditory scene: predictive regularity representations and perceptual objects , 2009, Trends in Cognitive Sciences.

[23]  Nava Rubin,et al.  Balance between noise and adaptation in competition models of perceptual bistability , 2009, Journal of Computational Neuroscience.

[24]  I. Good THE POPULATION FREQUENCIES OF SPECIES AND THE ESTIMATION OF POPULATION PARAMETERS , 1953 .

[25]  Makio Kashino,et al.  Involvement of the Thalamocortical Loop in the Spontaneous Switching of Percepts in Auditory Streaming , 2009, The Journal of Neuroscience.

[26]  J Horváth,et al.  Simultaneously active pre-attentive representations of local and global rules for sound sequences in the human brain. , 2001, Brain research. Cognitive brain research.

[27]  A. Pouget,et al.  Perceptual learning as improved probabilistic inference in early sensory areas , 2011, Nature Neuroscience.

[28]  R. Blake A Neural Theory of Binocular Rivalry , 1989 .

[29]  I. Winkler,et al.  Perceptual bistability in auditory streaming: How much do stimulus features matter? , 2013 .

[30]  P. Christiaan Klink,et al.  General Validity of Levelt's Propositions Reveals Common Computational Mechanisms for Visual Rivalry , 2008, PloS one.

[31]  Marcia Grabowecky,et al.  Evidence for Perceptual “Trapping” and Adaptation in Multistable Binocular Rivalry , 2002, Neuron.

[32]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .

[33]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[34]  L. A. N. Esq.,et al.  LXI. Observations on some remarkable optical phænomena seen in Switzerland; and on an optical phænomenon which occurs on viewing a figure of a crystal or geometrical solid , 1832 .

[35]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[36]  I. Merk,et al.  A stochastic model of multistable visual perception , 2002, Biological Cybernetics.

[37]  Alexander Pastukhov,et al.  Cumulative history quantifies the role of neural adaptation in multistable perception. , 2011, Journal of vision.

[38]  D. Knill,et al.  Bayesian sampling in visual perception , 2011, Proceedings of the National Academy of Sciences.

[39]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[40]  D. Alais,et al.  Attending to auditory signals slows visual alternations in binocular rivalry , 2010, Vision Research.

[41]  Frederick Jelinek,et al.  Interpolated estimation of Markov source parameters from sparse data , 1980 .

[42]  I. Winkler,et al.  The role of predictive models in the formation of auditory streams , 2006, Journal of Physiology-Paris.

[43]  M. Shank,et al.  Figure-ground organization in real and subjective contours: A new ambiguous figure, some novel measures of ambiguity, and apparent distance across regions of figure and ground , 1989, Perception & psychophysics.

[44]  David Alais,et al.  Independent Binocular Rivalry Processes for Motion and Form , 2006, Neuron.

[45]  R. Sundareswara,et al.  Perceptual multistability predicted by search model for Bayesian decisions. , 2008, Journal of vision.

[46]  Raymond van Ee,et al.  Dynamics of perceptual bi-stability for stereoscopic slant rivalry and a comparison with grating, house-face, and Necker cube rivalry , 2005, Vision Research.

[47]  Gustavo Deco,et al.  A model of binocular rivalry based on competition in IT , 2002, Neurocomputing.

[48]  S. R. Lehky Binocular rivalry is not chaotic , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[49]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[50]  G. Rees,et al.  The Neural Bases of Multistable Perception , 2022 .

[51]  T. W. Anderson,et al.  Statistical Inference about Markov Chains , 1957 .

[52]  David Alais,et al.  Multisensory Congruency as a Mechanism for Attentional Control over Perceptual Selection , 2009, The Journal of Neuroscience.

[53]  Raymond van Ee,et al.  Stochastic variations in sensory awareness are driven by noisy neuronal adaptation: evidence from serial correlations in perceptual bistability , 2009 .

[54]  P. Cavanagh,et al.  Onset Rivalry: Brief Presentation Isolates an Early Independent Phase of Perceptual Competition , 2007, PloS one.