The functional role of serial dependence

The world tends to be stable from moment to moment, leading to strong serial correlations in natural scenes. As similar stimuli usually require similar behavioural responses, it is highly likely that the brain has developed strategies to leverage these regularities. A good deal of recent psychophysical evidence is beginning to show that the brain is sensitive to serial correlations, causing strong drifts in observer responses towards previously seen stimuli. However, it is still not clear that this tendency leads to a functional advantage. Here, we test a formal model of optimal serial dependence and show that as predicted, serial dependence in an orientation reproduction task is dependent on current stimulus reliability, with less precise stimuli, such as low spatial frequency oblique Gabors, exhibiting the strongest effects. We also show that serial dependence depends on the similarity between two successive stimuli, again consistent with the behaviour of an ideal observer aiming at minimizing reproduction errors. Lastly, we show that serial dependence leads to faster response times, indicating that the benefits of serial integration go beyond reproduction error. Overall our data show that serial dependence has a beneficial role at various levels of perception, consistent with the idea that the brain exploits the temporal redundancy of the visual scene as an optimization strategy.

[1]  David Whitney,et al.  The perceived stability of scenes: serial dependence in ensemble representations , 2017, Scientific Reports.

[2]  Marc O. Ernst,et al.  A Bayesian view on multimodal cue integration , 2006 .

[3]  K. Nakayama,et al.  Priming of popout: II. Role of position , 1996 .

[4]  David C. Burr,et al.  Data from: The functional role of serial dependence , 2018 .

[5]  D. Burr,et al.  Optimal Encoding of Interval Timing in Expert Percussionists , 2011, The Journal of Neuroscience.

[6]  David Alais,et al.  Eye gaze direction shows a positive serial dependency. , 2018, Journal of vision.

[7]  David C. Burr,et al.  Orientation discrimination depends on spatial frequency , 1991, Vision Research.

[8]  Daniel P. Bliss,et al.  Serial dependence is absent at the time of perception but increases in visual working memory , 2017, bioRxiv.

[9]  G. Campana,et al.  Where perception meets memory: A review of repetition priming in visual search tasks , 2010, Attention, perception & psychophysics.

[10]  Wei Ji Ma,et al.  Comparing Bayesian models for multisensory cue combination without mandatory integration , 2007, NIPS.

[11]  S. Appelle Perception and discrimination as a function of stimulus orientation: the "oblique effect" in man and animals. , 1972, Psychological bulletin.

[12]  Mark D'Esposito,et al.  Confidence Leak in Perceptual Decision Making , 2015, Psychological science.

[13]  D. Burr,et al.  Compressive mapping of number to space reflects dynamic encoding mechanisms, not static logarithmic transform , 2014, Proceedings of the National Academy of Sciences.

[14]  David C. Burr,et al.  The effects of cross-sensory attentional demand on subitizing and on mapping number onto space , 2012, Vision Research.

[15]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[16]  D. Alais,et al.  Love at second sight: Sequential dependence of facial attractiveness in an on-line dating paradigm , 2016, Scientific Reports.

[17]  D. Whitney,et al.  Serial dependence in visual perception , 2011 .

[18]  David Alais,et al.  Different coding strategies for the perception of stable and changeable facial attributes , 2016, Scientific Reports.

[19]  D. Whitney,et al.  Serial Dependence in the Perception of Faces , 2014, Current Biology.

[20]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[21]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[22]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[23]  Daniel P. Bliss,et al.  Serial Dependence across Perception, Attention, and Memory , 2017, Trends in Cognitive Sciences.

[24]  Jean-Pierre Bresciani,et al.  Vision and touch are automatically integrated for the perception of sequences of events. , 2006, Journal of vision.

[25]  D. Whitney,et al.  Serial dependence in position occurs at the time of perception , 2018, Psychonomic Bulletin & Review.

[26]  Warrick Roseboom,et al.  Serial dependence in the perception of visual variance , 2018, Journal of vision.

[27]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[28]  Kyriaki Mikellidou,et al.  The oblique effect is both allocentric and egocentric. , 2015, Journal of vision.

[29]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[30]  K. Forster,et al.  REPETITION PRIMING AND FREQUENCY ATTENUATION IN LEXICAL ACCESS , 1984 .

[31]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[32]  Neil W. Roach,et al.  Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration , 2006, Proceedings of the Royal Society B: Biological Sciences.

[33]  Nadine Kloth,et al.  Past visual experiences weigh in on body size estimation , 2018, Scientific Reports.

[34]  Kyriaki Mikellidou,et al.  Serial dependencies act directly on perception. , 2017, Journal of vision.

[35]  Stanislas Dehaene,et al.  The neural basis of the Weber–Fechner law: a logarithmic mental number line , 2003, Trends in Cognitive Sciences.

[36]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[37]  Floris P de Lange,et al.  Serial Dependence in Perceptual Decisions Is Reflected in Activity Patterns in Primary Visual Cortex , 2016, The Journal of Neuroscience.

[38]  F. D. Lange,et al.  Opposite Effects of Recent History on Perception and Decision , 2017, Current Biology.

[39]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.