Serial dependence is absent at the time of perception but increases in visual working memory

Recent experiments have shown that visual cognition blends current visual input with that from the recent past to guide ongoing decision making. This serial dependence is tuned to the similarity between consecutive stimuli and appears to exploit the temporal autocorrelation normally present in visual scenes to promote perceptual stability. While these benefits have been assumed, evidence that serial dependence directly alters stimulus perception has been limited. In the present study, we parametrically vary the delay between stimulus and response in a spatial delayed response task to explore the trajectory of serial dependence from the moment of perception into post-perceptual visual working memory. We find that behavioral responses made immediately after viewing a stimulus show evidence of adaptation, but not attractive serial dependence. Only as the memory period lengthens is a blending of past and present information apparent in behavior, reaching its maximum with a memory delay of six seconds. These results dovetail with other recent findings to bolster the interpretation that serial dependence is a phenomenon of mnemonic rather than perceptual processes. We also demonstrate that when leading mathematical models of visual working memory are adjusted to account for this trial-history effect, their fit to behavioral data is substantially improved.

[1]  David Alais,et al.  Different coding strategies for the perception of stable and changeable facial attributes , 2016, Scientific Reports.

[2]  J. Henderson,et al.  Looking back at Waldo: oculomotor inhibition of return does not prevent return fixations. , 2011, Journal of vision.

[3]  Weiwei Zhang,et al.  A dual-trace model for visual sensory memory. , 2016, Journal of experimental psychology. Human perception and performance.

[4]  J. Gibson,et al.  ADAPTATION , AFTEREFFECT AND CONTRAST IN THE PERCEPTION OF TILTED LINES , 2004 .

[5]  M. Webster,et al.  Visual adaptation: Neural, psychological and computational aspects , 2007, Vision Research.

[6]  George A. Alvarez,et al.  Variability in the quality of visual working memory , 2012, Nature Communications.

[7]  M. Webster Adaptation and visual coding. , 2011, Journal of vision.

[8]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[9]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[10]  David J. Freedman,et al.  Dynamic population coding of category information in inferior temporal and prefrontal cortex. , 2008, Journal of neurophysiology.

[11]  Daniel P. Bliss,et al.  Serial Dependence across Perception, Attention, and Memory , 2017, Trends in Cognitive Sciences.

[12]  Mark D'Esposito,et al.  From cognitive to neural models of working memory , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  J. Atick,et al.  STATISTICS OF NATURAL TIME-VARYING IMAGES , 1995 .

[14]  S. Luck,et al.  Sudden Death and Gradual Decay in Visual Working Memory , 2009, Psychological science.

[15]  L. M. Ward Mixed-modality psychophysical scaling: Inter- and intramodality sequential dependencies as a function of lag , 1985, Perception & psychophysics.

[16]  V. Lamme,et al.  Fragile visual short-term memory is an object-based and location-specific store , 2013, Psychonomic Bulletin & Review.

[17]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[18]  Paul M Bays,et al.  Evaluating and excluding swap errors in analogue tests of working memory , 2016, Scientific Reports.

[19]  T. Egner,et al.  Working memory as internal attention: Toward an integrative account of internal and external selection processes , 2012, Psychonomic Bulletin & Review.

[20]  P. Petzold,et al.  The influence of category membership of stimuli on sequential effects in magnitude judgment , 2004, Perception & psychophysics.

[21]  Marcia K. Johnson,et al.  Memory: Enduring Traces of Perceptual and Reflective Attention , 2011, Neuron.

[22]  Lawrence M. Ward,et al.  Response system processes in absolute judgment , 1971 .

[23]  D. Whitney,et al.  Serial dependence in visual perception , 2011 .

[24]  J. Gabrieli Cognitive neuroscience of human memory. , 1998, Annual review of psychology.

[25]  D. Whitney,et al.  Serial dependence promotes object stability during occlusion , 2016, Journal of vision.

[26]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[27]  Y Agid,et al.  Temporal limits of spatial working memory in humans , 1998, The European journal of neuroscience.

[28]  Wei Ji Ma,et al.  Variability in encoding precision accounts for visual short-term memory limitations , 2012, Proceedings of the National Academy of Sciences.

[29]  Antoine Coutrot,et al.  Face exploration dynamics differentiate men and women. , 2016, Journal of vision.

[30]  S. Magnussen Low-level memory processes in vision , 2000, Trends in Neurosciences.

[31]  M. Chun Visual working memory as visual attention sustained internally over time , 2011, Neuropsychologia.

[32]  T. Pasternak,et al.  Working memory in primate sensory systems , 2005, Nature Reviews Neuroscience.

[33]  Justus-Liebig-University Giessen,et al.  Higher order sequential effects in psychophysical judgments , 2010 .

[34]  Françoise Viénot,et al.  A study on chromatic contrast regulation , 2004 .

[35]  Paul M Bays,et al.  Noise in Neural Populations Accounts for Errors in Working Memory , 2014, The Journal of Neuroscience.

[36]  Victor A. F. Lamme,et al.  Detailed Sensory Memory, Sloppy Working Memory , 2010, Front. Psychology.

[37]  A. Compte,et al.  Neural circuit basis of visuo-spatial working memory precision: a computational and behavioral study. , 2015, Journal of neurophysiology.

[38]  Victor A. F. Lamme,et al.  Are There Multiple Visual Short-Term Memory Stores? , 2008, PloS one.

[39]  J. Gibson,et al.  Adaptation, after-effect and contrast in the perception of tilted lines. I. Quantitative studies , 1937 .

[40]  Charalampos Papadimitriou,et al.  Ghosts in the Machine II: Neural Correlates of Memory Interference from the Previous Trial , 2016, Cerebral cortex.

[41]  Victor A. F. Lamme,et al.  Magnetic stimulation of the dorsolateral prefrontal cortex dissociates fragile visual short-term memory from visual working memory , 2011, Neuropsychologia.

[42]  E. Vogel,et al.  Interactions between attention and working memory , 2006, Neuroscience.

[43]  Paul M. Bays,et al.  A signature of neural coding at human perceptual limits , 2016, bioRxiv.

[44]  Mark D'Esposito,et al.  Distributed and Dynamic Storage of Working Memory Stimulus Information in Extrastriate Cortex , 2014, Journal of Cognitive Neuroscience.

[45]  Kohske Takahashi,et al.  Sequential Effects in Face-Attractiveness Judgment , 2012, Perception.

[46]  F. D. Lange,et al.  Opposite Effects of Recent History on Perception and Decision , 2017, Current Biology.

[47]  D. Burr,et al.  Compressive mapping of number to space reflects dynamic encoding mechanisms, not static logarithmic transform , 2014, Proceedings of the National Academy of Sciences.

[48]  A. Nobre,et al.  Prioritizing Information during Working Memory: Beyond Sustained Internal Attention , 2017, Trends in Cognitive Sciences.

[49]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[50]  David Whitney,et al.  Serial dependence in the perception of attractiveness , 2015, Journal of vision.

[51]  Victor A. F. Lamme,et al.  Manipulations of attention dissociate fragile visual short-term memory from visual working memory , 2011, Neuropsychologia.

[52]  J. Fuster Network memory , 1997, Trends in Neurosciences.

[53]  Charalampos Papadimitriou,et al.  Ghosts in the machine: memory interference from the previous trial. , 2015, Journal of neurophysiology.

[54]  James H Elder,et al.  Cue dynamics underlying rapid detection of animals in natural scenes. , 2009, Journal of vision.

[55]  Michael X. Cohen,et al.  Neural Correlates of Visual Short-term Memory Dissociate between Fragile and Working Memory Representations , 2015, Journal of Cognitive Neuroscience.

[56]  B. Postle,et al.  The cognitive neuroscience of working memory. , 2007, Annual review of psychology.

[57]  M. Webster,et al.  Visual adaptation and face perception , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[58]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[59]  C. Clifford,et al.  A functional angle on some after-effects in cortical vision , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[60]  W. Ma,et al.  Factorial comparison of working memory models. , 2014, Psychological review.

[61]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[62]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[63]  David L. Sparks,et al.  Saccades to remembered target locations: an analysis of systematic and variable errors , 1994, Vision Research.

[64]  Kartik K. Sreenivasan,et al.  Revisiting the role of persistent neural activity during working memory , 2014, Trends in Cognitive Sciences.

[65]  A. Nobre,et al.  Top-down modulation: bridging selective attention and working memory , 2012, Trends in Cognitive Sciences.

[66]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[67]  Karl R Gegenfurtner,et al.  Dynamics of oculomotor direction discrimination. , 2012, Journal of vision.

[68]  D. Whitney,et al.  Serial Dependence in the Perception of Faces , 2014, Current Biology.

[69]  B. Postle Working memory as an emergent property of the mind and brain , 2006, Neuroscience.

[70]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[71]  Katsumi Watanabe,et al.  Influence of gender membership on sequential decisions of face attractiveness , 2013, Attention, Perception, & Psychophysics.

[72]  David Whitney,et al.  Facilitating Stable Representations: Serial Dependence in Vision , 2011, PloS one.

[73]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[74]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[75]  R. Sekuler,et al.  Distortions in recall from visual memory: two classes of attractors at work. , 2010, Journal of vision.