Short-Term Memory Affects Color Perception in Context

Color-based object selection — for instance, looking for ripe tomatoes in the market — places demands on both perceptual and memory processes: it is necessary to form a stable perceptual estimate of surface color from a variable visual signal, as well as to retain multiple perceptual estimates in memory while comparing objects. Nevertheless, perceptual and memory processes in the color domain are generally studied in separate research programs with the assumption that they are independent. Here, we demonstrate a strong failure of independence between color perception and memory: the effect of context on color appearance is substantially weakened by a short retention interval between a reference and test stimulus. This somewhat counterintuitive result is consistent with Bayesian estimation: as the precision of the representation of the reference surface and its context decays in memory, prior information gains more weight, causing the retained percepts to be drawn toward prior information about surface and context color. This interaction implies that to fully understand information processing in real-world color tasks, perception and memory need to be considered jointly.

[1]  A. Hurlbert,et al.  Color contrast: a contributory mechanism to color constancy. , 2004, Progress in brain research.

[2]  Janneke F. M. Jehee,et al.  Less Is More: Expectation Sharpens Representations in the Primary Visual Cortex , 2012, Neuron.

[3]  R. Burnham,et al.  A test of hue memory. , 1955 .

[4]  Henrik Olsson,et al.  Visual memory needs categories. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Qasim Zaidi,et al.  Color strategies for object identification , 2008, Vision Research.

[6]  H E Smithson,et al.  Sensory, computational and cognitive components of human colour constancy , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  D. Purves,et al.  An empirical explanation of color contrast. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Julie M. Harris,et al.  Learning to Use Illumination Gradients as an Unambiguous Cue to Three Dimensional Shape , 2012, PloS one.

[9]  Joel Pearson,et al.  Sensory memory for ambiguous vision , 2008, Trends in Cognitive Sciences.

[10]  M. Landy,et al.  Bayesian Modelling of Visual Perception , 2002 .

[11]  B. Wandell,et al.  Asymmetric color matching: how color appearance depends on the illuminant. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[12]  David H Brainard,et al.  A Bayesian model of lightness perception that incorporates spatial variation in the illumination. , 2013, Journal of Vision.

[13]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[14]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[15]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[16]  I. Toni,et al.  Shared Representations for Working Memory and Mental Imagery in Early Visual Cortex , 2013, Current Biology.

[17]  D. Foster Color constancy , 2011, Vision Research.

[18]  T. M. Nelson,et al.  Delayed monochromatic hue matches indicate characteristics of visual memory. , 1981, Journal of experimental psychology. Human perception and performance.

[19]  David H Foster,et al.  Scene Articulation: Dependence of Illuminant Estimates on Number of Surfaces , 2002, Perception.

[20]  Peter B. Delahunt,et al.  Bayesian model of human color constancy. , 2006, Journal of vision.

[21]  V. A. Nemes,et al.  A behavioural investigation of human visual short term memory for colour , 2010, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[22]  David H Brainard,et al.  Surface color perception and equivalent illumination models. , 2011, Journal of vision.

[23]  Karl R Gegenfurtner,et al.  Categorical color constancy for real surfaces. , 2010, Journal of vision.

[24]  Konrad Paul Kording,et al.  Learning Priors for Bayesian Computations in the Nervous System , 2010, PloS one.

[25]  Elaine W. Jin,et al.  Color memory and color constancy. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  Caspar M. Schwiedrzik,et al.  Stimulus Predictability Reduces Responses in Primary Visual Cortex , 2010, The Journal of Neuroscience.

[27]  M. Greenlee,et al.  Delayed discrimination of spatial frequency for gratings of different orientation: behavioral and fMRI evidence for low-level perceptual memory stores in early visual cortex , 2008, Experimental Brain Research.

[28]  K. Gegenfurtner,et al.  Cortical mechanisms of colour vision , 2003, Nature Reviews Neuroscience.

[29]  K. Gegenfurtner,et al.  Memory Color , 2020, Encyclopedia of Color Science and Technology.

[30]  K. Gegenfurtner,et al.  Visual Working Memory Contents Bias Ambiguous Structure from Motion Perception , 2013, PloS one.

[31]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[32]  S. M. Newhall,et al.  Comparison of Successive with Simultaneous Color Matching , 1957 .

[33]  Karl J. Friston,et al.  A Dual Role for Prediction Error in Associative Learning , 2008, Cerebral cortex.

[34]  Randolph Blake,et al.  Visual working memory contaminates perception , 2011, Psychonomic bulletin & review.

[35]  Marc Ebner,et al.  Color Constancy , 2007, Computer Vision, A Reference Guide.

[36]  Jack L. Vevea,et al.  Why do categories affect stimulus judgment? , 2000, Journal of experimental psychology. General.

[37]  D H Brainard,et al.  Color constancy in the nearly natural image. I. Asymmetric matches. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[38]  L. Arend,et al.  Simultaneous color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[39]  David Whitaker,et al.  The retention and disruption of color information in human short-term visual memory. , 2012, Journal of vision.

[40]  I. Kuriki,et al.  Measurement of Color Constancy by Color Memory Matching , 1998 .

[41]  Karl-Heinz Bäuml,et al.  PII: S0042-6989(98)00192-8 , 1998 .

[42]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[43]  Steven K Shevell,et al.  Working memory is related to perceptual processing: a case from color perception. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[44]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[45]  Anya Hurlbert,et al.  Role of color memory in successive color constancy. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[46]  K. Gegenfurtner,et al.  Effects of spatial and temporal context on color categories and color constancy. , 2007, Journal of vision.

[47]  Steven K Shevell,et al.  Chromatic induction: border contrast or adaptation to surrounding light? , 1998, Vision Research.

[48]  Mert R. Sabuncu,et al.  Improved inference in Bayesian segmentation using Monte Carlo sampling: Application to hippocampal subfield volumetry , 2013, Medical Image Anal..

[49]  Steven K Shevell,et al.  Stereo disparity improves color constancy , 2002, Vision Research.

[50]  SOME OBSERVATIONS ON IMMEDIATE COLOUR MEMORY1 , 1932 .

[51]  D. Brainard,et al.  Mechanisms of color constancy under nearly natural viewing. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[52]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[53]  D. Pelli,et al.  Display Characterization , 1998 .

[54]  S. Shevell,et al.  Color in complex scenes. , 2008, Annual review of psychology.

[55]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[56]  M. Dolores de Fez,et al.  Asymmetric colour matching: memory matching versus simultaneous matching , 2001 .

[57]  Y. Loewenstein,et al.  Bayesian Inference Underlies the Contraction Bias in Delayed Comparison Tasks , 2011, PloS one.

[58]  Denis Schluppeck,et al.  Decoding Working Memory of Stimulus Contrast in Early Visual Cortex , 2013, The Journal of Neuroscience.