Hierarchical Encoding in Visual Working Memory

Influential models of visual working memory treat each item to be stored as an independent unit and assume that there are no interactions between items. However, real-world displays have structure that provides higher-order constraints on the items to be remembered. Even in the case of a display of simple colored circles, observers can compute statistics, such as mean circle size, to obtain an overall summary of the display. We examined the influence of such an ensemble statistic on visual working memory. We report evidence that the remembered size of each individual item in a display is biased toward the mean size of the set of items in the same color and the mean size of all items in the display. This suggests that visual working memory is constructive, encoding displays at multiple levels of abstraction and integrating across these levels, rather than maintaining a veridical representation of each item independently.

[1]  J. D. de Fockert,et al.  Rapid extraction of mean identity from sets of faces. , 2009, Quarterly journal of experimental psychology.

[2]  Jeffrey N Rouder,et al.  An assessment of fixed-capacity models of visual working memory , 2008, Proceedings of the National Academy of Sciences.

[3]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[4]  A. Treisman,et al.  Representation of statistical properties , 2003, Vision Research.

[5]  Andrew Hollingworth.  Visual Memory for Natural Scenes , 2008 .

[6]  Abel G. Oliva,et al.  Gist of a scene , 2005 .

[7]  Jack L. Vevea,et al.  Why do categories affect stimulus judgment? , 2000, Journal of experimental psychology. General.

[8]  Jeffrey S. Johnson,et al.  A Dynamic Neural Field Model of Visual Working Memory and Change Detection , 2009, Psychological science.

[9]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[10]  B. Scholl,et al.  The Automaticity of Visual Statistical Learning Statistical Learning , 2005 .

[11]  D. Ariely.  Seeing Sets: Representation by Statistical Properties , 2001, Psychological science.

[12]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[13]  Pernille Hemmer,et al.  Integrating episodic memories and prior knowledge at multiple levels of abstraction , 2009, Psychonomic bulletin & review.

[14]  L. Feigenson,et al.  Multiple Spatially Overlapping Sets Can Be Enumerated in Parallel , 2006, Psychological science.

[15]  Aude Oliva,et al.  Spatial ensemble statistics are efficient codes that can be represented with reduced attention , 2009, Proceedings of the National Academy of Sciences.

[16]  S. Luck,et al.  The influence of similarity on visual working memory representations , 2009, Visual cognition.

[17]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[18]  A. Oliva,et al.  The Representation of Simple Ensemble Visual Features Outside the Focus of Attention , 2008, Psychological science.

[19]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[20]  Lisa Feigenson,et al.  Parallel non-verbal enumeration is constrained by a set-based limit , 2008, Cognition.

[21]  George A. Alvarez,et al.  Compression in visual short-term memory: Using statistical regularities to form more efficient memory representations , 2010 .

[22]  J. Lund,et al.  Compulsory averaging of crowded orientation signals in human vision , 2001, Nature Neuroscience.

[23]  A. Treisman,et al.  Attentional spread in the statistical processing of visual displays , 2005, Perception & psychophysics.

[24]  Timothy F. Brady,et al.  Encoding higher-order structure in visual working memory: A probabilistic model , 2010 .

[25]  Jason M Haberman,et al.  Rapid extraction of mean emotion and gender from sets of faces , 2007, Current Biology.

[26]  Talia Konkle,et al.  Normative Representation of Objects: Evidence for an Ecological Bias in Object Perception and Memory , 2007 .

[27]  Thomas Sanocki,et al.  How high is visual short-term memory capacity for object layout? , 2010, Attention, perception & psychophysics.

[28]  A. Treisman,et al.  Statistical processing: computing the average size in perceptual groups , 2005, Vision Research.

[29]  Jonathan D. Victor,et al.  Visual working memory for image statistics , 2004, Vision Research.

[30]  David Whitney,et al.  The visual system ignores outliers when extracting a summary representation , 2010 .

[31]  Harold Pashler,et al.  Characterizing the Limits of Human Visual Awareness , 2007, Science.

[32]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[33]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[34]  R. Sekuler,et al.  Distortions in recall from visual memory: two classes of attractors at work. , 2010, Journal of vision.

[35]  Catherine Tallon-Baudry,et al.  Relational information in visual short-term memory: the structural gist. , 2005, Journal of vision.

[36]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[37]  J. Neuschatz,et al.  Recollections of things schematic: room schemas revisited. , 2001, Journal of experimental psychology. Learning, memory, and cognition.