Familiarity Speeds Up Visual Short-Term Memory Consolidation

Existing long-term memory (LTM) can boost the number of retained representations over a short delay in visual short-term memory (VSTM). However, it is unclear whether and how prior LTM affects the initial process of transforming fragile sensory inputs into durable VSTM representations (i.e., VSTM consolidation). The consolidation speed hypothesis predicts faster consolidation for familiar relative to unfamiliar stimuli. Alternatively, the perceptual boost hypothesis predicts that the advantage in perceptual processing of familiar stimuli should add a constant boost for familiar stimuli during VSTM consolidation. To test these competing hypotheses, the present study examined how the large variance in participants’ prior multimedia experience with Pokémon affected VSTM for Pokémon. In Experiment 1, the amount of time allowed for VSTM consolidation was manipulated by presenting consolidation masks at different intervals after the onset of to-be-remembered Pokémon characters. First-generation Pokémon characters that participants were more familiar with were consolidated faster into VSTM as compared with recent-generation Pokémon characters that participants were less familiar with. These effects were absent in participants who were unfamiliar with both generations of Pokémon. Although familiarity also increased the number of retained Pokémon characters when consolidation was uninterrupted but still incomplete due to insufficient encoding time in Experiment 1, this capacity effect was absent in Experiment 2 when consolidation was allowed to complete with sufficient encoding time. Together, these results support the consolidation speed hypothesis over the perceptual boost hypothesis and highlight the importance of assessing experimental effects on both processing and representation aspects of VSTM.

[1]  P. Bennett,et al.  Inversion Leads to Quantitative, Not Qualitative, Changes in Face Processing , 2004, Current Biology.

[2]  Henrik Olsson,et al.  Visual memory needs categories. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Isabel Gauthier,et al.  A visual short-term memory advantage for objects of expertise. , 2009, Journal of experimental psychology. Human perception and performance.

[4]  B McElree,et al.  Working memory and focal attention. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[5]  Gordon D. A. Brown,et al.  Memory for familiar and unfamiliar words: Evidence for a long-term memory contribution to short-term memory span , 1991 .

[6]  H. Simon,et al.  Expert chess memory: revisiting the chunking hypothesis. , 1998, Memory.

[7]  Heather Buttle,et al.  High familiarity enhances visual change detection for face stimuli , 2003, Perception & psychophysics.

[8]  D. Simons,et al.  Detecting Changes in Novel, Complex Three-dimensional Objects , 2000 .

[9]  H. Zimmer,et al.  The influence of expertise and of physical complexity on visual short-term memory consolidation , 2011, Quarterly Journal of Experimental Psychology.

[10]  Diyu Chen,et al.  Visual working memory for trained and novel polygons , 2006 .

[11]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[12]  Anders Petersen,et al.  Intensive video gaming improves encoding speed to visual short-term memory in young male adults. , 2013, Acta psychologica.

[13]  M. Potter Conceptual Short Term Memory in Perception and Thought , 2012, Front. Psychology.

[14]  A. Baddeley,et al.  Word length and the structure of short-term memory , 1975 .

[15]  C. S. Green,et al.  Learning, Attentional Control, and Action Video Games , 2012, Current Biology.

[16]  Mark W. Becker,et al.  Serial Consolidation of Orientation Information Into Visual Short-Term Memory , 2013, Psychological science.

[17]  Ingrid R Olson,et al.  Visual short-term memory is not improved by training , 2004, Memory & cognition.

[18]  Aude Oliva,et al.  Visual long-term memory has a massive storage capacity for object details , 2008, Proceedings of the National Academy of Sciences.

[19]  Ali Jannati,et al.  Individual differences in rate of encoding predict estimates of visual short-term memory capacity (K). , 2015, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[20]  Liqiang Huang,et al.  Familiarity does not aid access to features , 2011, Psychonomic bulletin & review.

[21]  Timothy F. Brady,et al.  Conceptual Distinctiveness Supports Detailed Visual Long-term Memory for Real-world Objects the Fidelity of Long-term Memory for Visual Information , 2022 .

[22]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[23]  Charles Hulme,et al.  Speech Rate and the Development of Short-Term Memory Span. , 1984 .

[24]  A. Treisman,et al.  Perception of objects in natural scenes: is it really attention free? , 2005, Journal of experimental psychology. Human perception and performance.

[25]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[26]  Michael X. Cohen,et al.  Neural Mechanisms of Expert Skills in Visual Working Memory , 2006, The Journal of Neuroscience.

[27]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[28]  Irida Mance,et al.  Visual working memory. , 2013, Wiley interdisciplinary reviews. Cognitive science.

[29]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[30]  Melissa R. Beck,et al.  Accessing long-term memory representations during visual change detection , 2011, Memory & cognition.

[31]  Mary C Potter,et al.  Large capacity temporary visual memory. , 2014, Journal of experimental psychology. General.

[32]  M. Tarr,et al.  Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects , 1999, Nature Neuroscience.

[33]  A. Bartels,et al.  Decoding the Yellow of a Gray Banana , 2013, Current Biology.

[34]  E. Vogel,et al.  Perceptual expertise enhances the resolution but not the number of representations in working memory , 2008, Psychonomic bulletin & review.

[35]  B. Sparrow,et al.  Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips , 2011, Science.

[36]  M. Beutel,et al.  Reliabilit ä t und Validit ä t der Skala zum Computerspielverhalten ( CSV-S ) Reliability and Validity of the Scale for the Assessment of Pathological Computer-Gaming ( CSV-S ) , 2011 .

[37]  Taiji Ueno,et al.  What goes through the gate? Exploring interference with visual feature binding , 2011, Neuropsychologia.

[38]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[39]  R. Kail,et al.  Processing speed, speech rate, and memory. , 1992 .

[40]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[41]  R. Dell’Acqua,et al.  The Demonstration of Short-Term Consolidation , 1998, Cognitive Psychology.

[42]  A. Lansner,et al.  Neurocognitive Architecture of Working Memory , 2015, Neuron.

[43]  L. Standing Learning 10,000 pictures. , 1973, The Quarterly journal of experimental psychology.

[44]  Timothy F. Brady,et al.  Compression in visual working memory: using statistical regularities to form more efficient memory representations. , 2009, Journal of experimental psychology. General.

[45]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[46]  Hubert D. Zimmer,et al.  Gains of item-specific training in visual working memory and their neural correlates , 2012, Brain Research.

[47]  Yuhong Jiang,et al.  Visual working memory for simple and complex visual stimuli , 2005 .

[48]  Steven J. Luck,et al.  Visual short term memory , 2007, Scholarpedia.

[49]  A. Niese The Relationship between visual working memory and visual long-term memory , 2008 .

[50]  Charles Hulme,et al.  The role of long-term memory mechanisms in memory span , 1995 .

[51]  Zaifeng Gao,et al.  Coarse-to-fine encoding of spatial frequency information into visual short-term memory for faces but impartial decay. , 2011, Journal of experimental psychology. Human perception and performance.

[52]  R. Engels,et al.  The benefits of playing video games. , 2014, The American psychologist.

[53]  Mark W. Becker,et al.  The Role of Iconic Memory in Change-Detection Tasks , 2000, Perception.

[54]  Richard J. Allen,et al.  What you Say Matters: Exploring Visual–Verbal Interactions in Visual Working Memory , 2012, Quarterly journal of experimental psychology.

[55]  Alan D Baddeley,et al.  Disruption of visual feature binding in working memory , 2011, Memory & cognition.

[56]  Richard L. Lewis,et al.  The mind and brain of short-term memory. , 2008, Annual review of psychology.

[57]  Thomas Alrik Sørensen,et al.  Short-term storage capacity for visual objects depends on expertise. , 2012, Acta psychologica.

[58]  Lisa D. Blalock,et al.  Stimulus familiarity improves consolidation of visual working memory representations , 2015, Attention, perception & psychophysics.

[59]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[60]  Mary C Potter,et al.  Early Conceptual and Linguistic Processes Operate in Independent Channels , 2012, Psychological science.

[61]  Frank Tong,et al.  Expertise for upright faces improves the precision but not the capacity of visual working memory , 2014, Attention, perception & psychophysics.

[62]  E. Erdfelder,et al.  Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses , 2009, Behavior research methods.

[63]  Thomas W. James,et al.  Expert individuation of objects increases activation in the fusiform face area of children , 2013, NeuroImage.

[64]  K. Oberauer,et al.  Attention to Information in Working Memory , 2012 .

[65]  K. Gegenfurtner,et al.  Memory modulates color appearance , 2006, Nature Neuroscience.

[66]  Lisa Durrance Blalock,et al.  Mask similarity impacts short-term consolidation in visual working memory , 2013, Psychonomic bulletin & review.

[67]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[68]  Lamme Vaf,et al.  Why visual attention and awareness are different , 2003 .

[69]  Timothy F. Brady,et al.  Hierarchical Encoding in Visual Working Memory , 2010, Psychological science.

[70]  Mary C Potter,et al.  Conceptual short-term memory (CSTM) supports core claims of Christiansen and Chater , 2016, Behavioral and Brain Sciences.

[71]  Thomas S. Redick,et al.  Is working memory training effective? , 2012, Psychological bulletin.

[72]  S. Dehaene,et al.  Timing of the brain events underlying access to consciousness during the attentional blink , 2005, Nature Neuroscience.

[73]  Timothy F. Brady,et al.  A review of visual memory capacity: Beyond individual items and toward structured representations. , 2011, Journal of vision.

[74]  S. Kühn,et al.  Amount of lifetime video gaming is positively associated with entorhinal, hippocampal and occipital volume , 2014, Molecular Psychiatry.

[75]  T. Klingberg Training and plasticity of working memory , 2010, Trends in Cognitive Sciences.

[76]  I. Gauthier,et al.  A visual short-term memory advantage for faces , 2007, Psychonomic bulletin & review.

[77]  B. Postle,et al.  Effects of verbal and nonverbal interference on spatial and object visual working memory , 2005, Memory & cognition.

[78]  Jane E Raymond,et al.  Familiarity enhances visual working memory for faces. , 2008, Journal of experimental psychology. Human perception and performance.

[79]  J. P. Cavanagh Relation between the immediate memory span and the memory search rate. , 1972 .

[80]  E. Vogel,et al.  Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[81]  G. Woodman,et al.  The time course of consolidation in visual working memory. , 2006, Journal of experimental psychology. Human perception and performance.

[82]  Katherine Sledge Moore,et al.  Associative learning improves visual working memory performance. , 2005, Journal of experimental psychology. Human perception and performance.

[83]  Isabel Gauthier,et al.  The temporal advantage for individuating objects of expertise: perceptual expertise is an early riser. , 2009, Journal of vision.

[84]  Jeffrey N. Rouder,et al.  How to measure working memory capacity in the change detection paradigm , 2011, Psychonomic bulletin & review.

[85]  E. Averbach,et al.  Short-term memory in vision , 1961 .

[86]  C Shawn Green,et al.  Increasing Speed of Processing With Action Video Games , 2009, Current directions in psychological science.

[87]  Klaus Wölfling,et al.  Reliabilität und Validität der Skala zum Computerspielverhalten (CSV-S) , 2010, Psychotherapie, Psychosomatik, medizinische Psychologie.

[88]  Chen Shuo The Capacity of Visual Working Memory for Motion Direction of Objects , 2006 .

[89]  Jeffrey N Rouder,et al.  An assessment of fixed-capacity models of visual working memory , 2008, Proceedings of the National Academy of Sciences.

[90]  Constantin Rezlescu,et al.  Normal acquisition of expertise with greebles in two cases of acquired prosopagnosia , 2014, Proceedings of the National Academy of Sciences.

[91]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[92]  Richard D. Morey,et al.  Confidence Intervals from Normalized Data: A correction to Cousineau (2005) , 2008 .