Visual Continuous Recognition Reveals Widespread Cortical Contributions to Scene Memory

Humans have a remarkably high capacity and long duration memory for complex scenes. Previous research documents the neural substrates that allow for efficient categorization of scenes from other complex stimuli like objects and faces, but the spatiotemporal neural dynamics underlying scene memory are less well understood. In the present study, we used high density EEG during a visual continuous recognition task in which new, old, and scrambled scenes consisting of color outdoor photographs were presented at an average rate 0.26 Hz. Old scenes were single repeated presentations occurring within either a short-term (≤ 20 seconds) or longer-term intervals of between 30 sec and 3 minutes or 4 and 10 minutes. Overall recognition was far above chance, with better performance at short- than longer-term intervals. A group ANOVA found parietal and frontal ERPs discriminated the three scene types as early as 59 ms after stimulus onset. Parietal ERPs were greater for old compared to new scenes by 189 ms, while fronto-temporal ERPs were greater for new compared to old scenes by 194 ms. For old scenes presented within longer-term intervals, parieto-temporal and centro-frontal ERPs were greater by 228 and 355 ms respectively compared to old scenes presented within a short-term interval. Supervised machine learning exhibited above-chance decoding of scene type by 275 ms. Single-subject BOLD-fMRI showed greater activity for old scenes across frontal, parietal, and temporal cortex. These converging findings show that a widespread network including parietal, frontal, and temporal regions supports short- and long-term scene memory. Significance Statement The ability to recognize a scene as novel or familiar is critical for basic cognition. Scene recognition plays an important role in episodic memory because it helps us quickly establish place, a first step in recalling where previous events occurred. Short-term recognition supports our ability to detect changes in the immediate environment, an ability critical to survival. Scene recognition after a longer-term interval is often the essential cue for retrieving autobiographical memories. Previous behavioral studies demonstrate high capacity and long duration scene memory. Neural studies have identified the brain regions that support scene-specific processing. The present study extends this research by filling a gap in understanding how distributed spatiotemporal patterns of neural activity support short- and long-term scene memory.

[1]  B. Underwood,et al.  Proactive inhibition in short-term retention of single items , 1962 .

[2]  Timothy F. Brady,et al.  Conceptual Distinctiveness Supports Detailed Visual Long-term Memory for Real-world Objects the Fidelity of Long-term Memory for Visual Information , 2022 .

[3]  Guillaume A. Rousselet,et al.  Processing of one, two or four natural scenes in humans: the limits of parallelism , 2004, Vision Research.

[4]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[5]  L. R. Peterson,et al.  Short-term retention of individual verbal items. , 1959, Journal of experimental psychology.

[6]  M. Rugg,et al.  Event-related potentials and recognition memory , 2007, Trends in Cognitive Sciences.

[7]  H Stanislaw,et al.  Calculation of signal detection theory measures , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[8]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[9]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[10]  R. Shepard Recognition memory for words, sentences, and pictures , 1967 .

[11]  Dwight J Kravitz,et al.  The Temporal Dynamics of Scene Processing: A Multifaceted EEG Investigation , 2016, eNeuro.

[12]  Mary C Potter,et al.  Large capacity temporary visual memory. , 2014, Journal of experimental psychology. General.

[13]  Michelle R. Greene,et al.  Recognition of natural scenes from global properties: Seeing the forest without representing the trees , 2009, Cognitive Psychology.

[14]  P. Berg,et al.  The correction of ocular artifacts: a topographic perspective , 2000, Clinical Neurophysiology.

[15]  S. Dehaene,et al.  Characterizing the dynamics of mental representations: the temporal generalization method , 2014, Trends in Cognitive Sciences.

[16]  M. Teplan FUNDAMENTALS OF EEG MEASUREMENT , 2002 .

[17]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[18]  M. Rugg,et al.  Context Effects on the Neural Correlates of Recognition Memory An Electrophysiological Study , 2001, Neuron.

[19]  E. Maris Statistical testing in electrophysiological studies. , 2012, Psychophysiology.

[20]  C. C. Chandler How memory for an event is influenced by related events: Interference in modified recognition tests. , 1991 .

[21]  A. L. Brown,et al.  Recognition memory for pictures in preschool children. , 1971, Journal of experimental child psychology.

[22]  Philippe Kahane,et al.  Timing of posterior parahippocampal gyrus activity reveals multiple scene processing stages , 2013, Human brain mapping.

[23]  Patrick Berg,et al.  Artifact Correction of the Ongoing EEG Using Spatial Filters Based on Artifact and Brain Signal Topographies , 2002, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[24]  Soojin Park,et al.  Disentangling Scene Content from Spatial Boundary: Complementary Roles for the Parahippocampal Place Area and Lateral Occipital Complex in Representing Real-World Scenes , 2011, The Journal of Neuroscience.

[25]  Aude Oliva,et al.  Visual long-term memory has a massive storage capacity for object details , 2008, Proceedings of the National Academy of Sciences.

[26]  Benjamin J. Shannon,et al.  Parietal lobe contributions to episodic memory retrieval , 2005, Trends in Cognitive Sciences.

[27]  Russell A. Epstein,et al.  Coding of navigational affordances in the human visual system , 2017, Proceedings of the National Academy of Sciences.

[28]  L. Standing Learning 10000 pictures , 1973 .

[29]  Stefan Glasauer,et al.  Rapid and independent memory formation in the parietal cortex , 2016, Proceedings of the National Academy of Sciences.

[30]  S. Vogt,et al.  Long-term memory for 400 pictures on a common theme. , 2007, Experimental psychology.

[31]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[32]  Sean D. Kristjansson,et al.  Rapid discrimination of visual scene content in the human brain , 2006, Brain Research.

[33]  Sennay Ghebreab,et al.  From Image Statistics to Scene Gist: Evoked Neural Activity Reveals Transition from Low-Level Natural Image Structure to Scene Category , 2013, The Journal of Neuroscience.

[34]  Endel Tulving,et al.  Similarity relations in recognition , 1981 .

[35]  Linda R. Warren,et al.  Evoked potential correlates of recognition memory , 1980, Biological Psychology.

[36]  Krista A. Ehinger,et al.  SUN database: Large-scale scene recognition from abbey to zoo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  T. Ellmore,et al.  Early and late components of EEG delay activity correlate differently with scene working memory performance , 2017, bioRxiv.

[38]  J. Rohrbaugh,et al.  Electrocortical signs of levels of processing: perceptual analysis and recognition memory. , 1980, Psychophysiology.

[39]  R. Haber,et al.  Perception and memory for pictures: Single-trial learning of 2500 visual stimuli , 1970 .

[40]  L. Stegagno,et al.  Selectively attending to natural scenes after alcohol consumption: An ERP analysis , 2006, Biological Psychology.

[41]  Guillaume A. Rousselet,et al.  Parallel processing in high-level categorization of natural images , 2002, Nature Neuroscience.

[42]  Yuhong Jiang,et al.  Proactive interference from items previously stored in visual working memory , 2008, Memory & cognition.