Prediction Beyond the Borders: ERP Indices of Boundary Extension-Related Error

Boundary extension (BE) is a rapidly occurring memory error in which participants incorrectly remember having seen beyond the boundaries of a view. However, behavioral data has provided no insight into how quickly after the onset of a test picture the effect is detected. To determine the time course of BE from neural responses we conducted a BE experiment while recording EEG. We exploited a diagnostic response asymmetry to mismatched views (a closer and wider view of the same scene) in which the same pair of views is rated as more similar when the closer item is shown first than vice versa. On each trial, a closer or wider view was presented for 250 ms followed by a 250-ms mask and either the identical view or a mismatched view. Boundary ratings replicated the typical asymmetry. We found a similar asymmetry in ERP responses in the 265-285 ms interval where the second member of the close-then-wide pairs evoked less negative responses at left parieto-temporal sites compared to the wide-then-close condition. We also found diagnostic ERP effects in the 500-560 ms range, where ERPs to wide-then-close pairs were more positive at centro-parietal sites than in the other three conditions, which is thought to be related to participants’ confidence in their perceptual decision. The ERP effect in the 265-285 ms range suggests the falsely remembered region beyond the view-boundaries of S1 is rapidly available and impacts assessment of the test picture within the first 265 ms of viewing, suggesting that extrapolated scene structure may be computed rapidly enough to play a role in the integration of successive views during visual scanning.

[1]  Christopher A. Dickinson,et al.  False Memory 1/20th of a Second Later , 2008, Psychological science.

[2]  E. Maguire,et al.  Attenuated Boundary Extension Produces a Paradoxical Memory Advantage in Amnesic Patients , 2012, Current Biology.

[3]  H. Intraub,et al.  Wide-angle memories of close-up scenes. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[4]  E. Wascher,et al.  Shifting attention between global features and small details: an event-related potential study , 1997, Biological Psychology.

[5]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[6]  A. Kok.  On the utility of P3 amplitude as a measure of processing capacity. , 2001, Psychophysiology.

[7]  Helene Intraub.  Chapter 6 - Rethinking Scene Perception: A Multisource Model , 2010 .

[8]  H. Intraub,et al.  Beyond the Edges of a View: Boundary Extension in Human Scene-Selective Visual Cortex , 2007, Neuron.

[9]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[10]  Sharon L. Thompson-Schill,et al.  Learning Places from Views: Variation in Scene Processing as a Function of Experience and Navigational Ability , 2005, Journal of Cognitive Neuroscience.

[11]  S. Galderisi,et al.  The cortical generators of P3a and P3b: A LORETA study , 2007, Brain Research Bulletin.

[12]  Karl J. Friston.  The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[13]  R. Blair,et al.  An alternative method for significance testing of waveform difference potentials. , 1993, Psychophysiology.

[14]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[15]  E. Donchin,et al.  Performance of concurrent tasks: a psychophysiological analysis of the reciprocity of information-processing resources. , 1983, Science.

[16]  T. Hubbard,et al.  Boundary extension: Findings and theories , 2010, Quarterly journal of experimental psychology.

[17]  Russell A. Epstein.  Cognitive Neuroscience: Scene Layout from Vision and Touch , 2011, Current Biology.

[18]  Yuping Wang,et al.  Event-related potentials evoked by multi-feature conflict under different attentive conditions , 2003, Experimental Brain Research.

[19]  H. Intraub,et al.  Boundary Extension for Briefly Glimpsed Photographs: Do Common Perceptual Processes Result in Unexpected Memory Distortions? , 1996 .

[20]  A. Koriat,et al.  Toward a psychology of memory accuracy. , 2000, Annual review of psychology.

[21]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[22]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  Piotr Jaskowski,et al.  Evidence for an Integrative Role of P3b in Linking Reaction to Perception , 2005 .

[24]  J. Wolfe,et al.  Looking at scenes while searching for numbers: Dividing attention multiplies space , 2008, Perception & psychophysics.

[25]  David M. Groppe,et al.  Mass univariate analysis of event-related brain potentials/fields I: a critical tutorial review. , 2011, Psychophysiology.

[26]  Jonathan D. Cohen,et al.  Decision making, the P3, and the locus coeruleus-norepinephrine system. , 2005, Psychological bulletin.

[27]  B. Hangya,et al.  Phase Entrainment of Human Delta Oscillations Can Mediate the Effects of Expectation on Reaction Speed , 2010, The Journal of Neuroscience.

[28]  E. Donchin,et al.  On quantifying surprise: the variation of event-related potentials with subjective probability. , 1977, Psychophysiology.

[29]  E. Maguire.  The retrosplenial contribution to human navigation: a review of lesion and neuroimaging findings. , 2001, Scandinavian journal of psychology.

[30]  Helene Intraub,et al.  Surface construal and the mental representation of scenes. , 2002, Journal of experimental psychology. Human perception and performance.

[31]  Shimin Fu,et al.  Event-related potentials reveal involuntary processing of orientation changes in the visual modality. , 2003, Psychophysiology.

[32]  Motohiro Kimura,et al.  Probability-independent and -dependent ERPs reflecting visual change detection. , 2006, Psychophysiology.

[33]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[34]  Christopher A. Dickinson,et al.  Transsaccadic representation of layout: what is the time course of boundary extension? , 2008, Journal of experimental psychology. Human perception and performance.

[35]  M. Potter.  Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[36]  Helene Intraub,et al.  Rethinking visual scene perception. , 2012, Wiley interdisciplinary reviews. Cognitive science.

[37]  J. Polich,et al.  Stimulus context determines P3a and P3b. , 1998, Psychophysiology.

[38]  Ray Johnson.  For Distinguished Early Career Contribution to Psychophysiology: Award Address, 1985 , 1986 .

[39]  H. Intraub,et al.  Effects of perceiving and imagining scenes on memory for pictures. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[40]  H Intraub,et al.  Looking at pictures but remembering scenes. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[41]  T W Picton,et al.  The P300 Wave of the Human Event‐Related Potential , 1992, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[42]  E. Maguire,et al.  The hippocampus extrapolates beyond the view in scenes: An fMRI study of boundary extension , 2013, Cortex.

[43]  Helene Intraub,et al.  Vertical biases in scene memory , 1997, Neuropsychologia.

[44]  Helene Intraub,et al.  More than meets the eye: The effect of planned fixations on scene representation , 2006, Perception & psychophysics.

[45]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[46]  E. Donchin,et al.  P300 and tracking difficulty: evidence for multiple resources in dual-task performance. , 1980, Psychophysiology.

[47]  Helene Intraub,et al.  Anticipatory spatial representation of natural scenes: Momentum without movement? , 2002 .

[48]  H. Roediger.  MEMORY ILLUSIONS , 2019, Experiencing the Impossible.

[49]  C. Gottesman,et al.  Mental layout extrapolations prime spatial processing of scenes. , 2011, Journal of experimental psychology. Human perception and performance.