The mental wormhole: Internal attention shifts without regard for distance

Attention operates perceptually on items in the environment, and internally on objects in visuospatial working memory. In the present study, we investigated whether spatial and temporal constraints affecting endogenous perceptual attention extend to internal attention. A retro-cue paradigm in which a cue is presented beyond the range of iconic memory and after stimulus encoding was used to manipulate shifts of internal attention. Participants’ memories were tested for colored circles (Experiments 1, 2, 3a, 4) or for novel shapes (Experiment 3b) and their locations within an array. In these experiments, the time to shift internal attention (Experiments 1 and 3) and the eccentricity of encoded objects (Experiments 2–4) were manipulated. Our data showed that, unlike endogenous perceptual attention, internal shifts of attention are not modulated by stimulus eccentricity. Across several timing parameters and stimuli, we found that shifts of internal attention require a minimum quantal amount of time regardless of the object eccentricity at encoding. Our findings are consistent with the view that internal attention operates on objects whose spatial information is represented in relative terms. Although endogenous perceptual attention abides by the laws of space and time, internal attention can shift across spatial representations without regard for physical distance.

[1]  S M Kosslyn,et al.  Visual images preserve metric spatial information: evidence from studies of image scanning. , 1978, Journal of experimental psychology. Human perception and performance.

[2]  Edward F. Ester,et al.  Spatially Global Representations in Human Primary Visual Cortex during Working Memory Maintenance , 2009, The Journal of Neuroscience.

[3]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[4]  T Bachmann,et al.  Integration and Interruption in the Masking of Form by Form , 1976, Perception.

[5]  J. Tipples Eye gaze is not unique: Automatic orienting in response to uninformative arrows , 2002, Psychonomic bulletin & review.

[6]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[7]  A. Nobre,et al.  Cognitive control of attention in the human brain: Insights from orienting attention to mental representations , 2006, Brain Research.

[8]  A. Kramer,et al.  Splitting the Beam: Distribution of Attention Over Noncontiguous Regions of the Visual Field , 1995 .

[9]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[10]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[11]  E Scheerer,et al.  Integration, interruption and processing rate in visual backward masking , 1973, Psychologische Forschung.

[12]  B. Fischer,et al.  Human express saccades: extremely short reaction times of goal directed eye movements , 2004, Experimental Brain Research.

[13]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[14]  David E. Irwin Robert D. Gordon Eye Movements, Attention and Trans-saccadic Memory , 1998 .

[15]  G. Sperling,et al.  Episodic theory of the dynamics of spatial attention. , 1995 .

[16]  Wilson O’Scalaidhe,et al.  Remembering “ what ” brings along “ where ” in visual working memory , 2022 .

[17]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[18]  D. Kahneman Method, findings, and theory in studies of visual masking. , 1968, Psychological bulletin.

[19]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[20]  J. Enns Object substitution and its relation to other forms of visual masking , 2004, Vision Research.

[21]  B. Bergum,et al.  Attention and performance IX , 1982 .

[22]  Anna C. Nobre,et al.  Spatial Attention can Bias Search in Visual Short-Term Memory , 2007, Frontiers in human neuroscience.

[23]  R. Radach,et al.  Transsaccadic memory for visual object detail , 2003 .

[24]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[25]  Ronald A. Rensink,et al.  Competition for consciousness among visual events: the psychophysics of reentrant visual processes. , 2000, Journal of experimental psychology. General.

[26]  A. Nobre,et al.  Orienting Attention to Locations in Internal Representations , 2003, Journal of Cognitive Neuroscience.

[27]  Peter De Graef,et al.  Transsaccadic memory for visual object detail. , 2002, Progress in brain research.

[28]  G. Woodman,et al.  Voluntary and automatic attentional control of visual working memory , 2002 .

[29]  Leonardo Chelazzi,et al.  Selective Attention to Specific Features within Objects: Behavioral and Electrophysiological Evidence , 2006, Journal of Cognitive Neuroscience.

[30]  C. Eriksen,et al.  Some characteristics of selective attention in visual perception determined by vocal reaction time , 1972 .

[31]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[32]  E. Vogel,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Working Memory Represents a Fixed Number of Items Regardless of Complexity , 2022 .

[33]  Lauren L. Richmond,et al.  Shifting Attention among Working Memory Representations: Testing Cue Type, Awareness, and Strategic Control , 2012, Quarterly journal of experimental psychology.

[34]  H. Spekreijse,et al.  Large capacity storage of integrated objects before change blindness , 2003, Vision Research.

[35]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[36]  S. Kosslyn The medium and the message in mental imagery: A theory. , 1981 .

[37]  Frans A. J. Verstraten,et al.  The speed of visual attention: what time is it? , 2006, Journal of vision.

[38]  D. E. Irwin Memory for position and identity across eye movements. , 1992 .

[39]  C. Miniussi,et al.  Orienting of attention with eye and arrow cues and the effect of overtraining. , 2010, Acta Psychologica.

[40]  Victor A. F. Lamme,et al.  Are There Multiple Visual Short-Term Memory Stores? , 2008, PloS one.

[41]  R. Klein,et al.  What are human express saccades? , 1993, Perception & psychophysics.

[42]  H. J. Muller,et al.  Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption. , 1989, Journal of experimental psychology. Human perception and performance.

[43]  V. Lamme,et al.  V4 Activity Predicts the Strength of Visual Short-Term Memory Representations , 2009, The Journal of Neuroscience.

[44]  A. Nobre,et al.  Attentional modulation of object representations in working memory. , 2007, Cerebral cortex.

[45]  A F Kramer,et al.  Object-based attentional selection--grouped arrays or spatially invariant representations?: comment on vecera and Farah (1994). , 1997, Journal of experimental psychology. General.

[46]  Heiner Deubel,et al.  Transsaccadic memory of position and form. , 2002, Progress in brain research.

[47]  P. Maquet,et al.  Orienting Attention to Locations in Perceptual Versus Mental Representations , 2004, Journal of Cognitive Neuroscience.

[48]  M. Farah,et al.  Does visual attention select objects or locations? , 1994, Journal of experimental psychology. General.

[49]  Jan Theeuwes,et al.  Spatial working memory effects in early visual cortex , 2010, Brain and Cognition.

[50]  ● Pytorch,et al.  Attention! , 1998, Trends in Cognitive Sciences.

[51]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[52]  Victor A. F. Lamme,et al.  Manipulations of attention dissociate fragile visual short-term memory from visual working memory , 2011, Neuropsychologia.

[53]  H. Egeth,et al.  Further evidence for a time-independent shift of the focus of attention , 1991, Perception & psychophysics.

[54]  Y. Tsal Movements of attention across the visual field. , 1983, Journal of experimental psychology. Human perception and performance.

[55]  J. Enns,et al.  Object Substitution: A New Form of Masking in Unattended Visual Locations , 1997 .

[56]  Rufin VanRullen,et al.  Bullet trains and steam engines: exogenous attention zips but endogenous attention chugs along. , 2011, Journal of vision.

[57]  John Jonides,et al.  Programming saccadic eye movements. , 1988 .

[58]  M. Cheal,et al.  Central and Peripheral Precuing of Forced-Choice Discrimination , 1991, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[59]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[60]  Michi Matsukura,et al.  Interference between object-based attention and object-based memory , 2009, Psychonomic bulletin & review.

[61]  Y. Tsal Movements of attention across the visual field , 1983 .

[62]  A. Nobre,et al.  Modulation of working-memory maintenance by directed attention , 2011, Neuropsychologia.

[63]  J Jonides,et al.  Programming saccadic eye movements. , 1988, Journal of experimental psychology. Human perception and performance.

[64]  Rachel S. Sussman,et al.  Orienting attention in visual working memory reduces interference from memory probes. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[65]  I. THE ATTENTION SYSTEM OF THE HUMAN BRAIN , 2002 .

[66]  C. Eriksen,et al.  Temporal course of selective attention. , 1969, Journal of experimental psychology.

[67]  Roy Luria,et al.  Orienting attention to objects in visual short-term memory , 2009, Neuropsychologia.

[68]  Yuhong Jiang,et al.  Distributing versus focusing attention in visual short-term memory , 2007, Psychonomic bulletin & review.

[69]  Johannes J. Fahrenfort,et al.  Masking Disrupts Reentrant Processing in Human Visual Cortex , 2007, Journal of Cognitive Neuroscience.

[70]  T. Spencer,et al.  Evidence for an interruption theory of backward masking. , 1970, Journal of experimental psychology.

[71]  D. Homa,et al.  Reallocation of visual attention. , 1991, Journal of experimental psychology. Human perception and performance.

[72]  Talis Bachmann Psychophysiology of Visual Masking: The Fine Structure of Conscious Experience , 1994 .

[73]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[74]  G. Shulman,et al.  Moving attention through visual space. , 1979, Journal of experimental psychology. Human perception and performance.

[75]  J. Enns,et al.  What’s new in visual masking? , 2000, Trends in Cognitive Sciences.

[76]  Gregory Francis,et al.  Effects of temporal integration on the shape of visual backward masking functions. , 2008, Journal of experimental psychology. Human perception and performance.

[77]  J. Jonides Voluntary versus automatic control over the mind's eye's movement , 1981 .

[78]  M. Carrasco Visual attention: The past 25 years , 2011, Vision Research.

[79]  S. Luck,et al.  Attention effects during visual short-term memory maintenance: Protection or prioritization? , 2007 .

[80]  S. Vecera Grouped arrays versus object-based representations : Reply to Kramer et al. (1997) , 1997 .

[81]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[82]  Axel Cleeremans,et al.  Feature bindings are maintained in visual short-term memory without sustained focused attention. , 2010, Experimental psychology.

[83]  Julie D. Golomb,et al.  A taxonomy of external and internal attention. , 2011, Annual review of psychology.

[84]  Victor A. F. Lamme,et al.  Detailed Sensory Memory, Sloppy Working Memory , 2010, Front. Psychology.

[85]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[86]  Victor A. F. Lamme,et al.  Magnetic stimulation of the dorsolateral prefrontal cortex dissociates fragile visual short-term memory from visual working memory , 2011, Neuropsychologia.

[87]  Jöran Lepsien,et al.  Searching for Targets within the Spatial Layout of Visual Short-Term Memory , 2009, The Journal of Neuroscience.

[88]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[89]  R. Remington,et al.  Moving attention: Evidence for time-invariant shifts of visual selective attention , 1984, Perception & psychophysics.

[90]  Object-based selection from spatially-invariant representations: evidence from a feature-report task , 2011, Attention, perception & psychophysics.

[91]  H Egeth,et al.  Consequences of allocating attention to locations and to other attributes , 1992, Perception & psychophysics.

[92]  Caroline Van Eccelpoel,et al.  The visual analog: evidence for a preattentive representation across saccades. , 2010, Journal of vision.

[93]  William C. Ogden,et al.  Attended and unattended processing modes: The role of set for spatial location , 2014 .

[94]  B. Julesz,et al.  Fast noninertial shifts of attention. , 1985, Spatial vision.

[95]  P. A. Kolers Perception and representation. , 1983, Annual review of psychology.

[96]  Jöran Lepsien,et al.  Directing spatial attention in mental representations: Interactions between attentional orienting and working-memory load , 2005, NeuroImage.

[97]  Geoffrey F Woodman,et al.  Perceptual organization influences visual working memory , 2003, Psychonomic bulletin & review.

[98]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[99]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[100]  Mark W. Becker,et al.  The Role of Iconic Memory in Change-Detection Tasks , 2000, Perception.