Keeping an eye on serial order: Ocular movements bind space and time

The present study examined whether traveling through serially-ordered verbal memories exploits overt visuospatial attentional resources. In a three-phase behavioral study, five single-digits were presented sequentially at one spatial location in phase 1, while recognition and verbal recall were tested in phases 2 and 3, respectively. Participants' spontaneous eye movements were registered along with the verbal responses. Results showed that the search and the retrieval of serially-ordered information were mediated by spontaneous ocular movements. Specifically, recognizing middle items of the memorized sequence required longer inspection times and, importantly, a greater involvement of overt attentional resources, than recognizing the serially first-presented item and, to a lesser extent, the last-presented item. Moreover, serial order was found to be spatially encoded from left-to-right, as eye position during vocal responses deviated the more to the right, the later the serial position of the retrieved item in the sequence. These findings suggest that overt spatial attention mediates the scanning of serial order representation.

[1]  Julio Santiago,et al.  Flexible Conceptual Projection of Time Onto Spatial Frames of Reference , 2006, Cogn. Sci..

[2]  F. Bracco,et al.  Investigating mental representation of order with a speeded probed recall task. , 2009, Acta psychologica.

[3]  M. Corballis,et al.  Access to elements of a memorized list , 1972 .

[4]  Serial Learning and Paralearning: Control Processes in Serial Acquisition , 1976 .

[5]  T. Loetscher,et al.  Eye position predicts what number you have in mind , 2010, Current Biology.

[6]  Giorgio Vallortigara,et al.  Number-space mapping in the newborn chick resembles humans’ mental number line , 2015, Science.

[7]  Pim Cuijpers,et al.  A meta-analysis of the contribution of eye movements in processing emotional memories. , 2013, Journal of behavior therapy and experimental psychiatry.

[8]  Julio Santiago,et al.  Time (also) flies from left to right , 2007, Psychonomic bulletin & review.

[9]  D. Munoz,et al.  Overt Responses during Covert Orienting , 2014, Neuron.

[10]  G D Brown,et al.  Oscillator-based memory for serial order. , 2000, Psychological review.

[11]  F. Shapiro Eye movement desensitization: a new treatment for post-traumatic stress disorder. , 1989, Journal of behavior therapy and experimental psychiatry.

[12]  B. Tversky,et al.  Cross-cultural and developmental trends in graphic productions , 1991, Cognitive Psychology.

[13]  K. Parker,et al.  Eye movement desensitization and reprocessing (EMDR): a meta-analysis. , 2001, Journal of consulting and clinical psychology.

[14]  A. Henik,et al.  Reading direction shifts visuospatial attention: an Interactive Account of attentional biases. , 2014, Acta psychologica.

[15]  R. Henson Short-Term Memory for Serial Order: The Start-End Model , 1998, Cognitive Psychology.

[16]  S. Sternberg Memory-scanning: mental processes revealed by reaction-time experiments. , 1969, American scientist.

[17]  Marc Ouellet,et al.  Thinking about the future moves attention to the right. , 2010, Journal of experimental psychology. Human perception and performance.

[18]  Luisa Girelli,et al.  Placing order in space: the SNARC effect in serial learning , 2010, Experimental Brain Research.

[19]  T. Loetscher,et al.  Looking for the answer: The mind's eye in number space , 2008, Neuroscience.

[20]  Jay Pratt,et al.  Time flies like an arrow: Space-time compatibility effects suggest the use of a mental timeline , 2008, Psychonomic bulletin & review.

[21]  P. Brugger,et al.  Chicks with a number sense , 2015, Science.

[22]  M. Zorzi,et al.  When time is space: Evidence for a mental time line , 2012, Neuroscience & Biobehavioral Reviews.

[23]  B. Murdock,et al.  Memory for Serial Order , 1989 .

[24]  S. Phillips,et al.  Relational knowledge: the foundation of higher cognition , 2010, Trends in Cognitive Sciences.

[25]  A. Baddeley,et al.  Working memory and the vividness of imagery. , 2000, Journal of experimental psychology. General.

[26]  B. Postle,et al.  Superior Parietal Cortex Is Critical for the Manipulation of Information in Working Memory , 2009, The Journal of Neuroscience.

[27]  B. Dosher,et al.  Serial position and set size in short-term memory: The time course of recognition , 1989 .

[28]  I. Robertson Digit span and visual neglect: A puzzling relationship , 1990, Neuropsychologia.

[29]  E. E. Smith,et al.  Working memory for order information: Multiple cognitive and neural mechanisms , 2006, Neuroscience.

[30]  Alejandro Lleras,et al.  Covert shifts of attention function as an implicit aid to insight , 2009, Cognition.

[31]  A. Baddeley Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[32]  Jean-Philippe van Dijck,et al.  A working memory account for spatial–numerical associations , 2011, Cognition.

[33]  Fred W. Mast,et al.  Eye movements during mental time travel follow a diagonal line , 2014, Consciousness and Cognition.

[34]  Klaus Bartl,et al.  Eye movement driven head-mounted camera: it looks where the eyes look , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[35]  B. Laeng,et al.  Eye scanpaths during visual imagery reenact those of perception of the same visual scene , 2002 .

[36]  M. Corballis Serial order in recognition and recall. , 1967, Journal of experimental psychology.

[37]  Andreas Meyer-Lindenberg,et al.  Shared and distinct neurophysiological components of the digits forward and backward tasks as revealed by functional neuroimaging , 2004, Neuropsychologia.

[38]  K. Heilman,et al.  Pseudoneglect: Effects of hemispace on a tactile line bisection task , 1980, Neuropsychologia.

[39]  C. Marshuetz,et al.  Order information in working memory: an integrative review of evidence from brain and behavior. , 2005, Psychological bulletin.

[40]  Steve Majerus,et al.  Human Neuroscience Hypothesis and Theory Article Finding the Answer in Space: the Mental Whiteboard Hypothesis on Serial Order in Working Memory , 2022 .

[41]  K. Lashley The problem of serial order in behavior , 1951 .

[42]  J Weinberg,et al.  Digit span in right and left hemiplegics. , 1972, Journal of clinical psychology.

[43]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[44]  M Corbetta,et al.  Frontoparietal cortical networks for directing attention and the eye to visual locations: identical, independent, or overlapping neural systems? , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[45]  S. Sternberg High-Speed Scanning in Human Memory , 1966, Science.

[46]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[47]  Luisa Girelli,et al.  Human Infants' Preference for Left-to-Right Oriented Increasing Numerical Sequences , 2014, PloS one.

[48]  A Baddeley,et al.  Eye-movements and visual imagery: a working memory approach to the treatment of post-traumatic stress disorder. , 1997, The British journal of clinical psychology.

[49]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[50]  Glen E. Bodner,et al.  How eye movements affect unpleasant memories: support for a working-memory account. , 2008, Behaviour research and therapy.

[51]  Luisa Girelli,et al.  Minds without language represent number through space: origins of the mental number line , 2012, Front. Psychology.

[52]  Krzysztof J. Gorgolewski,et al.  Dynamic network participation of functional connectivity hubs assessed by resting-state fMRI , 2014, Front. Hum. Neurosci..

[53]  D. Tolin,et al.  Science and pseudoscience in the development of eye movement desensitization and reprocessing: implications for clinical psychology. , 2000, Clinical psychology review.

[54]  Alan D Baddeley,et al.  Memory for serial order across domains: An overview of the literature and directions for future research. , 2014, Psychological bulletin.

[55]  Michael J. Spivey,et al.  Oculomotor mechanisms activated by imagery and memory: eye movements to absent objects , 2001, Psychological research.

[56]  S. Sternberg Memory Scanning: New Findings and Current Controversies , 1975 .

[57]  Julie D. Golomb,et al.  A taxonomy of external and internal attention. , 2011, Annual review of psychology.

[58]  Freya Acar,et al.  A Working Memory Account of the Interaction between Numbers and Spatial Attention , 2014, Quarterly journal of experimental psychology.

[59]  Laura E. Thomas,et al.  Moving eyes and moving thought: On the spatial compatibility between eye movements and cognition , 2007, Psychonomic bulletin & review.

[60]  M. Johansson,et al.  Look Here, Eye Movements Play a Functional Role in Memory Retrieval , 2014, Psychological science.

[61]  Ronald Okada,et al.  Serial position effects in high-speed memory search , 1971 .

[62]  Steve Majerus,et al.  Spatial Attention Interacts With Serial-Order Retrieval From Verbal Working Memory , 2013, Psychological science.