Independent Effects of Eye and Hand Movements on Visual Working Memory

Both eye and hand movements have been shown to selectively interfere with visual working memory. We investigated working memory in the context of simultaneous eye-hand movements to approach the question whether the eye and the hand movement systems independently interact with visual working memory. Participants memorized several locations and performed eye, hand, or simultaneous eye-hand movements during the maintenance interval. Subsequently, we tested spatial working memory at the eye or the hand motor goal, and at action-irrelevant locations. We found that for single eye and single hand movements, memory at the eye or hand target was significantly improved compared to action-irrelevant locations. Remarkably, when an eye and a hand movement were prepared in parallel, but to distinct locations, memory at both motor targets was enhanced—with no tradeoff between the two separate action goals. This suggests that eye and hand movements independently enhance visual working memory at their goal locations, resulting in an overall working memory performance that is higher than that expected when recruiting only one effector.

[1]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[2]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[3]  J. Myerson,et al.  Selective interference with the maintenance of location information in working memory. , 1996 .

[4]  P. Goldman-Rakic,et al.  Inactivation of parietal and prefrontal cortex reveals interdependence of neural activity during memory-guided saccades. , 2000, Journal of neurophysiology.

[5]  J. Myerson,et al.  The effects of eye and limb movements on working memory , 2001, Memory.

[6]  Chen Shuo.  The Capacity of Visual Working Memory for Motion Direction of Objects , 2006 .

[7]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[8]  J. Crawford,et al.  Action relevance induces an attentional weighting of representations in visual working memory , 2017, Memory & cognition.

[9]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[10]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[11]  H. Deubel,et al.  Independent Allocation of Attention to Eye and Hand Targets in Coordinated Eye-Hand Movements , 2011, Psychological science.

[12]  H. Deubel,et al.  Selective Dorsal and Ventral Processing: Evidence for a Common Attentional Mechanism in Reaching and Perception , 1998 .

[13]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[14]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[15]  Martin Rolfs,et al.  Reach preparation enhances visual performance and appearance , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[16]  Heiner Deubel,et al.  Oculomotor selection underlies feature retention in visual working memory. , 2016, Journal of neurophysiology.

[17]  Carolyn Jeane Perry,et al.  An Eye in the Palm of Your Hand: Alterations in Visual Processing Near the Hand, a Mini-Review , 2016, Front. Comput. Neurosci..

[18]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Martin Rolfs,et al.  Saccadic Eye Movements Impose a Natural Bottleneck on Visual Short-Term Memory , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[20]  Anjaneyulu Krothapalli,et al.  Turbulent pulsed jet , 2006, J. Vis..

[21]  Mazyar Fallah,et al.  Effector‐based attention systems , 2017, Annals of the New York Academy of Sciences.

[22]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[23]  J. Meere.  The role of attention. , 2002 .

[24]  Heiner Deubel,et al.  Independent selection of eye and hand targets suggests effector-specific attentional mechanisms , 2018, Scientific Reports.