Pupil Dilation Co-Varies with Memory Strength of Individual Traces in a Delayed Response Paired-Associate Task

Studies on cognitive effort have shown that pupil dilation is a reliable indicator of memory load. However, it is conceivable that there are other sources of effort involved in memory that also affect pupil dilation. One of these is the ease with which an item can be retrieved from memory. Here, we present the results of an experiment in which we studied the way in which pupil dilation acts as an online marker for memory processing during the retrieval of paired associates while reducing confounds associated with motor responses. Paired associates were categorized into sets containing either 4 or 7 items. After learning the paired associates once, pupil dilation was measured during the presentation of the retrieval cue during four repetitions of each set. Memory strength was operationalized as the number of repetitions (frequency) and set-size, since having more items per set results in a lower average recency. Dilation decreased with increased memory strength, supporting the hypothesis that the amplitude of the evoked pupillary response correlates positively with retrieval effort. Thus, while many studies have shown that “memory load” influences pupil dilation, our results indicate that the task-evoked pupillary response is also sensitive to the experimentally manipulated memory strength of individual items. As these effects were observed well before the response had been given, this study also suggests that pupil dilation can be used to assess an item’s memory strength without requiring an overt response.

[1]  D. Heitjan,et al.  Mixed-effects models in psychophysiology. , 2000, Psychophysiology.

[2]  Aaron J. Newman,et al.  The Influence of Language Proficiency on Lexical Semantic Processing in Native and Late Learners of English , 2012, Journal of Cognitive Neuroscience.

[3]  Michael D Rugg,et al.  Electrophysiological dissociation of retrieval orientation and retrieval effort , 2002, Psychonomic bulletin & review.

[4]  D I Boomsma,et al.  Does the heart know what the eye sees? A cardiac/pupillometric analysis of motor preparation and response execution. , 1989, Psychophysiology.

[5]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[6]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[7]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[8]  J S Wolffsohn,et al.  Continuous recording of accommodation and pupil size using the Shin-Nippon SRW-5000 autorefractor. , 2001, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[9]  Ariel Zylberberg,et al.  Pupil Dilation: A Fingerprint of Temporal Selection During the “Attentional Blink” , 2012, Front. Psychology.

[10]  W. Hockley,et al.  Item Effects in Recognition Memory for Words. , 2010 .

[11]  A. Jacobs,et al.  The coupling of emotion and cognition in the eye: introducing the pupil old/new effect. , 2007, Psychophysiology.

[12]  F. Paas,et al.  Memory load and the cognitive pupillary response in aging. , 2004, Psychophysiology.

[13]  Jean Lorenceau,et al.  Pupil dynamics during bistable motion perception. , 2009, Journal of vision.

[14]  Jelmer P. Borst,et al.  Stroop and picture—word interference are two sides of the same coin , 2009, Psychonomic bulletin & review.

[15]  M. Bradley,et al.  The pupil as a measure of emotional arousal and autonomic activation. , 2008, Psychophysiology.

[16]  Peter König,et al.  Overt Visual Attention as a Causal Factor of Perceptual Awareness , 2011, PloS one.

[17]  J. Beatty Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.

[18]  L. Selen,et al.  Deliberation in the Motor System: Reflex Gains Track Evolving Evidence Leading to a Decision , 2012, The Journal of Neuroscience.

[19]  C. Koch,et al.  Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry , 2008, Proceedings of the National Academy of Sciences.

[20]  A. Jacobs,et al.  Pupillary responses during lexical decisions vary with word frequency but not emotional valence. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  Tadeusz W. Kononowicz,et al.  Slow Potentials in Time Estimation: The Role of Temporal Accumulation and Habituation , 2011, Front. Integr. Neurosci..

[22]  T. Baccino,et al.  Analyzing the pupil response due to increased cognitive demand: an independent component analysis study. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[23]  Elisabeth Dévière,et al.  Analyzing linguistic data: a practical introduction to statistics using R , 2009 .

[24]  J. Cacioppo,et al.  Handbook of psychophysiology (2nd ed.). , 2000 .

[25]  S. Klein,et al.  Pupil dilation during visual target detection. , 2010, Journal of vision.

[26]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[27]  Qing Yang,et al.  The Pupil Reflects Motor Preparation for Saccades – Even before the Eye Starts to Move , 2011, Front. Hum. Neurosci..

[28]  F. Hutzler,et al.  Systematic influence of gaze position on pupil size measurement: analysis and correction , 2011, Behavior research methods.

[29]  E. Granholm,et al.  Pupillary responses index cognitive resource limitations. , 1996, Psychophysiology.

[30]  J L Barbur,et al.  Pupillary responses to stimulus structure, colour and movement , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[31]  D. Schacter,et al.  Functional–Anatomic Study of Episodic Retrieval Using fMRI I. Retrieval Effort versus Retrieval Success , 1998, NeuroImage.

[32]  Canan Karatekin,et al.  Development of attentional allocation in the dual task paradigm. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[33]  J Grainger,et al.  Orthographic processing in visual word recognition: a multiple read-out model. , 1996, Psychological review.

[34]  J Beatty,et al.  Response selection and initiation in speeded reactions: a pupillometric analysis. , 1983, Journal of experimental psychology. Human perception and performance.

[35]  Niels Taatgen,et al.  RACE/A: An Architectural Account of the Interactions Between Learning, Task Control, and Retrieval Dynamics , 2012, Cogn. Sci..

[36]  Y. Nakayama,et al.  Memorial message for the 10th anniversary of journal of visualization , 2007, J. Vis..

[37]  C. Caltagirone,et al.  Neural networks engaged in milliseconds and seconds time processing: evidence from transcranial magnetic stimulation and patients with cortical or subcortical dysfunction , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[38]  A. Magliero Pupil dilations following pairs of identical and related to-be-remembered words , 1983, Memory & cognition.

[39]  Hedderik van Rijn,et al.  The Locus of the Gratton Effect in Picture-Word Interference , 2010, Top. Cogn. Sci..

[40]  T. Troscianko,et al.  Effort during visual search and counting: Insights from pupillometry , 2007, Quarterly journal of experimental psychology.

[41]  J. Jolles,et al.  Pupil dilation in response preparation. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[42]  Fook K Chua,et al.  The effect of target contrast on the attentional blink , 2005, Perception & psychophysics.

[43]  Stefan M. Wierda,et al.  Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution , 2012, Proceedings of the National Academy of Sciences.

[44]  Simon Dennis,et al.  ERP ‘old/new’ effects: memory strength and decisional factor(s) , 2002, Neuropsychologia.

[45]  J Hyönä,et al.  Pupil Dilation as a Measure of Processing Load in Simultaneous Interpretation and Other Language Tasks , 1995, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[46]  Jeroen G. W. Raaijmakers,et al.  Mathematical Models of Human Memory , 2008 .

[47]  Paul Cisek,et al.  Response competition in the primary motor cortex: corticospinal excitability reflects response replacement during simple decisions. , 2010, Journal of neurophysiology.

[48]  J. Beatty,et al.  The pupillary system. , 2000 .

[49]  Isabell Wartenburger,et al.  Resource allocation and fluid intelligence: insights from pupillometry. , 2010, Psychophysiology.

[50]  R. Shiffrin,et al.  A model for evidence accumulation in the lexical decision task , 2004, Cognitive Psychology.

[51]  J. Byrne Learning and memory : a comprehensive reference , 2008 .

[52]  C. Chapman,et al.  Phasic pupil dilation response to noxious stimulation in normal volunteers: relationship to brain evoked potentials and pain report. , 1999, Psychophysiology.

[53]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .

[54]  Jonathan Smallwood,et al.  Pupillometric Evidence for the Decoupling of Attention from Perceptual Input during Offline Thought , 2011, PloS one.

[55]  Alexandros Kafkas,et al.  Familiarity and recollection produce distinct eye movement, pupil and medial temporal lobe responses when memory strength is matched , 2012, Neuropsychologia.