A practical guide to functional magnetic resonance imaging with simultaneous eye tracking for cognitive neuroimaging research.

The simultaneous acquisition of functional magnetic resonance imaging (fMRI) with in-scanner eye tracking promises to combine the advantages of full-brain coverage of brain activity measurements with a fast and unobtrusive capture of eye movement behavior and attentional deployment. Despite its applicability to a wide variety of research questions, ranging from investigations of gaze control and attention guidance to the use of eye movement events as a response modality for gaze-contingent fMRI experiments, only few studies employ this kind of data acquisition. In this chapter we identify technical challenges, describe all necessary components and procedures for conducting such a study, and give practical advice on how these can be integrated in a common MRI laboratory setup. The chapter concludes with notes on the analysis of such datasets and summarizes key data properties and their implications of a joint analysis of fMRI and eye tracking data.

[1]  Fabio Richlan,et al.  A new high-speed visual stimulation method for gaze-contingent eye movement and brain activity studies , 2013, Front. Syst. Neurosci..

[2]  Taylor R. Hayes,et al.  Mapping and correcting the influence of gaze position on pupil size measurements , 2015, Behavior Research Methods.

[3]  Jan Theeuwes,et al.  OpenSesame: An open-source, graphical experiment builder for the social sciences , 2011, Behavior Research Methods.

[4]  Stefan M. Wierda,et al.  Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution , 2012, Proceedings of the National Academy of Sciences.

[5]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[6]  Mathôt Sebastiaan,et al.  A simple way to reconstruct pupil size during eye blinks , 2013 .

[7]  John M. Henderson,et al.  Transsaccadic Memory and Integration During Real-World Object Perception , 1997 .

[8]  S. Mathôt.  Pupillometry: Psychology, Physiology, and Function , 2018, Journal of cognition.

[9]  Jan Theeuwes,et al.  Visual attention and stability , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  J. Theeuwes,et al.  Eye movement trajectories and what they tell us , 2006, Neuroscience & Biobehavioral Reviews.

[11]  Mariska E. Kret,et al.  Preprocessing pupil size data: Guidelines and code , 2018, Behavior Research Methods.

[12]  Michael Hanke,et al.  A studyforrest extension, simultaneous fMRI and eye gaze recordings during prolonged natural stimulation , 2016, Scientific Data.

[13]  Stefan Pollmann,et al.  Frontal Cortex Differentiates Between Free and Imposed Target Selection in Multiple-Target Search , 2019, bioRxiv.

[14]  Michael Hanke,et al.  REMoDNaV: Robust Eye-Movement Classification for Dynamic Stimulation , 2020 .

[15]  F. Paas,et al.  Memory load and the cognitive pupillary response in aging. , 2004, Psychophysiology.

[16]  Stefan Pollmann,et al.  Simulated loss of foveal vision eliminates visual search advantage in repeated displays , 2012, Front. Hum. Neurosci..

[17]  W. Levelt,et al.  Pupillary dilation as a measure of attention: a quantitative system analysis , 1993 .

[18]  Michael Hanke,et al.  REMoDNaV: robust eye-movement classification for dynamic stimulation , 2019, Behavior Research Methods.

[19]  Sebastiaan Mathôt,et al.  PyGaze: An open-source, cross-platform toolbox for minimal-effort programming of eyetracking experiments , 2014, Behavior research methods.

[20]  Ronen Hershman,et al.  A novel blink detection method based on pupillometry noise , 2018, Behavior Research Methods.

[21]  J. Gold,et al.  Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex , 2016, Neuron.

[22]  J. Theeuwes,et al.  Interactions between working memory, attention and eye movements. , 2009, Acta psychologica.

[23]  Sven Apel,et al.  Simultaneous measurement of program comprehension with fMRI and eye tracking: a case study , 2018, ESEM.

[24]  K. Rayner.  The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[25]  Sebastiaan Mathôt,et al.  Safe and sensible preprocessing and baseline correction of pupil-size data , 2018, Behavior Research Methods.

[26]  P. Gordon,et al.  Similarity-based interference during language comprehension: Evidence from eye tracking during reading. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[27]  L. Stark,et al.  The main sequence, a tool for studying human eye movements , 1975 .

[28]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Sylvain Sirois,et al.  Pupil diameter measurement errors as a function of gaze direction in corneal reflection eyetrackers , 2013, Behavior research methods.

[30]  E. Castet,et al.  Intrasaccadic perception triggers pupillary constriction , 2015, PeerJ.

[31]  Ying Le-an,et al.  Brief review on physiological and biochemical evaluations of human mental workload , 2012 .

[32]  Mieke Donk,et al.  Large pupils predict goal-driven eye movements. , 2015, Journal of experimental psychology. General.

[33]  Glenn R. Gibson,et al.  Klebsiella pneumoniae subsp. pneumoniae–bacteriophage combination from the caecal effluent of a healthy woman , 2015, PeerJ.

[34]  Marcus Nyström,et al.  One algorithm to rule them all? An evaluation and discussion of ten eye movement event-detection algorithms , 2016, Behavior Research Methods.

[35]  F. Hutzler,et al.  Systematic influence of gaze position on pupil size measurement: analysis and correction , 2011, Behavior research methods.

[36]  B. Goldwater.  Psychological significance of pupillary movements. , 1972, Psychological bulletin.