Fixation based event‐related fmri analysis: Using eye fixations as events in functional magnetic resonance imaging to reveal cortical processing during the free exploration of visual images

Eye movements, comprising predominantly fixations and saccades, are known to reveal information about perception and cognition, and they provide an explicit measure of attention. Nevertheless, fixations have not been considered as events in the analyses of data obtained during functional magnetic resonance imaging (fMRI) experiments. Most likely, this is due to their brevity and statistical properties. Despite these limitations, we used fixations as events to model brain activation in a free viewing experiment with standard fMRI scanning parameters. First, we found that fixations on different objects in different task contexts resulted in distinct cortical patterns of activation. Second, using multivariate pattern analysis, we showed that the BOLD signal revealed meaningful information about the task context of individual fixations and about the object being inspected during these fixations. We conclude that fixation‐based event‐related (FIBER) fMRI analysis creates new pathways for studying human brain function by enabling researchers to explore natural viewing behavior. Hum Brain Mapp, 2012. © 2011 Wiley Periodicals, Inc.

[1]  J. Haynes Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Andreas Keil,et al.  The Timing of Emotional Discrimination in Human Amygdala and Ventral Visual Cortex , 2009, The Journal of Neuroscience.

[4]  F. Cornelissen,et al.  Impaired visual processing preceding image recognition in Parkinson's disease patients with visual hallucinations. , 2009, Brain : a journal of neurology.

[5]  D. Veltman,et al.  The Netherlands Study of Anxiety and Depression (NESDA): Amygdala response to facial expressions. , 2009, NeuroImage.

[6]  Nikolaus Kriegeskorte,et al.  Analyzing for information, not activation, to exploit high-resolution fMRI , 2007, NeuroImage.

[7]  Janaina Mourão Miranda,et al.  Classifying brain states and determining the discriminating activation patterns: Support Vector Machine on functional MRI data , 2005, NeuroImage.

[8]  Kim M. Dalton,et al.  Gaze fixation and the neural circuitry of face processing in autism , 2005, Nature Neuroscience.

[9]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[10]  D. Hubel,et al.  The role of fixational eye movements in visual perception , 2004, Nature Reviews Neuroscience.

[11]  Ziad S Saad,et al.  The spatial extent of the BOLD response , 2003, NeuroImage.

[12]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[13]  Peter A. Bandettini,et al.  Detection versus Estimation in Event-Related fMRI: Choosing the Optimal Stimulus Timing , 2002, NeuroImage.

[14]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[15]  P. Bandettini,et al.  Spatial Heterogeneity of the Nonlinear Dynamics in the FMRI BOLD Response , 2001, NeuroImage.

[16]  R. Buxton,et al.  Detection Power, Estimation Efficiency, and Predictability in Event-Related fMRI , 2001, NeuroImage.

[17]  A. Dale,et al.  Deconvolution of Event-Related fMRI Responses in Fast-Rate Experimental Designs: Tracking Amplitude Variations , 2000, Journal of Cognitive Neuroscience.

[18]  P T Fox,et al.  Comparison of the temporal response in perfusion and BOLD‐based event‐related functional MRI , 2000, Magnetic resonance in medicine.

[19]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[20]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[21]  A M Dale,et al.  Randomized event‐related experimental designs allow for extremely rapid presentation rates using functional MRI , 1998, Neuroreport.

[22]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[23]  A M Dale,et al.  Event-related functional MRI: past, present, and future. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[24]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[25]  Karl J. Friston,et al.  Nonlinear event‐related responses in fMRI , 1998, Magnetic resonance in medicine.

[26]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[27]  W Richter,et al.  Limitations of temporal resolution in functional MRI , 1997, Magnetic resonance in medicine.

[28]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[29]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[30]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[31]  A. Dale,et al.  Selective averaging of rapidly presented individual trials using fMRI , 1997, Human brain mapping.

[32]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[33]  Karl J. Friston,et al.  Event‐related f MRI , 1997, Human brain mapping.

[34]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[35]  R. Buckner,et al.  Human Brain Mapping 6:373–377(1998) � Event-Related fMRI and the Hemodynamic Response , 2022 .