iMap: a novel method for statistical fixation mapping of eye movement data

Eye movement data analyses are commonly based on the probability of occurrence of saccades and fixations (and their characteristics) in given regions of interest (ROIs). In this article, we introduce an alternative method for computing statistical fixation maps of eye movements—iMap—based on an approach inspired by methods used in functional magnetic resonance imaging. Importantly, iMap does not require the a priori segmentation of the experimental images into ROIs. With iMap, fixation data are first smoothed by convolving Gaussian kernels to generate three-dimensional fixation maps. This procedure embodies eyetracker accuracy, but the Gaussian kernel can also be flexibly set to represent acuity or attentional constraints. In addition, the smoothed fixation data generated by iMap conform to the assumptions of the robust statistical random field theory (RFT) approach, which is applied thereafter to assess significant fixation spots and differences across the three-dimensional fixation maps. The RFT corrects for the multiple statistical comparisons generated by the numerous pixels constituting the digital images. To illustrate the processing steps of iMap, we provide sample analyses of real eye movement data from face, visual scene, and memory processing. The iMap MATLAB toolbox is editable and freely available for download online (www.unifr.ch/psycho/ibmlab/).

[1]  Bruno Rossion,et al.  Reduced fixation on the upper area of personally familiar faces following acquired prosopagnosia. , 2008, Journal of neuropsychology.

[2]  K. Rayner.  The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[3]  Nicholas J Wade,et al.  Dodge-Ing the Issue: Dodge, Javal, Hering, and the Measurement of Saccades in Eye-Movement Research , 2003, Perception.

[4]  R. Caldara,et al.  Developing cultural differences in face processing. , 2011, Developmental science.

[5]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[6]  P. Buisseret,et al.  Role of eye movements in developmental processes of orientation selectivity in the kitten visual cortex , 1986, Vision Research.

[7]  Rachael E. Jack,et al.  Social Experience Does Not Abolish Cultural Diversity in Eye Movements , 2011, Front. Psychology.

[8]  A. Gunji,et al.  Scanning Strategies Do Not Modulate Face Identification: Eye-Tracking and Near-Infrared Spectroscopy Study , 2010, PloS one.

[9]  R. Caldara,et al.  Putting Culture Under the ‘Spotlight’ Reveals Universal Information Use for Face Recognition , 2010, PloS one.

[10]  Olaf Blanke,et al.  Gravity and observer's body orientation influence the visual perception of human body postures. , 2009, Journal of vision.

[11]  Donald C. Hood,et al.  Sensitivity to Light , 1986 .

[12]  Raymond Dodge.  Visual motor functions. , 1911 .

[13]  E. Javal,et al.  Essai sur la physiologie de la lecture , 1878 .

[14]  J. Henderson,et al.  Object-based attentional selection in scene viewing. , 2010, Journal of vision.

[15]  Bruno Rossion,et al.  Does prosopagnosia take the eyes out from faces? Evidence for a defect in the use of diagnostic facial information in a brain-damaged patient , 2004 .

[16]  August Pfizmaier,et al.  Sitzungsberichte der kaiserlichen Akademie der Wissenschaften , 1875 .

[17]  Roberto Caldara,et al.  The Fusiform Face Area responds automatically to statistical regularities optimal for face categorization , 2009, Human brain mapping.

[18]  Iain D. Gilchrist,et al.  Mediaeval artists: Masters in directing the observers' gaze , 2007, Current Biology.

[20]  H. Ritter,et al.  Disambiguating Complex Visual Information: Towards Communication of Personal Views of a Scene , 1996, Perception.

[21]  J. V. van Hateren,et al.  Asymmetric dynamics of adaptation after onset and offset of flicker. , 2004, Journal of vision.

[22]  I. Nelken,et al.  Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades , 2008, Neuron.

[23]  David S Wooding,et al.  Eye movements of large populations: II. Deriving regions of interest, coverage, and similarity using fixation maps , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[24]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[25]  R. Caldara,et al.  Inverting Faces Does Not Abolish Cultural Diversity in Eye Movements , 2010, Perception.

[26]  Ignace T C Hooge,et al.  A quantitative measure for the uniformity of fixation density: The Voronoi method , 2006, Behavior research methods.

[27]  B. Tatler,et al.  Yarbus, eye movements, and vision , 2010, i-Perception.

[28]  Laurent Itti,et al.  The role of memory in guiding attention during natural vision. , 2006, Journal of vision.

[29]  Philippe G Schyns,et al.  Accurate statistical tests for smooth classification images. , 2005, Journal of vision.

[30]  R. Caldara,et al.  Culture Shapes Eye Movements for Visually Homogeneous Objects , 2010, Front. Psychology.

[31]  Marcus Nyström,et al.  A vector-based, multidimensional scanpath similarity measure , 2010, ETRA.

[32]  R. Caldara,et al.  Investigating cultural diversity for extrafoveal information use in visual scenes. , 2010, Journal of vision.

[33]  Marina Bloj,et al.  Real and predicted influence of image manipulations on eye movements during scene recognition. , 2010, Journal of vision.

[34]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[35]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[36]  Jan Theeuwes,et al.  ScanMatch: A novel method for comparing fixation sequences , 2010, Behavior research methods.

[37]  Rachael E. Jack,et al.  Culture Shapes How We Look at Faces , 2008, PloS one.

[38]  R. Adler.  The Geometry of Random Fields , 2009 .

[39]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[40]  L. Zhaoping.  Attention capture by eye of origin singletons even without awareness--a hallmark of a bottom-up saliency map in the primary visual cortex. , 2008, Journal of vision.

[41]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[42]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[43]  Klaus Kessler,et al.  How checking breeds doubt: reduced performance in a simple working memory task. , 2009, Behaviour research and therapy.

[44]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[45]  C. Kennard,et al.  The role of visual salience in directing eye movements in visual object agnosia , 2009, Current Biology.

[46]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[47]  Janet Hui-wen Hsiao,et al.  NIMBLE: a kernel density model of saccade-based visual memory. , 2008, Journal of vision.

[48]  Miki Namatame,et al.  Eye Gaze during Observation of Static Faces in Deaf People , 2011, PloS one.

[49]  M. Seghier,et al.  A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. , 2003, Brain : a journal of neurology.

[50]  Bruno Rossion,et al.  The fusiform face area is tuned for curvilinear patterns with more high-contrasted elements in the upper part , 2006, NeuroImage.

[51]  P. Schyns,et al.  Local Jekyll and Global Hyde : The Dual Identity of Face Identification , 2011 .

[52]  Jason J S Barton,et al.  Information Processing during Face Recognition: The Effects of Familiarity, Inversion, and Morphing on Scanning Fixations , 2006, Perception.

[53]  Rachael E. Jack,et al.  Cultural Confusions Show that Facial Expressions Are Not Universal , 2009, Current Biology.

[54]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[55]  M. Lamare.  Des mouvements des yeux dans la lecture , 1892 .

[56]  Carrick C. Williams,et al.  Eye movements are functional during face learning , 2005, Memory & cognition.

[57]  C. Lappe.  Eye movements: A window on mind and brain , 2008 .

[58]  R. C. Langford.  How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[59]  Eli Brenner,et al.  Reliable Identification by Color under Natural Conditions the Locations Baseline Measurement , 2022 .

[60]  R. Goebel,et al.  Cerebral Cortex doi:10.1093/cercor/bhj005 Impaired Face Discrimination in Acquired Prosopagnosia Is Associated with Abnormal Response to Individual Faces in the Right Middle Fusiform Gyrus , 2005 .

[61]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[62]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[63]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[64]  K. Munhall,et al.  Spatial statistics of gaze fixations during dynamic face processing , 2007, Social neuroscience.

[65]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[66]  John Ashburner.  Preparing fMRI Data for Statistical Analysis , 2009 .

[67]  Andreas Schulze-Bonhage,et al.  A Rapid Sound-Action Association Effect in Human Insular Cortex , 2007 .

[68]  R. Adler,et al.  The Geometry of Random Fields , 1982 .