Highly Informative Natural Scene Regions Increase Microsaccade Production during Visual Scanning

Classical image statistics, such as contrast, entropy, and the correlation between central and nearby pixel intensities, are thought to guide ocular fixation targeting. However, these statistics are not necessarily task relevant and therefore do not provide a complete picture of the relationship between informativeness and ocular targeting. Moreover, it is not known whether either informativeness or classical image statistics affect microsaccade production; thus, the role of microsaccades in information acquisition is also unknown. The objective quantification of the informativeness of a scene region is a major challenge, because it can vary with both image features and the task of the viewer. Thus, previous definitions of informativeness suffered from subjectivity and inconsistency across studies. Here we developed an objective measure of informativeness based on fixation consistency across human observers, which accounts for both bottom-up and top-down influences in ocular targeting. We then analyzed fixations in more versus less informative image regions in relation to classical statistics. Observers generated more microsaccades on more informative than less informative image regions, and such regions also exhibited low redundancy in their classical statistics. Increased microsaccade production was not explained by increased fixation duration, suggesting that the visual system specifically uses microsaccades to heighten information acquisition from informative regions.

[1]  T. Cornsweet Determination of the stimuli for involuntary drifts and saccadic eye movements. , 1956, Journal of the Optical Society of America.

[2]  J. Nachmias Determiners of the drift of the eye during monocular fixation. , 1961, Journal of the Optical Society of America.

[3]  P. Boyce Monocular fixation in human eye movement , 1967, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .

[5]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[6]  A. L. Yarbus,et al.  Eye Movements During Fixation on Stationary Objects , 1967 .

[7]  D. Fender,et al.  The interplay of drifts and flicks in binocular fixation. , 1969, Vision research.

[8]  R. Steinman,et al.  The smallest voluntary saccade: implications for fixation. , 1973, Vision research.

[9]  J. Antes The time course of picture viewing. , 1974, Journal of experimental psychology.

[10]  I. Biederman,et al.  On the information extracted from a glance at a scene. , 1974, Journal of experimental psychology.

[11]  D. Navon Forest before trees: The precedence of global features in visual perception , 1977, Cognitive Psychology.

[12]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  R. Leigh,et al.  The neurology of eye movements , 1984 .

[15]  P. de Graef,et al.  Perceptual effects of scene context on object identification , 1990, Psychological research.

[16]  D. Ruderman The statistics of natural images , 1994 .

[17]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[18]  R. Baddeley,et al.  Searching for filters with 'interesting' output distributions: an uninteresting direction to explore? , 1996, Network.

[19]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[20]  P Reinagel,et al.  Natural scene statistics at the centre of gaze. , 1999, Network.

[21]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[22]  G. Hauske,et al.  Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics. , 2000, Spatial vision.

[23]  F. Møller,et al.  Binocular quantification and characterization of microsaccades , 2002, Graefe’s Archive for Clinical and Experimental Ophthalmology.

[24]  David S Wooding,et al.  Eye movements of large populations: II. Deriving regions of interest, coverage, and similarity using fixation maps , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[25]  D. S. Wooding,et al.  Fixation maps: quantifying eye-movement traces , 2002, ETRA.

[26]  David S Wooding,et al.  Eye movements of large populations: I. Implementation and performance of an autonomous public eye tracker , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[27]  M. Potter,et al.  Recognition memory for briefly presented pictures: the time course of rapid forgetting. , 2002, Journal of experimental psychology. Human perception and performance.

[28]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[29]  Derrick J. Parkhurst,et al.  Scene content selected by active vision. , 2003, Spatial vision.

[30]  D. Robinson,et al.  Motion of the eye immediately after a saccade , 2004, Experimental Brain Research.

[31]  Ralf Engbert,et al.  Microsaccades Keep the Eyes' Balance During Fixation , 2004, Psychological science.

[32]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[33]  Michele Rucci,et al.  Fixational instability and natural image statistics: Implications for early visual representations , 2005, Network.

[34]  M. Young,et al.  Longer fixation duration while viewing face images , 2006, Experimental Brain Research.

[35]  David Williams,et al.  The locus of fixation and the foveal cone mosaic. , 2005, Journal of vision.

[36]  B. Velichkovsky,et al.  Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration , 2005 .

[37]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[38]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Antonino Casile,et al.  A Theoretical Analysis of the Influence of Fixational Instability on the Development of Thalamocortical Connectivity , 2006, Neural Computation.

[40]  Xoana G. Troncoso,et al.  Microsaccades Counteract Visual Fading during Fixation , 2005, Neuron.

[41]  Martina Poletti,et al.  Miniature eye movements enhance fine spatial detail , 2007, Nature.

[42]  K. Donner,et al.  Modelling the effect of microsaccades on retinal responses to stationary contrast patterns , 2007, Vision Research.

[43]  M. Landy,et al.  The effect of viewpoint on perceived visual roughness. , 2007, Journal of vision.

[44]  P. Perona,et al.  What do we perceive in a glance of a real-world scene? , 2007, Journal of vision.

[45]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[46]  J. Henderson,et al.  Initial scene representations facilitate eye movement guidance in visual search. , 2007, Journal of experimental psychology. Human perception and performance.

[47]  Benjamin W. Tatler,et al.  Systematic tendencies in scene viewing , 2008 .

[48]  Stephen L Macknik,et al.  Microsaccades counteract perceptual filling-in. , 2008, Journal of vision.

[49]  Ralf Engbert,et al.  Toward a model of microsaccade generation: the case of microsaccadic inhibition. , 2008, Journal of vision.

[50]  Xoana G. Troncoso,et al.  Saccades and microsaccades during visual fixation, exploration, and search: foundations for a common saccadic generator. , 2008, Journal of vision.

[51]  J. Helmert,et al.  Visual Fixation Durations and Saccade Amplitudes: Shifting Relationship in a Variety of Conditions , 2008 .

[52]  You Yun Lee,et al.  Quantitative assessment of divergence eye movements. , 2008, Journal of vision.

[53]  J. Hegdé Time course of visual perception: Coarse-to-fine processing and beyond , 2008, Progress in Neurobiology.

[54]  George L. Malcolm,et al.  Eye Movements and Visual Encoding During Scene Perception , 2009, Psychological science.

[55]  M. Rolfs Microsaccades: Small steps on a long way , 2009, Vision Research.

[56]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[57]  Xoana G. Troncoso,et al.  Microsaccades: a neurophysiological analysis , 2009, Trends in Neurosciences.

[58]  J. Henderson,et al.  How are eye fixation durations controlled during scene viewing? Further evidence from a scene onset delay paradigm , 2009 .

[59]  Donna J Bridge,et al.  Can race enhance perceptual awareness? Evidence from the attentional blink paradigm , 2010 .

[60]  Jan-Mark Geusebroek,et al.  An Image Statistics–Based Model for Fixation Prediction , 2010, Cognitive Computation.

[61]  M. Rucci,et al.  Microsaccades Precisely Relocate Gaze in a High Visual Acuity Task , 2010, Nature Neuroscience.

[62]  N. Kanwisher,et al.  The FFA shows a face inversion effect that is correlated with the behavioral face inversion effect , 2010 .

[63]  R. Leigh,et al.  Triggering mechanisms in microsaccade and saccade generation: a novel proposal , 2011, Annals of the New York Academy of Sciences.

[64]  Ralf Engbert,et al.  An integrated model of fixational eye movements and microsaccades , 2011, Proceedings of the National Academy of Sciences.

[65]  Xoana G. Troncoso,et al.  Distinctive Features of Saccadic Intrusions and Microsaccades in Progressive Supranuclear Palsy , 2011, The Journal of Neuroscience.

[66]  J. Victor,et al.  Temporal Encoding of Spatial Information during Active Visual Fixation , 2012, Current Biology.

[67]  Xoana G. Troncoso,et al.  Microsaccadic Efficacy and Contribution to Foveal and Peripheral Vision , 2012, The Journal of Neuroscience.

[68]  C. Koch,et al.  Evidence for two distinct mechanisms directing gaze in natural scenes. , 2012, Journal of vision.

[69]  Ziad M. Hafed,et al.  On the Dissociation between Microsaccade Rate and Direction after Peripheral Cues: Microsaccadic Inhibition Revisited , 2013, The Journal of Neuroscience.

[70]  B. Velichkovsky,et al.  Attentional dynamics during free picture viewing: Evidence from oculomotor behavior and electrocortical activity , 2013, Front. Syst. Neurosci..

[71]  S. Martinez-Conde,et al.  An oculomotor continuum from exploration to fixation , 2013, Proceedings of the National Academy of Sciences.

[72]  Davis Coakley,et al.  Simultaneous recordings of ocular microtremor and microsaccades with a piezoelectric sensor and a video-oculography system , 2013, PeerJ.

[73]  Michael B. McCamy,et al.  Microsaccade and drift dynamics reflect mental fatigue , 2013, The European journal of neuroscience.

[74]  Antje Nuthmann,et al.  Eye movement control during scene viewing: immediate effects of scene luminance on fixation durations. , 2013, Journal of experimental psychology. Human perception and performance.

[75]  S. Martinez-Conde,et al.  The impact of microsaccades on vision: towards a unified theory of saccadic function , 2013, Nature Reviews Neuroscience.

[76]  Michael B. McCamy,et al.  The effects of fixation target size and luminance on microsaccades and square-wave jerks , 2013, PeerJ.

[77]  Leandro L. Di Stasi,et al.  Microsaccades scan highly informative image areas , 2014 .