An Information Maximization Model of Eye Movements

We propose a sequential information maximization model as a general strategy for programming eye movements. The model reconstructs high-resolution visual information from a sequence of fixations, taking into account the fall-off in resolution from the fovea to the periphery. From this framework we get a simple rule for predicting fixation sequences: after each fixation, fixate next at the location that minimizes uncertainty (maximizes information) about the stimulus. By comparing our model performance to human eye movement data and to predictions from a saliency and random model, we demonstrate that our model is best at predicting fixation locations. Modeling additional biological constraints will improve the prediction of fixation sequences. Our results suggest that information maximization is a useful principle for programming eye movements.

[1]  Nancy Millette,et al.  How People Look at Pictures , 1935 .

[2]  M. Tinker.  How People Look at Pictures. , 1936 .

[3]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[4]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[5]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[6]  L. Stark,et al.  Most naturally occurring human saccades have magnitudes of 15 degrees or less. , 1975, Investigative ophthalmology.

[7]  S. Klein,et al.  Vernier acuity, crowding and cortical magnification , 1985, Vision Research.

[8]  D. Burr,et al.  Selective suppression of the magnocellular visual pathway during saccadic eye movements , 1994, Nature.

[9]  Donald Geman,et al.  An Active Testing Model for Tracking Roads in Satellite Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[11]  Tai Sing Lee,et al.  An Information-Theoretic Framework for Understanding Saccadic Eye Movements , 1999, NIPS.

[12]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[13]  Robert M. McPeek,et al.  Concurrent processing of saccades in visual search , 2000, Vision Research.

[14]  H. Nothdurft.  Attention shifts to salient targets , 2002, Vision Research.

[15]  G. Legge,et al.  Mr. Chips 2002: new insights from an ideal-observer model of reading , 2002, Vision Research.

[16]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[17]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[18]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[19]  Jitendra Malik,et al.  Sequential information maximization can explain eye movements in an object learning task , 2004 .

[20]  Miguel P Eckstein,et al.  The time course of visual information accrual guiding eye movement decisions. , 2004, Proceedings of the National Academy of Sciences of the United States of America.