The relationship between scene and eye movements

Individual differences make it difficult to recognize similarities between individuals in eye movement patterns. However, if consistencies can be found, eye movements could be used for a variety of purposes. In this study, the consistency of eye fixation patterns is explored using statistical evaluation as well as neural networks. Eye tracking data is used as input units into neural networks to test whether they can learn to associate task patterns with that task data. A network is successfully used to determine whether a participant was searching text on the screen or counting groups of arrows from eye fixation information. Another network is trained to determine whether the participant was counting a group of 1-3 arrows or 4-6 arrows, as would be expected according to the tendency to "subitize," or recognize small numbers of objects without counting each of them. The implications of the findings are discussed.

[1]  P. Viviani Eye movements in visual search: cognitive, perceptual and motor control aspects. , 1990, Reviews of oculomotor research.

[2]  E. L. Kaufman,et al.  The discrimination of visual number. , 1949, The American journal of psychology.

[3]  Hans-Jürgen Zimmermann,et al.  A neural network and fuzzy rule base hybrid for pattern classification , 2001, Soft Comput..

[4]  K. Rayner,et al.  Comparing naming, lexical decision, and eye fixation times: Word frequency effects and individual differences , 1998, Memory & cognition.

[5]  Joseph P. Bigus,et al.  Data mining with neural networks , 1996 .

[6]  Amar Mitiche,et al.  Pattern classification by a condensed neural network , 2001, Neural Networks.

[7]  John R. Anderson,et al.  Mapping eye movements to cognitive processes , 1999 .

[8]  G. David Garson,et al.  Interpreting neural-network connection weights , 1991 .

[9]  M. Hegarty,et al.  Individual differences in mental animation during mechanical reasoning , 1994, Memory & cognition.

[10]  Tony J. Simon,et al.  Computational evidence for the subitizing phenomenon as an emergent property of the human cognitive architecture , 2000, Cogn. Sci..

[11]  Amit Konar,et al.  Artificial Intelligence and Soft Computing: Behavioral and Cognitive Modeling of the Human Brain , 1999 .

[12]  Miroslav Kubat,et al.  Designing neural network architectures for pattern recognition , 2000, The Knowledge Engineering Review.

[13]  Henk Sol,et al.  Proceedings of the 54th Hawaii International Conference on System Sciences , 1997, HICSS 2015.

[14]  Theodore E. Parks,et al.  Looking at looking : an introduction to the intelligence of vision , 2001 .

[15]  Daniel Kersten,et al.  Introduction to neural networks , 1993 .

[16]  M. Lynn Hawaii International Conference on System Sciences , 1996 .

[17]  R Rothkegel,et al.  Subitizing and its subprocesses , 2000, Psychological research.

[18]  Joseph P. Bigus,et al.  Data mining with neural networks: solving business problems from application development to decision support , 1996 .

[19]  John B. Carroll Human cognitive abilities: Abilities in the Domain of Visual Perception , 1993 .

[20]  Christopher D. Wickens,et al.  Proximity Compatibility and Information Display: Effects of Color, Space, and Objectness on Information Integration , 1990 .

[21]  Masayuki Kikuchi,et al.  Invariant pattern recognition with eye movement: A neural network model , 2001, Neurocomputing.