Eye movement is a basic human behavior that offers a valuable means to explore human cognitive processes. This article introduces two modeling studies of eye movement. First, random menu search was modeled using a queueing network approach and second, a reinforcement learning algorithm was used to generate various eye movement patterns. Random menu search is a task component involved in many human-machine interfaces and has been modeled with several cognitive models including ACT-R and EPIC. Based upon review of empirical data in menu search, and strengths and limitations of existing models, this article proposes a queueing network model, which has been successfully applied in some other task domains (e.g., response time, driver performance). The queueing network model for random menu search was implemented and evaluated through model simulation. In contrast to existing models that rely on four task-specific strategies to account for data, the queueing network model accounted for the same data using only one strategy already employed in cognitive modeling. To extend this parsimonious, “minimal task strategy” modeling approach, QLearning, one of the reinforcement learning methods, was adopted to generate different patterns in eye movement. The same strategy from random menu search was used to generate eye movement, and the simulated eye movements were qualitatively compared to the human eye movement.
[1]
Anthony J. Hornof,et al.
Cognitive strategies and eye movements for searching hierarchical computer displays
,
2003,
CHI '03.
[2]
Yili Liu,et al.
Queueing network modeling of human performance of concurrent spatial and verbal tasks
,
1994,
IEEE Trans. Syst. Man Cybern. Part A.
[3]
John R. Anderson,et al.
ACT-R: A Theory of Higher Level Cognition and Its Relation to Visual Attention
,
1997,
Hum. Comput. Interact..
[4]
Yili Liu,et al.
Modeling Steering Using the Queueing Network — Model Human Processor (QN-MHP)
,
2003
.
[5]
Erik Nilsen,et al.
PERCEPTUAL-MOTOR CONTROL IN HUMAN-COMPUTER INTERACTION
,
1991,
SGCH.
[6]
A. L. Yarbus.
Eye Movements During Perception of Complex Objects
,
1967
.
[7]
Dana H. Ballard,et al.
Eye Movements for Reward Maximization
,
2003,
NIPS.
[8]
Michael D. Byrne,et al.
ACT-R/PM and menu selection: applying a cognitive architecture to HCI
,
2001,
Int. J. Hum. Comput. Stud..
[9]
Y Liu,et al.
Queueing network modeling of elementary mental processes.
,
1996,
Psychological review.
[10]
Anthony J. Hornof,et al.
Computational models of the perceptual, cognitive, and motor processes involved in the visual search of pull -down menus and computer screens
,
1999
.
[11]
John R. Anderson,et al.
Eye tracking the visual search of click-down menus
,
1999,
CHI '99.