Modeling the Visual Search of Displays : A Revised ACT-R / PM Model of Icon Search Based on Eye-Tracking and Experimental Data

As computer use becomes more visual in nature, researchers and designers of computer systems would like to gain some insight into the visual search strategies of computer users and the characteristics of displays that encourage the most efficient of these strategies. Icons, which are becoming increasingly prevalent, serve as the focus for a set of studies on the interaction of human vision with computer displays. Previous work (Fleetwood & Byrne, 2002) presented a study of “icon search” and a set of computational models of the task in the ACT-R/PM architecture. Presented here are an eye tracking study, conducted to examine the search strategies of users, and a revised model based on the results of the eye tracking study. The revised model incorporates EMMA (Salvucci, 2001) and changes in search strategy. Findings indicate key environmental influences of icon search (particularly set size and icon quality), evaluate the vision module in the underlying cognitive architecture, and provide some illumination on the strategies of users.

[1]  J. D. Gould,et al.  Eye-movement parameters and pattern discrimination , 1969 .

[2]  J. Findlay Global visual processing for saccadic eye movements , 1982, Vision Research.

[3]  L. G. Williams,et al.  The effect of target specification on objects fixated during visual search , 1966 .

[4]  K. Rayner Eye Movements and Cognitive Processes in Reading, Visual Search, and Scene Perception , 1995 .

[5]  Dario D. Salvucci An integrated model of eye movements and visual encoding , 2001, Cognitive Systems Research.

[6]  Michael D. Byrne,et al.  Modeling icon search in ACT-R/PM , 2002, Cognitive Systems Research.

[7]  L. G. Williams The effect of target specification on objects fixated during visual search , 1966 .

[8]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[9]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[10]  Brian D. Ehret,et al.  Learning where to look: location learning in graphical user interfaces , 2002, CHI.

[11]  David L. Sheinberg,et al.  Eye movements during parallel-serial visual search. , 1997, Journal of experimental psychology. Human perception and performance.

[12]  John R. Anderson,et al.  ACT-R: A Theory of Higher Level Cognition and Its Relation to Visual Attention , 1997, Hum. Comput. Interact..

[13]  Ahmet Çakir,et al.  Visual Display Terminals: A Manual Covering Ergonomics, WorkPlace Design, Health and Safety, Task Organization , 1980 .

[14]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[15]  J. Henderson Visual Attention and Eye Movement Control During Reading and Picture Viewing , 1992 .