Robust clustering of eye movement recordings for quantification of visual interest

Characterizing the location and extent of a viewer's interest, in terms of eye movement recordings, informs a range of investigations in image and scene viewing. We present an automatic data-driven method for accomplishing this, which clusters visual point-of-regard (POR) measurements into gazes and regions-of-interest using the mean shift procedure. Clusters produced using this method form a structured representation of viewer interest, and at the same time are replicable and not heavily influenced by noise or outliers. Thus, they are useful in answering fine-grained questions about where and how a viewer examined an image.

[1]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[2]  K. Turano,et al.  Oculomotor strategies for the direction of gaze tested with a real-world activity , 2003, Vision Research.

[3]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[4]  Elizabeth A. Krupinski,et al.  Recording and analyzing eye-position data using a microcomputer workstation , 1992 .

[5]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[6]  Leonard F. M. Scinto,et al.  An algorithm for determining clusters, pairs or singletons in eye-movement scan-path records , 1986 .

[7]  Wilson S. Geisler,et al.  Focusing on the essential , 2003, Commun. ACM.

[8]  C. Latimer,et al.  Eye-movement data: Cumulative fixation time and cluster analysis , 1988 .

[9]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[10]  Christopher M. Harris,et al.  The distribution of fixation durations in infants and naive adults , 1988, Vision Research.

[11]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[12]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[13]  A. Inhoff,et al.  Chapter 2 – Definition and Computation of Oculomotor Measures in the Study of Cognitive Processes , 1998 .

[14]  D. S. Wooding,et al.  Fixation maps: quantifying eye-movement traces , 2002, ETRA.

[15]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  H. Widdel.  Operational Problems in Analysing Eye Movements , 1984 .

[17]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[18]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[19]  Claudio M. Privitera,et al.  Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[21]  Claudia Mello-Thoms,et al.  What attracts the eye to the location of missed and reported breast cancers? , 2002, ETRA.

[22]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[23]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .