Assessing Media Relevance via Eye Tracking

To ease the problem of data overloading, it is crucial to understand the user behavior when s/he interacts with online contents, or more specifically, a web page containing several entries for further exploration. We devise to estimate the relevance of an entry to the user goal by observing eye movements as implicit feedback. Specifically, this study proposes a framework that assumes eye movement measures can be used to infer a user¡¦s cognition. A rating task was conducted in which subjects were required to judge whether an image was relevant to a word. Results showed that the total fixation duration and the fixation count can be used to discriminate between the relevant and irrelevant conditions, in contrast, the first fixation duration cannot. In addition, the subjective rating and relevancy manipulation interacted on the total fixation duration. Converging evidence verifies the assumption we have proposed.

[1]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[2]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[3]  Amanda Spink,et al.  Determining the informational, navigational, and transactional intent of Web queries , 2008, Inf. Process. Manag..

[4]  Eyal M Reingold,et al.  Stimulus exposure and gaze bias: A further test of the gaze cascade model , 2009, Attention, perception & psychophysics.

[5]  Jaime Teevan,et al.  Visual snippets: summarizing web pages for search and revisitation , 2009, CHI.

[6]  Norman A. Krasnegor,et al.  Measurement of Audition and Vision in the First Year of Postnatal Life: A Methodological Overview , 1985 .

[7]  Eyal M. Reingold,et al.  The time course of gaze bias in visual decision tasks , 2009 .

[8]  Allison Woodruff,et al.  Using thumbnails to search the Web , 2001, CHI.

[9]  A. Kaplan,et al.  Users of the world, unite! The challenges and opportunities of Social Media , 2010 .

[10]  Patrick Baudisch,et al.  Summary thumbnails: readable overviews for small screen web browsers , 2005, CHI.

[11]  Fred Stentiford,et al.  Perceptual Image Retrieval Using Eye Movements , 2006, IWICPAS.

[12]  Ronald A. Rensink,et al.  Picture Changes During Blinks: Looking Without Seeing and Seeing Without Looking , 2000 .

[13]  Xing Xie,et al.  Efficient browsing of Web search results on mobile devices based on block importance model , 2005, Third IEEE International Conference on Pervasive Computing and Communications.

[14]  Claus Bahlmann,et al.  In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision , 2010, Proceedings of the IEEE.

[15]  Andreas Dengel,et al.  Eye movements as implicit relevance feedback , 2008, CHI Extended Abstracts.

[16]  Allison Woodruff,et al.  Popout prism: adding perceptual principles to overview+detail document interfaces , 2002, CHI.

[17]  Samuel Kaski,et al.  Implicit Relevance Feedback from Eye Movements , 2005, ICANN.

[18]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[19]  Geoffrey M. Underwood,et al.  Cognitive Processes in Eye Guidance: Algorithms for Attention in Image Processing , 2009, Cognitive Computation.

[20]  S. Shimojo,et al.  Gaze bias both reflects and influences preference , 2003, Nature Neuroscience.

[21]  Scott Counts,et al.  Your Brain on Facebook: Neuropsychological Associations with Social Versus other Media , 2010, ICWSM.

[22]  Andrew Hollingworth,et al.  Eye Movements, Visual Memory, and Scene Representation , 2000 .

[23]  O. Mimura [Eye movements]. , 1992, Nippon Ganka Gakkai zasshi.