Prediction of relevance of an image from a scan pattern

This report considers the task of inferring implicit relevance feedback from eye movements in image retrieval settings. The feasibility of solving the problem without using any image-level features is demonstrated on two different search settings, and the accuracy of inferring the relevance feedback is shown to be relatively high, clearly better than random. In addition, the report provides a list of image-level features that are good cues for relevance.

[1]  Riad I. Hammoud,et al.  Passive Eye Monitoring: Algorithms, Applications and Experiments , 2008 .

[2]  Samuel Kaski,et al.  Can Relevance be Inferred from Eye Movements in Information Retrieval , 2003 .

[3]  Fred Stentiford,et al.  Perceptual Image Retrieval Using Eye Movements , 2006, IWICPAS.

[4]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[5]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[6]  Bernhard Schölkopf,et al.  A Nonparametric Approach to Bottom-Up Visual Saliency , 2006, NIPS.

[7]  Samuel Kaski,et al.  Can relevance of images be inferred from eye movements? , 2008, MIR '08.

[8]  Kitsuchart Pasupa,et al.  A simple iterative algorithm for parsimonious binary kernel Fisher discrimination , 2010, Pattern Analysis and Applications.

[9]  Samuel Kaski,et al.  Inferring Relevance from Eye Movements: Feature Extraction , 2005 .

[10]  Andreas Dengel,et al.  Eye movements as implicit relevance feedback , 2008, CHI Extended Abstracts.

[11]  Samuel Kaski,et al.  Implicit Relevance Feedback from Eye Movements , 2005, ICANN.

[12]  Samuel Kaski,et al.  Learning to learn implicit queries from gaze patterns , 2008, ICML '08.

[13]  Samuel Kaski,et al.  Learning from Relevant Tasks Only , 2007, ECML.

[14]  John Shawe-Taylor,et al.  Information Retrieval by Inferring Implicit Queries from Eye Movements , 2007, AISTATS.

[15]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.