Perceptual Image Retrieval Using Eye Movements

This paper explores the feasibility of using an eye tracker as an image retrieval interface. A database of image similarity values between 1000 Corel images is used in the study. Results from participants performing image search tasks show that eye tracking data can be used to reach target images in fewer steps than by random selection. The effects of the intrinsic difficulty of finding images and the time allowed for successive selections were also investigated.

[1]  David J. Ward,et al.  Fast Hands-free Writing by Gaze Direction , 2002, ArXiv.

[2]  John Paulin Hansen,et al.  Eye-gaze control of multimedia systems , 1995 .

[3]  Samuel Kaski,et al.  Combining eye movements and collaborative filtering for proactive information retrieval , 2005, SIGIR '05.

[4]  Yoshinori Kuno,et al.  Speed Browser controlled by eye movements , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[5]  Fred Stentiford,et al.  An eye tracking interface for image search , 2006, ETRA.

[6]  Fred Stentiford,et al.  A performance comparison of eye tracking and mouse interfaces in a target image identification task , 2005 .

[7]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .

[8]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[9]  Fred Stentiford,et al.  Exploring human eye behaviour using a model of visual attention , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[10]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[11]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[12]  Colin C. Venters,et al.  The user interface & content-based image retrieval systems , 1997 .

[13]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[14]  Jens Riegelsberger,et al.  Could I have the Menu Please? An Eye Tracking Study of Design Conventions , 2004 .

[15]  Eric J. Pauwels.  Multimedia Understanding through Semantics, Computation and Learning , 2005 .

[16]  Colin C. Venters,et al.  The User Interface and Content-Based Image Retrieval Systems , 1997, BCS-IRSG Annual Colloquium on IR Research.

[17]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[18]  Paul M. Fitts,et al.  Eye movements of aircraft pilots during instrument-landing approaches. , 1950 .

[19]  David J. Ward,et al.  Artificial intelligence: Fast hands-free writing by gaze direction , 2002, Nature.

[20]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[21]  Fred Stentiford,et al.  Attention-based similarity , 2007, Pattern Recognit..

[22]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[23]  Eric J. Pauwels.  A Short Introduction to FP6 Network of Excellence Muscle: Multimedia Understanding through Semantics, Computation and Learning , 2004, EWIMT.

[24]  Laura Farinetti,et al.  A cost-effective solution for eye-gaze assistive technology , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[25]  Jana Urban,et al.  AN ADAPTIVE APPROACH TOWARDS CONTENT-BASED IMAGE RETRIEVAL , 2003 .