Enabling Effective User Interactions in Content-Based Image Retrieval

This paper presents an interactive content-based image retrieval framework--uInteract, for delivering a novel four-factor user interaction model visually. The four-factor user interaction model is an interactive relevance feedback mechanism that we proposed, aiming to improve the interaction between users and the CBIR system and in turn users overall search experience. In this paper, we present how the framework is developed to deliver the four-factor user interaction model, and how the visual interface is designed to support user interaction activities. From our preliminary user evaluation result on the ease of use and usefulness of the proposed framework, we have learnt what the users like about the framework and the aspects we could improve in future studies. Whilst the framework is developed for our research purposes, we believe the functionalities could be adapted to any content-based image search framework.

[1]  Ryen W. White,et al.  A study of interface support mechanisms for interactive information retrieval , 2006 .

[2]  Daniel Heesch,et al.  Performance boosting with three mouse clicks - Relevance feedback for CBIR , 2003 .

[3]  C. J. van Rijsbergen,et al.  Incorporating user search behavior into relevance feedback , 2003, J. Assoc. Inf. Sci. Technol..

[4]  Hermann Ney,et al.  FIRE - Flexible Image Retrieval Engine: ImageCLEF 2004 Evaluation , 2004, CLEF.

[5]  Amanda Spink,et al.  From Highly Relevant to Not Relevant: Examining Different Regions of Relevance , 1998, Inf. Process. Manag..

[6]  Thierry Pun,et al.  Strategies for positive and negative relevance feedback in image retrieval , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[7]  SpinkAmanda,et al.  From highly relevant to not relevant , 1998 .

[8]  Marcia J. Bates,et al.  Where should the person stop and the information search interface start? , 1990, Inf. Process. Manag..

[9]  Jana Urban,et al.  EGO: A personalized multimedia management and retrieval tool: Research Articles , 2006 .

[10]  Joemon M. Jose,et al.  EGO: A personalized multimedia management and retrieval tool , 2006, Int. J. Intell. Syst..

[11]  Iain Campbell,et al.  Interactive Evaluation of the Ostensive Model Using a New Test Collection of Images with Multiple Relevance Assessments , 2000, Information Retrieval.

[12]  Victoria S. Uren,et al.  A Four-Factor User Interaction Model for Content-Based Image Retrieval , 2009, ICTIR.

[13]  Frank Hopfgartner,et al.  Simulated Testing of an Adaptive Multimedia Information Retrieval System , 2007, 2007 International Workshop on Content-Based Multimedia Indexing.

[14]  Carol Peters,et al.  Multilingual Information Access for Text, Speech and Images, 5th Workshop of the Cross-Language Evaluation Forum, CLEF 2004, Bath, UK, September 15-17, 2004, Revised Selected Papers , 2005, CLEF.

[15]  Marcus Jerome Pickering,et al.  Evaluation of key frame-based retrieval techniques for video , 2003, Comput. Vis. Image Underst..

[16]  Joemon M. Jose,et al.  An adaptive technique for content-based image retrieval , 2006, Multimedia Tools and Applications.