ViGOR: a grouping oriented interface for search and retrieval in video libraries

In this paper, we present ViGOR (Video Grouping, Organisation and Retrieval) a video retrieval system that allows users to group videos in order to facilitate video retrieval tasks. In this way users are able to visualise and conceptualise many aspects of their search tasks and carry out a localised search in order to solve a more global search problem. The main objective of this work is to aid users while carrying out explorative video retrieval tasks; these tasks can be often ambiguous and multi-faceted. Two user evaluations were carried out in order to evaluate the usefulness of this grouping paradigm for assisting users. The first evaluation involved users carrying out broad tasks on YouTube, and gave insights into the application of our interface to a vast online video collection. The second evaluation involved users carrying out focused tasks on the TRECVID 2007 video collection, allowing a comparison over a local collection, on which we could extract a number of content-based features. The results of our evaluations show that the use of the ViGOR system results in an increase in user performance and user satisfaction, showing the potential of a grouping paradigm for video search for various tasks in a variety of diverse video collections.

[1]  Adam M. Fass,et al.  PicturePiper: using a re-configurable pipeline to find images on the Web , 2000, UIST '00.

[2]  Kalervo Järvelin,et al.  Task complexity affects information seeking and use , 1995 .

[3]  Alexander G. Hauptmann,et al.  Successful approaches in the TREC video retrieval evaluations , 2004, MULTIMEDIA '04.

[4]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[5]  Robert Villa,et al.  A faceted interface for multimedia search , 2008, SIGIR '08.

[6]  Martin Halvey,et al.  Analysis of online video search and sharing , 2007, HT '07.

[7]  Manuel Blum,et al.  reCAPTCHA: Human-Based Character Recognition via Web Security Measures , 2008, Science.

[8]  Marcel Worring,et al.  Learned Lexicon-Driven Interactive Video Retrieval , 2006, CIVR.

[9]  Nick Craswell,et al.  Random walks on the click graph , 2007, SIGIR.

[10]  Wei-Ying Ma,et al.  Multimedia information retrieval: what is it, and why isn't anyone using it? , 2005, MIR '05.

[11]  Iain Campbell,et al.  Interactive Evaluation of the Ostensive Model Using a New Test Collection of Images with Multiple Relevance Assessments , 2000, Information Retrieval.

[12]  Jana Urban,et al.  EGO: A Personalised Multimedia Management Tool , 2004 .

[13]  Marcel Worring,et al.  MediaMill: fast and effective video search using the forkbrowser , 2008, CIVR '08.

[14]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Rong Yan,et al.  Extreme video retrieval: joint maximization of human and computer performance , 2006, MM '06.

[16]  Jana Urban,et al.  EGO: A personalized multimedia management and retrieval tool: Research Articles , 2006 .

[17]  Michael G. Christel Establishing the utility of non-text search for news video retrieval with real world users , 2007, ACM Multimedia.

[18]  Michael G. Christel,et al.  Mining Novice User Activity with TRECVID Interactive Retrieval Tasks , 2006, CIVR.

[19]  Desney S. Tan,et al.  CueFlik: interactive concept learning in image search , 2008, CHI.

[20]  Munehiro Nakazato,et al.  ImageGrouper: a group-oriented user interface for content-based image retrieval and digital image arrangement , 2003, J. Vis. Lang. Comput..

[21]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[22]  Martin Halvey,et al.  Search trails using user feedback to improve video search , 2008, ACM Multimedia.

[23]  Marieke Guy,et al.  Folksonomies: Tidying Up Tags? , 2006, D Lib Mag..