Supporting aspect-based video browsing: analysis of a user study

In this paper, we present a novel video search interface based on the concept of aspect browsing. The proposed strategy is to assist the user in exploratory video search by actively suggesting new query terms and video shots. Our approach has the potential to narrow the "Semantic Gap" issue by allowing users to explore the data collection. First, we describe a clustering technique to identify potential aspects of a search. Then, we use the results to propose suggestions to the user to help them in their search task. Finally, we analyse this approach by exploiting the log files and the feedbacks of a user study.

[1]  Andrew M. Webb,et al.  Promoting emergence in information discovery by representing collections with composition , 2007, C&C '07.

[2]  Stephen E. Robertson,et al.  Okapi at TREC-3 , 1994, TREC.

[3]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[4]  Diane Kelly,et al.  Contextual relevance feedback , 2006, IIiX.

[5]  Stephen E. Robertson,et al.  GatfordCentre for Interactive Systems ResearchDepartment of Information , 1996 .

[6]  Iadh Ounis,et al.  Research directions in Terrier: a search engine for advanced retrieval on the Web , 2007 .

[7]  Christian Petersohn.  Fraunhofer HHI at TRECVID 2004: Shot Boundary Detection System , 2004, TRECVID.

[8]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[9]  Ian Ruthven,et al.  Searcher's Assessments of Task Complexity for Web Searching , 2004, ECIR.

[10]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[11]  C. J. van Rijsbergen,et al.  Report on the need for and provision of an 'ideal' information retrieval test collection , 1975 .

[12]  Alan F. Smeaton,et al.  Using score distributions for query-time fusion in multimediaretrieval , 2006, MIR '06.

[13]  Joemon M. Jose,et al.  Fetch: A Personalised Information Retrieval Tool , 2004, RIAO.

[14]  Chabane Djeraba,et al.  An efficient indexing structure for multimedia data , 2008, MIR '08.

[15]  Noel E. O'Connor,et al.  The acetoolbox: low-level audiovisual feature extraction for retrieval and classification , 2005 .

[16]  Robert Villa,et al.  FacetBrowser: a user interface for complex search tasks , 2008, ACM Multimedia.

[17]  Rong Yan,et al.  Co-retrieval: A Boosted Reranking Approach for Video Retrieval , 2004, CIVR.

[18]  Thierry Urruty,et al.  Facet-Based Browsing in Video Retrieval: A Simulation-Based Evaluation , 2009, MMM.

[19]  Paul Over,et al.  TREC-7 Interactive Track Report , 1998, TREC.

[20]  Franciska de Jong,et al.  Annotation of Heterogeneous Multimedia Content Using Automatic Speech Recognition , 2007, SAMT.