Supporting exploratory video retrieval tasks with grouping and recommendation

Combine grouping of video search results with recommendation techniques to assist video retrieval.Evaluate grouping and recommendation techniques in separate evaluations to assess impact.Different recommendation approaches are relevant to the users at different stages of their search.Organisational and recommendation functionalities can result in a significant improvement on the users' search performance. In this paper, we present ViGOR (Video Grouping, Organisation and Recommendation), an exploratory video retrieval system. Exploratory video retrieval tasks are hampered by the lack of semantics associated to video and the overwhelming amount of video items stored in these types of collections (e.g. YouTube, MSN video, etc.). In order to help facilitate these exploratory video search tasks we present a system that utilises two complementary approaches: the first a new search paradigm that allows the semantic grouping of videos and the second the exploitation of past usage history in order to provide video recommendations. We present two types of recommendation techniques adapted to the grouping search paradigm: the first is a global recommendation, which couples the multi-faceted nature of explorative video retrieval tasks with the current user need of information in order to provide recommendations, and second is a local recommendation, which exploits the organisational features of ViGOR in order to provide more localised recommendations based on a specific aspect of the user task. Two user evaluations were carried out in order to (1) validate the new search paradigm provided by ViGOR, characterised by the grouping functionalities and (2) evaluate the usefulness of the proposed recommendation approaches when integrated into ViGOR. The results of our evaluations show (1) that the grouping, organisational and recommendation functionalities can result in an improvement in the users' search performance without adversely impacting their perceptions of the system and (2) that both recommendation approaches are relevant to the users at different stages of their search, showing the importance of using multi-faceted recommendations for video retrieval systems and also illustrating the many uses of collaborative recommendations for exploratory video search tasks.

[1]  Martin Halvey,et al.  ViGOR: a grouping oriented interface for search and retrieval in video libraries , 2009, JCDL '09.

[2]  Michael G. Christel Establishing the utility of non-text search for news video retrieval with real world users , 2007, ACM Multimedia.

[3]  Steve Fox,et al.  Evaluating implicit measures to improve web search , 2005, TOIS.

[4]  Michael G. Christel,et al.  Mining Novice User Activity with TRECVID Interactive Retrieval Tasks , 2006, CIVR.

[5]  Ryen W. White,et al.  Assessing the scenic route: measuring the value of search trails in web logs , 2010, SIGIR.

[6]  David B. Leake,et al.  Real time user context modeling for information retrieval agents , 2001, CIKM '01.

[7]  Amanda Spink,et al.  From Highly Relevant to Not Relevant: Examining Different Regions of Relevance , 1998, Inf. Process. Manag..

[8]  Frank Hopfgartner,et al.  Effects of Usage-Based Feedback on Video Retrieval: A Simulation-Based Study , 2011, TOIS.

[9]  Ryen W. White,et al.  Studying trailfinding algorithms for enhanced web search , 2010, SIGIR.

[10]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[11]  Frank Hopfgartner,et al.  Understanding Video Retrieval , 2012 .

[12]  Martin Halvey,et al.  Search trails using user feedback to improve video search , 2008, ACM Multimedia.

[13]  Kalervo Järvelin,et al.  Task Complexity Affects Information Seeking and Use , 1995, Inf. Process. Manag..

[14]  Gerard Salton,et al.  Improving Retrieval Performance by Relevance Feedback , 1997 .

[15]  Munehiro Nakazato,et al.  ImageGrouper: a group-oriented user interface for content-based image retrieval and digital image arrangement , 2003, J. Vis. Lang. Comput..

[16]  Iain Campbell,et al.  Interactive Evaluation of the Ostensive Model Using a New Test Collection of Images with Multiple Relevance Assessments , 2000, Information Retrieval.

[17]  Alexander G. Hauptmann,et al.  Successful approaches in the TREC video retrieval evaluations , 2004, MULTIMEDIA '04.

[18]  Ji-Rong Wen,et al.  WWW 2007 / Track: Search Session: Personalization A Largescale Evaluation and Analysis of Personalized Search Strategies ABSTRACT , 2022 .

[19]  Mohan S. Kankanhalli,et al.  Proceedings of the 2008 international conference on Content-based image and video retrieval , 2008 .

[20]  Frank Hopfgartner,et al.  Simulated Testing of an Adaptive Multimedia Information Retrieval System , 2007, 2007 International Workshop on Content-Based Multimedia Indexing.

[21]  Marcel Worring,et al.  Learned Lexicon-Driven Interactive Video Retrieval , 2006, CIVR.

[22]  Marcel Worring,et al.  MediaMill: fast and effective video search using the forkbrowser , 2008, CIVR '08.

[23]  Nick Craswell,et al.  Random walks on the click graph , 2007, SIGIR.

[24]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Joemon M. Jose,et al.  EGO: A personalized multimedia management and retrieval tool , 2006, Int. J. Intell. Syst..

[26]  Micheline Hancock-Beaulieu,et al.  An Evaluation of Automatic Query Expansion in an Online Library Catalogue , 1992, J. Documentation.

[27]  Rong Yan,et al.  Extreme video retrieval: joint maximization of human and computer performance , 2006, MM '06.

[28]  Andreas Nürnberger,et al.  Intelligent Multimedia Retrieval , 2006 .

[29]  Frank M. Shipman,et al.  MediaGLOW: organizing photos in a graph-based workspace , 2009, IUI.

[30]  Jaime Teevan,et al.  Implicit feedback for inferring user preference: a bibliography , 2003, SIGF.

[31]  Adam M. Fass,et al.  PicturePiper: using a re-configurable pipeline to find images on the Web , 2000, UIST '00.

[32]  Tao Mei,et al.  Online video recommendation based on multimodal fusion and relevance feedback , 2007, CIVR '07.

[33]  Desney S. Tan,et al.  CueFlik: interactive concept learning in image search , 2008, CHI.

[34]  Jeff Z. Pan,et al.  Multimedia annotations on the semantic Web , 2006, IEEE Multimedia.

[35]  Jana Urban,et al.  EGO: A personalized multimedia management and retrieval tool: Research Articles , 2006 .

[36]  Tao Mei,et al.  VideoReach: an online video recommendation system , 2007, SIGIR.

[37]  Ryen W. White,et al.  Studying the use of popular destinations to enhance web search interaction , 2007, SIGIR.

[38]  Marieke Guy,et al.  Folksonomies: Tidying Up Tags? , 2006, D Lib Mag..

[39]  Martin Halvey,et al.  Analysis of online video search and sharing , 2007, HT '07.

[40]  Huan Liu,et al.  CubeSVD: a novel approach to personalized Web search , 2005, WWW '05.

[41]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[42]  Robert Villa,et al.  A faceted interface for multimedia search , 2008, SIGIR '08.