Defining and Evaluating Video Hyperlinking for Navigating Multimedia Archives

Multimedia hyperlinking is an emerging research topic in the context of digital libraries and (cultural heritage) archives. We have been studying the concept of video-to-video hyperlinking from a video search perspective in the context of the MediaEval evaluation benchmark for several years. Our task considers a use case of exploring large quantities of video content via an automatically created hyperlink structure at the media fragment level. In this paper we report on our findings, examine the features of the definition of video hyperlinking based on results, and discuss lessons learned with respect to evaluation of hyperlinking in real-life use scenarios.

[1]  Rada Mihalcea,et al.  Wikify!: linking documents to encyclopedic knowledge , 2007, CIKM '07.

[2]  M. de Rijke,et al.  Linking Archives Using Document Enrichment and Term Selection , 2011, TPDL.

[3]  Zi Huang,et al.  Near-duplicate video retrieval: Current research and future trends , 2013, CSUR.

[4]  Hung-Khoon Tan,et al.  Modeling video hyperlinks with hypergraph for web video reranking , 2008, ACM Multimedia.

[5]  Georges Quénot,et al.  TRECVID 2015 - An Overview of the Goals, Tasks, Data, Evaluation Mechanisms and Metrics , 2011, TRECVID.

[6]  Song Tan,et al.  Cross media hyperlinking for search topic browsing , 2011, ACM Multimedia.

[7]  Maarten de Rijke,et al.  Exploratory Search in an Audio-Visual Archive: Evaluating a Professional Search Tool for Non-Professional Users , 2011, EuroHCIR.

[8]  Daniel Stein.  Enrichment of news show videos with multimodal semi-automatic analysis , 2012 .

[9]  Frank M. Shipman,et al.  Designing affordances for the navigation of detail-on-demand hypervideo , 2004, AVI.

[10]  Maria Eskevich,et al.  Linking inside a video collection: what and how to measure? , 2013, WWW.

[11]  Michael Herczeg,et al.  HyLive: Hypervideo-Authoring for Live Television , 2008, EuroITV.

[12]  Lyndon J. B. Nixon,et al.  Connected media experiences: web based interactive video using linked data , 2013, WWW '13 Companion.

[13]  Maria Eskevich,et al.  The Search and Hyperlinking Task at MediaEval 2013 , 2013, MediaEval.

[14]  Rik Van de Walle,et al.  Multimedia information seeking through search and hyperlinking , 2013, ICMR.

[15]  Douglas W. Oard,et al.  Bridging communities of practice: Emerging technologies for content-centered linking , 2016 .

[16]  Dennis Koelma,et al.  The MediaMill TRECVID 2008 Semantic Video Search Engine , 2008, TRECVID.

[17]  Tinne Tuytelaars,et al.  Beyond Metadata: Searching Your Archive Based on its Audio-visual Content , 2014 .

[18]  Sreenivas Gollapudi,et al.  Diversifying search results , 2009, WSDM '09.

[19]  Franciska de Jong,et al.  Infolink: Analysis of Dutch Broadcast News and Cross-Media Browsing , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[20]  Noel E. O'Connor,et al.  Link Anchors in Images: Is there Truth? , 2012 .