Convenient Discovery of Archived Video Using Audiovisual Hyperlinking

This paper overviews ongoing work that aims to support end-users in conveniently exploring and exploiting large audiovisual archives by deploying multiple multimodal linking approaches. We present ongoing work on multimodal video hyperlinking, from a perspective of unconstrained link anchor identification and based on the identification of named entities, and recent attempts to implement and validate the concept of outside-in linking that relates current events to archive content. Although these concepts are not new, current work is revealing novel insights, more mature technology, development of benchmark evaluations and emergence of dedicated workshops which are opening many interesting research questions on various levels that require closer collaboration between research communities.

[1]  M. Radford,et al.  “If it is too inconvenient I'm not going after it:” Convenience as a critical factor in information-seeking behaviors , 2011 .

[2]  Peter E. Hart,et al.  Query-Free Information Retrieval , 1997, IEEE Expert.

[3]  Franciska de Jong,et al.  Infolink: Analysis of Dutch Broadcast News and Cross-Media Browsing , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[4]  Rada Mihalcea,et al.  Wikify!: linking documents to encyclopedic knowledge , 2007, CIKM '07.

[5]  Raphaël Troncy,et al.  Automatic fine-grained hyperlinking of videos within a closed collection using scene segmentation , 2014, ACM Multimedia.

[6]  Peter Stockinger Audiovisual Archives: Digital Text and Discourse Analysis , 2013 .

[7]  Maria Eskevich,et al.  Linking inside a video collection: what and how to measure? , 2013, WWW.

[8]  D Stein From raw data to semantically enriched hyperlinking: Recent advances in the LinkedTV analysis workflow , 2013 .

[9]  Daniel Stein Enrichment of news show videos with multimodal semi-automatic analysis , 2012 .

[10]  P. Stockinger Digital Audiovisual Archives (ISTE) , 2012 .

[11]  Noel E. O'Connor,et al.  Link Anchors in Images: Is there Truth? , 2012 .

[12]  Maria Eskevich,et al.  Hyper Video Browser: Search and Hyperlinking in Broadcast Media , 2015, ACM Multimedia.

[13]  Douglas W. Oard,et al.  Bridging communities of practice: Emerging technologies for content-centered linking , 2016 .

[14]  M. de Rijke,et al.  Linking Archives Using Document Enrichment and Term Selection , 2011, TPDL.

[15]  Tinne Tuytelaars,et al.  Beyond Metadata: Searching Your Archive Based on its Audio-visual Content , 2014 .