Exploring Video Hyperlinking in Broadcast Media

Multimedia content produced by professionals and individual users on the daily basis and in constantly growing quantity requires creation of navigation systems that allow access to this data on different levels of granularity that can contribute to further discovery of a topic of user interest or to browsing by each user in an individual way. In this paper we describe our approach to enable the users to browse through the multimedia collection. We implement the hyperlinking approach that uses the fine-grained segmentation of the visual content based on the scene segmentation, as well as available metadata, transcripts, and information about extracted visual concepts. The approach was tested at the MediaEval Search and Hyperlinking 2014 evaluation task, where it has shown its effectiveness at locating accurately relevant content in a large media archive.

[1]  Maria Eskevich,et al.  Defining and Evaluating Video Hyperlinking for Navigating Multimedia Archives , 2015, WWW.

[2]  Boon-Lock Yeo,et al.  Segmentation of Video by Clustering and Graph Analysis , 1998, Comput. Vis. Image Underst..

[3]  Mark J. F. Gales,et al.  Automatic Transcription of Multi-genre Media Archives , 2013, SLAM@INTERSPEECH.

[4]  Yiannis Kompatsiaris,et al.  Enhancing video concept detection with the use of tomographs , 2013, 2013 IEEE International Conference on Image Processing.

[5]  Noel E. O'Connor,et al.  DCU Linking Runs at MediaEval 2012 Search and Hyperlinking Task , 2012, MediaEval.

[6]  Werner Bailer,et al.  TOSCA-MP at Search and Hyperlinking of Television Content Task , 2013, MediaEval.

[7]  Pavel Pecina,et al.  CUNI at MediaEval 2014 Search and Hyperlinking Task: Search Task Experiments , 2014, MediaEval.

[8]  Rik Van de Walle,et al.  Multimedia information seeking through search and hyperlinking , 2013, ICMR.

[9]  Jean-Luc Gauvain,et al.  Speech Processing for Audio Indexing , 2008, GoTAL.

[10]  Pascale Sébillot,et al.  HITS and IRISA at MediaEval 2013: Search and Hyperlinking Task , 2013, MediaEval.

[11]  Carles Ventura,et al.  UPC at MediaEval 2013 Hyperlinking Task , 2013, MediaEval.

[12]  Yiannis Kompatsiaris,et al.  Temporal Video Segmentation to Scenes Using High-Level Audiovisual Features , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Marie-Francine Moens,et al.  IRISA and KUL at MediaEval 2014: Search and Hyperlinking Task , 2014, MediaEval.

[14]  Cor J. Veenman,et al.  Visual Word Ambiguity , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[16]  Maria Eskevich,et al.  Adapting Binary Information Retrieval Evaluation Metrics for Segment-based Retrieval Tasks , 2013, ArXiv.

[17]  Maryam Habibi,et al.  Idiap at MediaEval 2013: Search and Hyperlinking Task , 2013, MediaEval.

[18]  Maria Eskevich,et al.  The Search and Hyperlinking Task at MediaEval 2013 , 2013, MediaEval.

[19]  Paul Deléglise,et al.  LIUM's systems for the IWSLT 2011 speech translation tasks , 2011, IWSLT.

[20]  Quoc-Minh Bui,et al.  LinkedTV at MediaEval 2014 Search and Hyperlinking Task , 2014, MediaEval.

[21]  Wesley De Neve,et al.  Ghent University-iMinds at MediaEval 2013: An Unsupervised Named Entity-based Similarity Measure for Search and Hyperlinking , 2013, MediaEval.

[22]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[23]  Georges Quénot,et al.  TRECVID 2015 - An Overview of the Goals, Tasks, Data, Evaluation Mechanisms and Metrics , 2011, TRECVID.

[24]  Kim Schouten,et al.  Searching and Hyperlinking using Word Importance Segment Boundaries in MediaEval 2013 , 2013, MediaEval.

[25]  Christian Wartena.  Comparing segmentation strategies for efficient video passage retrieval , 2012, 2012 10th International Workshop on Content-Based Multimedia Indexing (CBMI).

[26]  Raphaël Troncy,et al.  Automatic fine-grained hyperlinking of videos within a closed collection using scene segmentation , 2014, ACM Multimedia.

[27]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.