EURECOM @ SAVA2015: Visual Features for Multimedia Search

This paper describes our approach to carry out multimedia search by connecting the textual information, or the corresponding textual description of the required visual content, in the user query to the audio-visual content of the videos within the collection. The experiments were carried out on the dataset of the Search and Anchoring in Video Archives (SAVA) task at MediaEval 2015, consisting of roughly 2700 hours of the BBC TV broadcast material. We combined visual concepts extraction condence scores with the information about corresponding word vectors distances in order to rerank the baseline text based search. The reranked runs did not outperform the baseline, however they exposed potential of our method for further improvement.

[1]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[2]  Chenyi Zhang,et al.  An Algorithm for , 2011 .

[3]  Raphaël Troncy,et al.  Automatic fine-grained hyperlinking of videos within a closed collection using scene segmentation , 2014, ACM Multimedia.

[4]  Andrew Zisserman,et al.  VISOR: Towards On-the-Fly Large-Scale Object Category Retrieval , 2012, ACCV.

[5]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.

[6]  Maryam Habibi,et al.  Idiap at MediaEval 2013: Search and Hyperlinking Task , 2013, MediaEval.

[7]  Quoc-Minh Bui,et al.  LinkedTV at MediaEval 2014 Search and Hyperlinking Task , 2014, MediaEval.

[8]  Tinne Tuytelaars,et al.  A Testbed for Cross-Dataset Analysis , 2014, ECCV Workshops.

[9]  Djoerd Hiemstra,et al.  Using language models for information retrieval , 2001 .

[10]  Geoffrey Zweig,et al.  Linguistic Regularities in Continuous Space Word Representations , 2013, NAACL.

[11]  Noel E. O'Connor,et al.  An Investigation into Feature Effectiveness for Multimedia Hyperlinking , 2014, MMM.

[12]  Ben He,et al.  Terrier : A High Performance and Scalable Information Retrieval Platform , 2022 .

[13]  H. Markov,et al.  An algorithm to , 1997 .

[14]  Jean-Luc Gauvain,et al.  Speech Processing for Audio Indexing , 2008, GoTAL.

[15]  Maria Eskevich,et al.  SAVA at MediaEval 2015: Search and Anchoring in Video Archives , 2015, MediaEval.

[16]  Maria Eskevich,et al.  The Search and Hyperlinking Task at MediaEval 2013 , 2013, MediaEval.