Semantic Multimedia Information Retrieval Based on Contextual Descriptions

Semantic analysis and annotation of textual information with appropriate semantic entities is an essential task to enable content based search on the annotated data. For video resources textual information is rare at first sight. But in recent years the development of technologies for automatic extraction of textual information from audio visual content has advanced. Additionally, video portals allow videos to be annotated with tags and comments by authors as well as users. All this information taken together forms video metadata which is manyfold in various ways. By making use of the characteristics of the different metadata types context can be determined to enable sound and reliable semantic analysis and to support accuracy of understanding the video’s content. This paper proposes a description model of video metadata for semantic analysis taking into account various contextual factors.

[1]  Kalina Bontcheva,et al.  Named Entity Disambiguation using Linked Data , 2012 .

[2]  Prithviraj Sen,et al.  Collective context-aware topic models for entity disambiguation , 2012, WWW.

[3]  Patrick Brézillon,et al.  Modeling and Using Context , 1999, Lecture Notes in Computer Science.

[4]  Rada Mihalcea,et al.  Wikify!: linking documents to encyclopedic knowledge , 2007, CIKM '07.

[5]  D. Lenat.  The Dimensions of Context-Space , 1998 .

[6]  Christopher D. Manning.  Part-of-Speech Tagging from 97% to 100%: Is It Time for Some Linguistics? , 2011, CICLing.

[7]  Harald Sack,et al.  Named Entity Recognition for User-Generated Tags , 2011, 2011 22nd International Workshop on Database and Expert Systems Applications.

[8]  Howard D. Wactlar,et al.  Complementary video and audio analysis for broadcast news archives , 2000, CACM.

[9]  Ian Horrocks,et al.  The Semantic Web – ISWC 2010: 9th International Semantic Web Conference, ISWC 2010, Shanghai, China, November 7-11, 2010, Revised Selected Papers, Part I , 2010, SEMWEB.

[10]  George P. Adams,et al.  University of California Publications in Philosophy , 1925 .

[11]  Paul Dourish,et al.  What we talk about when we talk about context , 2004, Personal and Ubiquitous Computing.

[12]  Luciano Serafini,et al.  Supporting Natural Language Processing with Background Knowledge: Coreference Resolution Case , 2010, International Semantic Web Conference.

[13]  Alexander Gelbukh,et al.  Computational Linguistics and Intelligent Text Processing , 2015, Lecture Notes in Computer Science.

[14]  Gediminas Adomavicius,et al.  Context-aware recommender systems , 2008, RecSys '08.

[15]  Khalid Choukri,et al.  Evaluation of Automatic Speech Recognition and Speech Language Translation within TC-STAR: Results from the first evaluation campaign , 2006, LREC.

[16]  Christian Bizer,et al.  DBpedia spotlight: shedding light on the web of documents , 2011, I-Semantics '11.

[17]  J. Dewey.  Context and thought , 1931 .

[18]  Patrick Brézillon,et al.  Understanding Context Before Using It , 2005, CONTEXT.

[19]  Pankaj Mehra.  Context-Aware Computing: Beyond Search and Location-Based Services , 2012, IEEE Internet Comput..