Enabling access to Linked Media with SPARQL-MM

The amount of audio, video and image data on the web is immensely growing, which leads to data management problems based on the hidden character of multimedia. Therefore the interlinking of semantic concepts and media data with the aim to bridge the gap between the document web and the Web of Data has become a common practice and is known as Linked Media. However, the value of connecting media to its semantic meta data is limited due to lacking access methods specialized for media assets and fragments as well as to the variety of used description models. With SPARQL-MM we extend SPARQL, the standard query language for the Semantic Web with media specific concepts and functions to unify the access to Linked Media. In this paper we describe the motivation for SPARQL-MM, present the State of the Art of Linked Media description formats and Multimedia query languages, and outline the specification and implementation of the SPARQL-MM function set.

[1]  Raphaël Troncy,et al.  The Semantic Web: ESWC 2014 Satellite Events , 2014, Lecture Notes in Computer Science.

[2]  Kyoungro Yoon,et al.  The MPEG Query Format: Unifying Access to Multimedia Retrieval Systems , 2008, IEEE MultiMedia.

[3]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[4]  Timothy Clark,et al.  Open Annotation Data Model: community draft , 2013 .

[5]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[6]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[7]  Andreas Henrich,et al.  POQL: A Query Language for Structured Multimedia Documents , 2001 .

[8]  Timothy Clark,et al.  Open Annotation Data Model , 2013 .

[9]  Peiya Liu,et al.  A predicate logic approach for MPEG-7 XML document queries , 2001 .

[10]  Zhongfei Zhang,et al.  WebSSQL-a query language for multimedia Web documents , 2000, Proceedings IEEE Advances in Digital Libraries 2000.

[11]  Rik Van de Walle,et al.  Web-Scale Querying through Linked Data Fragments , 2014, LDOW.

[12]  Fernando Pereira,et al.  MPEG-7 the generic multimedia content description standard, part 1 - Multimedia, IEEE , 2001 .

[13]  Abraham Bernstein,et al.  The Fundamentals of iSPARQL: A Virtual Triple Approach for Similarity-Based Semantic Web Tasks , 2007, ISWC/ASWC.

[14]  Violeta Damjanovic,et al.  Semantic Enhancement : The Key to Massive and Heterogeneous Data Pools , 2011 .

[15]  Timos K. Sellis,et al.  A Family of Directional Relation Models for Extended Objects , 2007, IEEE Transactions on Knowledge and Data Engineering.

[16]  Olaf Hartig,et al.  Querying Trust in RDF Data with tSPARQL , 2009, ESWC.

[17]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[18]  Ingo Schmitt,et al.  WS-QBE: A QBE-Like Query Language for Complex Multimedia Queries , 2005, 11th International Multimedia Modelling Conference.

[19]  John David N. Dionisio,et al.  MQuery: A Visual Query Language for Multimedia, Timeline and Simulation Data , 1996, J. Vis. Lang. Comput..

[20]  Jim Melton,et al.  SQL multimedia and application packages (SQL/MM) , 2001, SGMD.

[21]  Rik Van de Walle,et al.  Experiencing standardized media fragment annotations within HTML5 , 2012, Multimedia Tools and Applications.

[22]  Violeta Damjanovic,et al.  Semantic enhancement for media asset management systems , 2014, Multimedia Tools and Applications.

[23]  Henning Schulzrinne,et al.  Real Time Streaming Protocol (RTSP) , 1998, RFC.

[24]  Eliseo Clementini,et al.  A Small Set of Formal Topological Relationships Suitable for End-User Interaction , 1993, SSD.

[25]  Harald Kosch,et al.  SPARQL-MM - Extending SPARQL to Media Fragments , 2014, ESWC.

[26]  Vincent Oria,et al.  MOQL: A Multimedia Object Query Language , 2000 .

[27]  Irene Cheng,et al.  VisualMOQL: the DISIMA visual query language , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[28]  Jonathan Mamou,et al.  A Query Language for Multimedia Content , 2007 .

[29]  Peiya Liu,et al.  A Logic Approach for MPEG-7 XML Document Queries , 2001, Extreme Markup Languages®.

[30]  Scott Boag,et al.  XQuery 1.0 : An XML Query Language , 2007 .