Synote: Weaving Media Fragments and Linked Data

While end users could easily share and tag the multimedia resources online, the searching and reusing of the inside content of multimedia, such as a certain area within an image or a ten minutes segment within a one-hour video, is still difficult. Linked data is a promising way to interlink media fragments with other resources. Many applications in Web 2.0 have generated large amount of external annotations linked to media fragments. In this paper, we use Synote as the target application to discuss how media fragments could be published together with external annotations following linked data principles. Our design solves the dereferencing, describing and interlinking methods problems in interlinking multimedia. We also implement a model to let Google index media fragments which improves media fragments’ online presence. The evaluation shows that our design can successfully publish media fragments and annotations for both semantic Web agents and traditional search engines. Publishing media fragments using the design we describe in this paper will lead to better indexing of multimedia resources and their consequent findability.

[1]  Lynda Hardman,et al.  Identifying Spatial and Temporal Media Fragments on the Web , 2007 .

[2]  Raphaël Troncy,et al.  Interlinking Multimedia: How to Apply Linked Data Principles to Multimedia Fragments , 2009, LDOW.

[3]  Stefan Decker,et al.  Sig.ma: Live views on the Web of Data , 2010, J. Web Semant..

[4]  Hong Qing Yu,et al.  Linked Data based video annotation and browsing for distance learning , 2010 .

[5]  E. Prud hommeaux,et al.  SPARQL query language for RDF , 2011 .

[6]  Harry Halpin,et al.  Architecture of the World Wide Web , 2013 .

[7]  Raphaël Troncy,et al.  LODE: Linking Open Descriptions of Events , 2009, ASWC.

[8]  Stefan Decker,et al.  Sig.ma: live views on the web of data , 2010, WWW '10.

[9]  Harald Sack,et al.  Augmenting Video Search with Linked Open Data , 2009, I-SEMANTICS.

[10]  Rik Van de Walle,et al.  Television on a tablet: how TV will look like in the future and how to deal with professionally produced content , 2011 .

[11]  Raphaël Troncy Bringing the IPTC News Architecture into the Semantic Web , 2008, International Semantic Web Conference.

[12]  Orri Erling,et al.  RDF Support in the Virtuoso DBMS , 2007, CSSW.

[13]  Eyal Oren,et al.  Sindice.com: Weaving the Open Linked Data , 2007, ISWC/ASWC.

[14]  Bernhard Haslhofer,et al.  The LEMO annotation framework: weaving multimedia annotations with the web , 2009, International Journal on Digital Libraries.

[15]  Marja-Riitta Koivunen,et al.  Annotea: an open RDF infrastructure for shared Web annotations , 2001, WWW '01.

[16]  Leo Sauermann,et al.  Cool URIs for the semantic web , 2007 .

[17]  Christian Bizer,et al.  D2R Server - Publishing Relational Databases on the Semantic Web , 2004 .

[18]  Óscar Corcho,et al.  Linked Stream Data: A Position Paper , 2009, SSN.

[19]  Ansgar Scherp,et al.  Unlocking the semantics of multimedia presentations in the web with the multimedia metadata ontology , 2010, WWW '10.

[20]  Jens Lehmann,et al.  Triplify: light-weight linked data publication from relational databases , 2009, WWW '09.

[21]  Steffen Staab,et al.  COMM: Designing a Well-Founded Multimedia Ontology for the Web , 2007, ISWC/ASWC.

[22]  Jens Lehmann,et al.  DBpedia: A Nucleus for a Web of Open Data , 2007, ISWC/ASWC.

[23]  Roy T. Fielding,et al.  Hypertext Transfer Protocol - HTTP/1.1 , 1997, RFC.

[24]  Tom Heath,et al.  Linked Data: Evolving the Web into a Global Data Space , 2011, Linked Data.

[25]  Tim Berners-Lee,et al.  Linked data , 2020, Semantic Web for the Working Ontologist.

[26]  Philipp Hoschka,et al.  An Introduction to the Synchronized Multimedia Integration Language , 1998, IEEE Multim..

[27]  Gary B. Wills,et al.  Synote: development of a Web-based tool for synchronized annotations , 2011, New Rev. Hypermedia Multim..

[28]  Thomas Steiner SemWebVid - Making Video a First Class Semantic Web Citizen and a First Class Web Bourgeois , 2010, ISWC Posters&Demos.

[29]  Wesley De Neve,et al.  NinSuna: a fully integrated platform for format-independent multimedia content adaptation and delivery using Semantic Web technologies , 2009, Multimedia Tools and Applications.

[30]  Rik Van de Walle,et al.  A URI-based approach for addressing fragments of media resources on the Web , 2012, Multimedia Tools and Applications.

[31]  Gary Wills,et al.  Interlinking Multimedia Annotations , 2011 .

[32]  S. Pfeiffer,et al.  Specifying time intervals in URI queries and fragments of time-based Web resources (BCP) , 2003 .

[33]  Raphaël Troncy,et al.  How Google is using Linked Data Today and Vision For Tomorrow , 2010, LDSI@FIA.