The LEMO annotation framework: weaving multimedia annotations with the web

Cultural institutions and museums have realized that annotations contribute valuable metadata for search and retrieval, which in turn can increase the visibility of the digital items they expose via their digital library systems. By exploiting annotations created by others, visitors can discover content they would not have found otherwise, which implies that annotations must be accessible and processable for humans and machines. Currently, however, there exists no widely adopted annotation standard that goes beyond specific media types. Most institutions build their own in-house annotation solution and employ proprietary annotation models, which are not interoperable with those of other systems. As a result, annotation data are usually stored in closed data silos and visible and processable only within the scope of a certain annotation system. As the main contribution of this paper, we present the LEMO Annotation Framework. It (1) provides a uniform annotation model for multimedia contents and various types of annotations, (2) can address fragments of various content-types in a uniform, interoperable manner and (3) pulls annotations out of closed data silos and makes them available as interoperable, dereferencable Web resources. With the LEMO Annotation Framework annotations become part of the Web and can be processed, linked, and referenced by other services. This in turn leads to even higher visibility and increases the potential value of annotations.

[1]  Nicola Ferro,et al.  Annotations: Enriching a Digital Library , 2003, ECDL.

[2]  Jose Perez-Carballo,et al.  Library of Congress Subject Headings (LCSH) , 2010 .

[3]  Nicola Ferro,et al.  Annotations as Context for Searching Documents , 2005, CoLIS.

[4]  John R. Smith,et al.  MPEG-7 multimedia description schemes , 2001, IEEE Trans. Circuits Syst. Video Technol..

[5]  Eric Prud'hommeaux,et al.  Annotea: an open RDF infrastructure for shared Web annotations , 2002, Comput. Networks.

[6]  A FoxEdward,et al.  Streams, structures, spaces, scenarios, societies (5s) , 2004 .

[7]  Sandra Payette,et al.  Flexible and Extensible Digital Object and Repository Architecture (FEDORA) , 1998, ECDL.

[8]  Robert Wilensky,et al.  Multivalent Annotations , 1997, ECDL.

[9]  Stefan Decker,et al.  JeromeDL - Adding Semantic Web Technologies to Digital Libraries , 2005, DEXA.

[10]  Sandra Payette,et al.  Fedora: an architecture for complex objects and their relationships , 2005, International Journal on Digital Libraries.

[11]  Stefano Levialdi,et al.  MADCOW: a visual interface for annotating web pages , 2006, AVI '06.

[12]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[13]  Heiko Schuldt,et al.  The Delos digital library reference model : foundations for digital libraries , 2007 .

[14]  Nicola Orio,et al.  IPSA: A Digital Archive of Herbals to Support Scientific Research , 2003, ICADL.

[15]  Steffen Staab,et al.  M-OntoMat-Annotizer: Image Annotation Linking Ontologies and Multimedia Low-Level Features , 2006, KES.

[16]  Max Kaiser,et al.  Living Memory Annotation Tool - Image Annotations for Digital Libraries , 2007, ECDL.

[17]  Laurent Denoue,et al.  An annotation tool for Web browsers and its applications to information retrieval , 2000, RIAO.

[18]  Edward A. Fox,et al.  Streams, structures, spaces, scenarios, societies (5s): A formal model for digital libraries , 2004, TOIS.

[19]  Erik Wilde,et al.  Fragment identifiers for plain text files , 2005, HYPERTEXT '05.

[20]  Ian H. Witten,et al.  Greenstone: a comprehensive open-source digital library software system , 2000, DL '00.

[21]  Norbert Fuhr,et al.  Probabilistic, object-oriented logics for annotation-based retrieval in digital libraries , 2006, Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06).

[22]  S. Pfeiffer,et al.  Specifying time intervals in URI queries and fragments of time-based Web resources (BCP) , 2003 .

[23]  Melvil Dewey Dewey decimal classification, DDC , 1971 .

[24]  Catherine C. Marshall,et al.  Toward an ecology of hypertext annotation , 1998, HYPERTEXT '98.

[25]  Mark E. Frisse Searching for Information in a Hypertext Medical Handbook , 1987, Hypertext.

[26]  Manjula Patel,et al.  What Terms Does Your Metadata Use? Application Profiles as Machine-Understandable Narratives , 2001, J. Digit. Inf..

[27]  Lynda Hardman,et al.  Identifying Spatial and Temporal Media Fragments on the Web , 2007 .

[28]  Michael A. Arbib,et al.  Annotation technology , 1999, Int. J. Hum. Comput. Stud..

[29]  Ulrich Thiel,et al.  How to Incorporate Collaborative Discourse in Cultural Digital Libraries , 2002, SAAKM@ECAI.

[30]  Bill N. Schilit,et al.  Beyond paper: supporting active reading with free form digital ink annotations , 1998, CHI.

[31]  Catherine C. Marshall,et al.  Annotation: from paper books to the digital library , 1997, DL '97.

[32]  Nicola Orio,et al.  DiLAS: a Digital Library Annotation Service , 2005, IWAC.

[33]  Robert Wilensky,et al.  Robust intra-document locations , 2000, Comput. Networks.

[34]  H. L. Hardman,et al.  Requirements for practical multimedia annotation , 2005 .

[35]  Nicola Ferro,et al.  Search Strategies for Finding Annotations and Annotated Documents: The FAST Service , 2006, FQAS.

[36]  Catherine C. Marshall The Future of Annotation in a Digital (Paper) World , 1998 .

[37]  C.C. Marshall,et al.  Exploring the relationship between personal and public annotations , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[38]  Manjula Patel,et al.  Application Profiles: Mixing and Matching Metadata Schemas , 2000 .

[39]  Nicola Ferro,et al.  A formal model of annotations of digital content , 2007, TOIS.

[40]  David M. Nichols,et al.  DEBORA: Developing an Interface to Support Collaboration in a Digital Library , 2000, ECDL.

[41]  Marja-Riitta Koivunen Semantic Authoring By Tagging with Annotea Social Bookmarks and Topics , 2006, SAAW@ISWC.

[42]  Nicola Ferro,et al.  Annotations in Digital Libraries and Collaboratories - Facets, Models and Usage , 2004, ECDL.

[43]  E. Frisse Mark,et al.  Searching for information in a hypertext medical handbook , 1988 .

[44]  David Bargeron,et al.  Robust annotation positioning in digital documents , 2001, CHI.

[45]  Jane Hunter,et al.  Annotating Relationships Between Multiple Mixed-Media Digital Objects by Extending Annotea , 2007, ESWC.

[46]  Bart Selman,et al.  Referral Web: combining social networks and collaborative filtering , 1997, CACM.

[47]  Yong Yu,et al.  Exploring social annotations for the semantic web , 2006, WWW '06.

[48]  Previous version: , 2004 .