An Ontology Model for Narrative Image Annotation in the Field of Cultural Heritage

In the task of tagging narrative images, traditional event or story models are not suitable for temporal-spatial information modeling. These models are too coarse-grained to represent plots and actions information sufficiently in the particular field of culture heritage. In this paper, we design a narrative image annotation ontology (NIAO) model and a tool (NIA) to address these issues, by using ontology design patterns and other relevant models for reusability. The annotation model, combining the OAC (Open Annotation Collaboration) framework and regarding the Plot as a core element, makes a mapping between annotated image regions and high-level image semantics. It has been embedded in NIA, which we successfully use in the task of annotating narrative paintings. This tool can record annotation region pixels and related property values according to NIAO, and these annotation data can be stored as various formats such as csv, json, and rdf. We have built a SPARQL endpoint, in which end users can make semantic queries based on these annotation data, and visualize the results with pictures rather than tables.

[1]  N. Shadbolt,et al.  Ontological Approaches to Modelling Narrative , 2006 .

[2]  Eelco Herder,et al.  Timeline Summarization from Relevant Headlines , 2015, ECIR.

[3]  Maximillian Jahn.  Narratology: A guide to the theory of Narrative , 1981 .

[4]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[5]  Raphaël Troncy,et al.  LODE: Linking Open Descriptions of Events , 2009, ASWC.

[6]  Mitsuru Ishizuka,et al.  Storytelling Ontology Model Using RST , 2006, 2006 IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[7]  Steffen Staab,et al.  F--a model of events based on the foundational ontology dolce+DnS ultralight , 2009, K-CAP '09.

[8]  Rossana Damiano,et al.  Ontological Representations of Narratives: a Case Study on Stories and Actions , 2013, CMN.

[9]  Willem Robert van Hage,et al.  The Simple Event Model , 2013, Situation Awareness with Systems of Systems.

[10]  Georgios Meditskos,et al.  Ontology Patterns for Complex Activity Modelling , 2013, RuleML.

[11]  William C. Mann,et al.  RHETORICAL STRUCTURE THEORY: A THEORY OF TEXT ORGANIZATION , 1987 .

[12]  Desislava Zhekova,et al.  Toward a formal ontology for narrative , 2016 .

[13]  Mark S. Fox,et al.  The Role of Competency Questions in Enterprise Engineering , 1995 .

[14]  Pascal Hitzler,et al.  A Core Pattern for Events , 2016, WOP@ISWC.

[15]  M. Bal,et al.  Narratology: Introduction to the Theory of Narrative , 1988 .

[16]  Martin Doerr,et al.  The CIDOC Conceptual Reference Module: An Ontological Approach to Semantic Interoperability of Metadata , 2003, AI Mag..

[17]  Lei Xu,et al.  Semantic Description of Cultural Digital Images: Using a Hierarchical Model and Controlled Vocabulary , 2015, D Lib Mag..

[18]  Jane Hunter,et al.  The ABC Ontology and Model , 2001, J. Digit. Inf..