Reasoning on Crowd-Sourced Semantic Annotations to Facilitate Cataloguing of 3D Artefacts in the Cultural Heritage Domain

The 3D Semantic Annotation (3DSA) system expedites the classification of 3D digital surrogates from the cultural heritage domain, by leveraging crowd-sourced semantic annotations. More specifically, the 3DSA system generates high-level classifications of 3D objects by applying rule-based reasoning across community-generated annotations and low-level shape and size attributes. This paper describes a particular use of the 3DSA system — cataloguing Greek pottery. It also describes our novel approach to rule-based reasoning that is modelled on concepts inspired from Markov logic networks. Our evaluation of this approach demonstrates its efficiency, accuracy and versatility, compared to classical rule-based reasoning.

[1]  Zahir Tari,et al.  On the Move to Meaningful Internet Systems 2005: OTM 2005 Workshops, OTM Confederated International Workshops and Posters, AWeSOMe, CAMS, GADA, MIOS+INTEROP, ORM, PhDS, SeBGIS, SWWS, and WOSE 2005, Agia Napa, Cyprus, October 31 - November 4, 2005, Proceedings , 2005, OTM Workshops.

[2]  Lora Aroyo,et al.  Semantic annotation and search of cultural-heritage collections: The MultimediaN E-Culture demonstrator , 2008, J. Web Semant..

[3]  David B. Arnold,et al.  Web based presentation of semantically tagged 3D content for public sculptures and monuments in the UK , 2009, Web3D '09.

[4]  Matthew Richardson,et al.  Markov Logic , 2008, Probabilistic Inductive Logic Programming.

[5]  Gerhard Weikum,et al.  STAR: Steiner-Tree Approximation in Relationship Graphs , 2009, 2009 IEEE 25th International Conference on Data Engineering.

[6]  Greg Humphreys,et al.  Research challenges for digital archives of 3D cultural heritage models , 2009, JOCCH.

[7]  Jane Hunter,et al.  High Speed Capture, Retrieval and Rendering of Segment-Based Annotations on 3D Museum Objects , 2011, ICADL.

[8]  Marco Attene,et al.  Semantic Annotation Of Digital 3D Objects , 2007, SAMT.

[9]  Anshuman Razdan,et al.  A Prototype Digital Library For 3D Collections: Tools To Capture, Model, Analyze, And Query Complex 3D Data , 2003 .

[10]  Jane Hunter,et al.  Using the Semantic Grid to Build Bridges between Museums and Indigenous Communities , 2004 .

[11]  Lora Aroyo,et al.  Tag interoperability in cultural web-based applications , 2008, HT '08.

[12]  Lora Aroyo,et al.  Crowdsourcing in the cultural heritage domain: opportunities and challenges , 2011, C&T.

[13]  Sheng-sheng Wang,et al.  An Ontology and SWRL Based 3D Model Retrieval System , 2008, AIRS.

[14]  Eero Hyvönen,et al.  Learning and Visualizing Cultural Heritage Connections between Places on the Semantic Web , 2009 .

[15]  Martin Ritz,et al.  Interactive Semantic Enrichment of 3D Cultural Heritage Collections , 2012, VAST.

[16]  Guus Schreiber,et al.  Thesaurus-Based Search in Large Heterogeneous Collections , 2008, SEMWEB.

[17]  Marios Pitikakis,et al.  Ontology-Based Searching Framework for Digital Shapes , 2005, OTM Workshops.

[18]  Steffen Staab,et al.  The Semantic Web - ISWC 2008, 7th International Semantic Web Conference, ISWC 2008, Karlsruhe, Germany, October 26-30, 2008. Proceedings , 2008, SEMWEB.

[19]  F. Marzani,et al.  ArchaeoKM: Managing Archaeological data through Archaeological Knowledge , 2010 .

[20]  Katrin Erk,et al.  Integrating Logical Representations with Probabilistic Information using Markov Logic , 2011, IWCS.

[21]  Ian Horrocks,et al.  The Semantic Web – ISWC 2010: 9th International Semantic Web Conference, ISWC 2010, Shanghai, China, November 7-11, 2010, Revised Selected Papers, Part I , 2010, SEMWEB.

[22]  Dana Dannélls,et al.  Reason-Able View of Linked Data for Cultural Heritage , 2011 .

[23]  Christophe Cruz,et al.  Knowledge Base Approach for 3D Objects Detection in Point Clouds Using 3D Processing and Specialists Knowledge , 2013, ArXiv.

[24]  Matthias Klusch,et al.  ISReal: An Open Platform for Semantic-Based 3D Simulations in the 3D Internet , 2010, SEMWEB.

[25]  Martin Doerr,et al.  A Repository for 3D Model Production and Interpretation in Culture and Beyond , 2010, VAST.

[26]  Monika Sester,et al.  Spatial relations and properties for semantically enhanced 3D city models , 2012 .