Evaluation of semantic retrieval systems on the semantic web

Purpose – This paper seeks to analyze and evaluate different types of semantic web retrieval systems, with respect to their ability to manage and retrieve semantic documents. Design/methodology/approach – The authors provide a brief overview of knowledge modeling and semantic retrieval systems in order to identify their major problems. They classify a set of characteristics to evaluate the management of semantic documents. For doing the same the authors select 12 retrieval systems classified according to these features. The evaluation methodology followed in this work is the one that has been used in the Desmet project for the evaluation of qualitative characteristics. Findings – A review of the literature has shown deficiencies in the current state of the semantic web to cope with known problems. Additionally, the way semantic retrieval systems are implemented shows discrepancies in their implementation. The authors analyze the presence of a set of functionalities in different types of semantic retrieval...

[1]  Christian Gütl,et al.  On using JSON-LD to create evolvable RESTful services , 2012, WS-REST.

[2]  Boris Motik,et al.  OWL 2 Web Ontology Language XML Serialization , 2008 .

[3]  Bela Mutschler,et al.  On the Precision of Search Engines: Results from a Controlled Experiment , 2012, BIS.

[4]  Steffen Staab,et al.  On2broker: Semantic-Based Access to Information Sources at the WWW , 1999, Intelligent Information Integration.

[5]  Hassan Abolhassani,et al.  A Categorization Scheme for Semantic Web Search Engines , 2006, IEEE International Conference on Computer Systems and Applications, 2006..

[6]  Martin 0. Andago,et al.  Evaluation of a Semantic Search Engine against a Keyword Search Engine Using First 20 Precision 1 , 2011 .

[7]  Pericles A. Mitkas,et al.  WebOWL: A Semantic Web search engine development experiment , 2012, Expert Syst. Appl..

[8]  Christian Bizer,et al.  Media Meets Semantic Web - How the BBC Uses DBpedia and Linked Data to Make Connections , 2009, ESWC.

[9]  Nektarios Gioldasis,et al.  The XML and Semantic Web Worlds: Technologies, Interoperability and Integration. A Survey of the State of the Art , 2016, Semantic Hyper/Multimedia Adaptation.

[10]  Stefanie N. Lindstaedt,et al.  Information Retrieval on the Semantic Web - Does it exist? , 2007, LWA.

[11]  Enrico Motta,et al.  The usability of semantic search tools: a review , 2007, The Knowledge Engineering Review.

[12]  Vicente Palacios Madrid Sistema de recuperación conceptual mediante niveles semánticos en la representación de esquemas de metadatos , 2011 .

[13]  Jorge Morato,et al.  Hacia una web semántica social , 2008 .

[14]  Thomas Lukasiewicz,et al.  Semantic search on the Web , 2010, Semantic Web.

[15]  Steven J. DeRose,et al.  Xml linking language (xlink), version 1. 0 , 2000, WWW 2000.

[16]  Antoine Isaac,et al.  Library Linked Data Incubator Group Final Report , 2011 .

[17]  Jorge Morato,et al.  Eight steps towards the socialisation of the Semantic Web , 2012, Int. J. Soc. Humanist. Comput..

[18]  Lynne C. Howarth,et al.  Creating a Metadata-Enabled Framework for Resource Discovery in Knowledge Bases , 2013 .

[19]  Jürgen Umbrich,et al.  Searching and browsing Linked Data with SWSE: The Semantic Web Search Engine , 2011, J. Web Semant..

[20]  Ramanathan V. Guha,et al.  Semantic search , 2003, WWW '03.

[21]  Sihem Amer-Yahia,et al.  XML search: languages, INEX and scoring , 2006, SGMD.

[22]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[23]  Carole A. Goble,et al.  Why Linked Data is Not Enough for Scientists , 2010, 2010 IEEE Sixth International Conference on e-Science.

[24]  Harald Sack,et al.  Augmenting Video Search with Linked Open Data , 2009, I-SEMANTICS.

[25]  Amit P. Sheth,et al.  Linked Data Is Merely More Data , 2010, AAAI Spring Symposium: Linked Data Meets Artificial Intelligence.

[26]  B. Kitchenham,et al.  DESMET : A method for evaluating Software Engineering methods and tools , 2000 .

[27]  Deborah L. McGuinness,et al.  Tracking RDF Graph Provenance using RDF Molecules , 2005 .

[28]  Dragan Gasevic,et al.  Semantic Document Architecture for Desktop Data Integration and Management , 2011, SEKE.

[29]  Christoph Mangold,et al.  A survey and classification of semantic search approaches , 2007, Int. J. Metadata Semant. Ontologies.

[30]  Juan-Antonio Pastor-Sánchez,et al.  Aplicación de SKOS para la interoperabilidad de vocabularios controlados en el entorno de linked open data , 2012 .

[31]  Paolo Rosso,et al.  Tag semantics for the retrieval of XML documents , 2003, ISICT.

[32]  Yun Peng,et al.  Finding and Ranking Knowledge on the Semantic Web , 2005, SEMWEB.

[33]  Duygu Tümer,et al.  An Empirical Evaluation on Semantic Search Performance of Keyword-Based and Semantic Search Engines: Google, Yahoo, Msn and Hakia , 2009, 2009 Fourth International Conference on Internet Monitoring and Protection.

[34]  Dean Allemang,et al.  RDF—The Basis of the Semantic Web , 2008 .

[35]  Andrzej Bargiela,et al.  Search with Meanings:An Overview of Semantic Search Systems , 2008 .