Empirical Insights on a Value of Ontology Quality in Ontology-Driven Web Search

Nowadays ontologies are often used to improve search applications. Quality of ontology plays an important role in these applications. An important body of work exists in both information retrieval evaluation and ontology quality assessment areas. However, there is a lack of task- and scenario-based quality assessment methods. In this paper we discuss a framework to assess fitness of ontology for use in ontology-driven Web search. We define metrics for ontology fitness to particular search tasks and metrics for ontology capability to enhance recall and precision. Further, we discuss results of a preliminary experiment showing applicability of the proposed framework and a value of ontology quality in ontology-driven Web search.

[1]  Stuart Aitken,et al.  Evaluation of an Ontology-Based Information Retrieval Tool , 2000 .

[2]  Amanda Spink,et al.  Real life, real users, and real needs: a study and analysis of user queries on the web , 2000, Inf. Process. Manag..

[3]  Marta Mattoso,et al.  Using ontologies for domain information retrieval , 2000, Proceedings 11th International Workshop on Database and Expert Systems Applications.

[4]  Olivier Corby,et al.  Assessment of Ontology-based Tools: Systemizing the Scenario Approach , 2002, EON.

[5]  Kilian Stoffel,et al.  knOWLer - Ontological Support for Information Retrieval Systems , 2003 .

[6]  Anne Aula,et al.  Query Formulation in Web Information Search , 2003, ICWI.

[7]  J. Paralič,et al.  Ontology-based Information Retrieval , 2003 .

[8]  Ramanathan V. Guha,et al.  Semantic search , 2003, WWW '03.

[9]  Yugyung Lee,et al.  OntoKhoj: a semantic web portal for ontology searching, ranking and classification , 2003, WIDM '03.

[10]  Paul Buitelaar,et al.  OntoSelect: A Dynamic Ontology Library with Support for Ontology Selection , 2004 .

[11]  Steffen Staab,et al.  International Handbooks on Information Systems , 2013 .

[12]  Nicola Guarino,et al.  An Overview of OntoClean , 2004, Handbook on Ontologies.

[13]  Laura Farinetti,et al.  Ontology Driven Semantic Search , 2004 .

[14]  Daniel Schwabe,et al.  A hybrid approach for searching in the semantic web , 2004, WWW '04.

[15]  Timothy W. Finin,et al.  Swoogle: a search and metadata engine for the semantic web , 2004, CIKM '04.

[16]  Yorick Wilks,et al.  Data Driven Ontology Evaluation , 2004, LREC.

[17]  Atanas Kiryakov,et al.  Semantic annotation, indexing, and retrieval , 2004, J. Web Semant..

[18]  Asunción Gómez-Pérez,et al.  ONTOMETRIC: A Method to Choose the Appropriate Ontology , 2004, J. Database Manag..

[19]  Deborah L. McGuinness.  Question Answering on the Semantic Web , 2004, IEEE Intell. Syst..

[20]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[21]  Vijayan Sugumaran,et al.  A semiotic metrics suite for assessing the quality of ontologies , 2005, Data Knowl. Eng..

[22]  Owen Williams,et al.  Search Engine Watch , 2005 .

[23]  Jaana Kekäläinen,et al.  Ontology as a Search-Tool: A Study of Real Users' Query Formulation With and Without Conceptual Support , 2005, ECIR.

[24]  Zhang Wei-ming,et al.  Ontology-based information retrieval model for the semantic Web , 2005, 2005 IEEE International Conference on e-Technology, e-Commerce and e-Service.

[25]  Zahir Tari,et al.  On the Move to Meaningful Internet Systems 2005: OTM 2005 Workshops, OTM Confederated International Workshops and Posters, AWeSOMe, CAMS, GADA, MIOS+INTEROP, ORM, PhDS, SeBGIS, SWWS, and WOSE 2005, Agia Napa, Cyprus, October 31 - November 4, 2005, Proceedings , 2005, OTM Workshops.

[26]  Asunción Gómez-Pérez,et al.  Ontology Metadata Vocabulary and Applications , 2005, OTM Workshops.

[27]  Peter Spyns,et al.  Lexically Evaluating Ontology Triples Generated Automatically from Texts , 2005, ESWC.

[28]  Amit P. Sheth,et al.  OntoQA: Metric-Based Ontology Quality Analysis , 2005 .

[29]  Jun-feng Song,et al.  Ontology-Based Information Retrieval Model for the Semantic Web , 2005, EEE.

[30]  Aldo Gangemi,et al.  Modelling Ontology Evaluation and Validation , 2006, ESWC.

[31]  Dean Allemang,et al.  The Semantic Web - ISWC 2006, 5th International Semantic Web Conference, ISWC 2006, Athens, GA, USA, November 5-9, 2006, Proceedings , 2006, SEMWEB.

[32]  Harith Alani,et al.  Ranking Ontologies with AKTiveRank , 2006, SEMWEB.

[33]  Enrico Motta,et al.  Watson: supporting next generation semantic web applications , 2007 .

[34]  Ah Chung Tsoi,et al.  Advances in Web and Network Technologies, and Information Management, APWeb/WAIM 2007 International Workshops: DBMAN 2007, WebETrends 2007, PAIS 2007 and ASWAN 2007, Huang Shan, China, June 16-18, 2007, Proceedings , 2007, APWeb/WAIM Workshops.

[35]  Pablo Castells,et al.  An Adaptation of the Vector-Space Model for Ontology-Based Information Retrieval , 2007, IEEE Transactions on Knowledge and Data Engineering.

[36]  Jon Espen Ingvaldsen,et al.  Ontology Learning for Search Applications , 2007, OTM Conferences.

[37]  Gábor Nagypál,et al.  Possibly imperfect ontologies for effective information retrieval , 2007 .

[38]  Zahir Tari,et al.  On the Move to Meaningful Internet Systems 2007: CoopIS, DOA, ODBASE, GADA, and IS, OTM Confederated International Conferences CoopIS, DOA, ODBASE, GADA, and IS 2007, Vilamoura, Portugal, November 25-30, 2007, Proceedings, Part II , 2007, OTM Conferences.

[39]  Darijus Strasunskas,et al.  Web Search Tailored Ontology Evaluation Framework , 2007, APWeb/WAIM Workshops.

[40]  Stein L. Tomassen.  Searching with Document Space Adapted Ontologies , 2008, WSKS.

[41]  Lora Aroyo,et al.  The Semantic Web: Research and Applications , 2009, Lecture Notes in Computer Science.

[42]  Peter Ingwersen,et al.  Developing a Test Collection for the Evaluation of Integrated Search , 2010, ECIR.