Evaluating Ontology Cleaning

Ontology as a discipline of Computer Science has made many claims about its usefulness, however to date there has been very little evaluation of those claims. We present the results of an experiment using a hybrid search system with a significant knowledge-based component to measure, using precision and recall, the impact of improving the quality of an ontology on overall performance. We demonstrate that improving the ontology using OntoClean (Guarino and Welty, 2002)., does positively impact performance, and that having knowledge of the search domain is more effective than domain-knowledge-free search techniques such as link analysis.

[1]  Rada Mihalcea,et al.  Using WordNet and Lexical Operators to Improve Internet Searches , 2000, IEEE Internet Comput..

[2]  Eduard H. Hovy,et al.  Toward Semantics-Based Answer Pinpointing , 2001, HLT.

[3]  Chris Welty,et al.  FOIS introduction: Ontology---towards a new synthesis , 2001, FOIS.

[4]  Michael C. McCord,et al.  Slot Grammars , 1980, CL.

[5]  Nicola Guarino,et al.  Restructuring WordNet's Top-Level: The OntoClean approach , 2002 .

[6]  Barry Smith,et al.  FOIS introduction: Ontology---towards a new synthesis , 2001, FOIS.

[7]  Mirella Lapata,et al.  Proceedings of EMNLP 2004 , 2004 .

[8]  Jennifer Chu-Carroll,et al.  Use of WordNet Hypernyms for Answering What-Is Questions , 2001, TREC.

[9]  H. William Buttelmann,et al.  American Journal of Computational Linguistics , 1974 .

[10]  Ken Barker,et al.  Towards Context Aware Emotional Intelligence in Machines: Computing Contextual Appropriateness of Affective States , 2009, IJCAI.

[11]  Chris Welty,et al.  Evaluating Ontological Analysis , 2003 .

[12]  Peter Clark,et al.  Exploiting a Thesaurus-Based Semantic Net for Knowledge-Based Search , 2000, AAAI/IAAI.

[13]  Jennifer Chu-Carroll,et al.  A Hybrid Approach to Natural Language Web Search , 2002, EMNLP.

[14]  Stephen J. Green,et al.  Halfway to Question Answering , 2000, TREC.

[15]  Nicola Guarino,et al.  Evaluating ontological decisions with OntoClean , 2002, CACM.

[16]  Nicola Guarino,et al.  A Formal Ontology of Properties , 2000, EKAW.

[17]  Nicola Guarino,et al.  Sweetening Ontologies with DOLCE , 2002, EKAW.