Evaluation of Ontology Enhancement Tools

Mining algorithms can enhance the task of ontology establishment but methods are needed to assess the quality of their findings. Ontology establishment is a long-term interactive process, so it is important to evaluate the contribution of a mining tool at an early phase of this process so that only appropriate tools are used in later phases. We propose a method for the evaluation of such tools on their impact on ontology enhancement. We model impact as quality perceived by the expert and as statistical quality computed by an objective function. We further provide a mechanism that juxtaposes the two forms of quality. We have applied our method on an ontology enhancement tool and gained some interesting insights on the interplay between perceived impact and statistical quality.

[1]  Martin Kavalec,et al.  A Study on Automated Relation Labelling in Ontology Learning , 2005 .

[2]  Steffen Staab,et al.  Automatic Acquisition of Taxonomies from Text: FCA meets NLP , 2003 .

[3]  Steffen Staab,et al.  S-CREAM: Semiautomatic CREAtion of Metadata , 2002, SAAKM@ECAI.

[4]  Benno Stein,et al.  On Cluster Validity and the Information Need of Users , 2003 .

[5]  Lei Zhang,et al.  Learning to Generate Semantic Annotation for Domain Specific Sentences , 2001, Semannot@K-CAP 2001.

[6]  Steffen Staab,et al.  Semi-Automatic Engineering of Ontologies from Text , 2000, ICSE 2000.

[7]  Steffen Staab,et al.  Explaining Text Clustering Results Using Semantic Structures , 2003, PKDD.

[8]  Ramanathan V. Guha,et al.  SemTag and seeker: bootstrapping the semantic web via automated semantic annotation , 2003, WWW '03.

[9]  R. Porzel,et al.  A Task-based Approach for Ontology Evaluation , 2022 .

[10]  Dimitrios Gunopulos,et al.  Uncertainty Handling and Quality Assessment in Data Mining , 2003, Advanced Information and Knowledge Processing.

[11]  Ralf Steinmetz,et al.  Precision and Recall for Ontology Enrichment , 2004 .

[12]  Paola Velardi,et al.  Quantitative and Qualitative Evaluation of the OntoLearn Ontology Learning System , 2004, COLING.

[13]  Peter Haase,et al.  Collaborative and Usage-driven Evolution of Personal Ontologies , 2005, LWA.

[14]  K. D. Joshi,et al.  A collaborative approach to ontology design , 2002, CACM.

[15]  Myra Spiliopoulou,et al.  RELFIN - Topic Discovery for Ontology Enhancement and Annotation , 2005, ESWC.

[16]  David Faure,et al.  Knowledge Acquisition of Predicate Argument Structures from Technical Texts Using Machine Learning: The System ASIUM , 1999, EKAW.

[17]  Steffen Staab,et al.  Mining Ontologies from Text , 2000, EKAW.