Generating Reference Mappings for Evaluating Ontology Matching Tools

Ontology Alignment is one of the biggest challenges of semantic web research. Recently there has been some attention on automatic alignment methods and number of matching tools have been developed. One of the open problem of automatic matching currently is the evaluation of the quality of automatically generated mappings. Normally, reference mappings are used to compute the precision and recall of automatically created mappings. Often, however, such reference mappings do not exist and creating them by hand is not feasible for large ontologies. In this paper, we extend previous work on overcoming this problem by proposing a method for automatically generating highly correct reference mappings. In particular, we consider the case where we do not have shared instances for the ontologies to be aligned and report the results of an experiment in which we used automatic document classification as a basis for creating a reference mapping. We present the results of our experiment on medical datasets and show that the result provides a useful basis for comparing matching systems.

[1]  Fausto Giunchiglia,et al.  Contextual Reasoning , 1998, ECAI.

[2]  Bernardo Magnini,et al.  A Semantic-based Approach to Interoperabiltity of Classification Hierarchies: Evaluation of Linguistic Techniques , 2004, COLING.

[3]  Marc Ehrig,et al.  Relaxed Precision and Recall for Ontology Matching , 2005, Integrating Ontologies.

[4]  Fausto Giunchiglia,et al.  S-Match: an Algorithm and an Implementation of Semantic Matching , 2004, ESWS.

[5]  Erhard Rahm,et al.  COMA - A System for Flexible Combination of Schema Matching Approaches , 2002, VLDB.

[6]  Jérôme Euzenat,et al.  Similarity-Based Ontology Alignment in OWL-Lite , 2004, ECAI.

[7]  Jérôme Euzenat,et al.  Specification of a Common Framework for Characterizing Alignment , 2004 .

[8]  Fausto Giunchiglia,et al.  A Large Scale Taxonomy Mapping Evaluation , 2005, International Semantic Web Conference.

[9]  Heiner Stuckenschmidt,et al.  Introduction to the Ontology Alignment Evaluation 2005 , 2005, Integrating Ontologies.

[10]  Ryutaro Ichise,et al.  Integrating Multiple Internet Directories by Instance-based Learning , 2003, IJCAI.

[11]  Heiner Stuckenschmidt,et al.  Ontology Alignment: An annotated Bibliography , 2005, Semantic Interoperability and Integration.

[12]  Erhard Rahm,et al.  Schema and ontology matching with COMA++ , 2005, SIGMOD '05.

[13]  Steffen Staab,et al.  QOM - Quick Ontology Mapping , 2004, GI Jahrestagung.

[14]  Pedro M. Domingos,et al.  Learning to Match the Schemas of Data Sources: A Multistrategy Approach , 2003, Machine Learning.

[15]  Yuzhong Qu,et al.  FalconAO: Aligning Ontologies with Falcon , 2005, Integrating Ontologies.