Towards Evaluating Interactive Ontology Matching Tools

With a growing number of ontologies used in the semantic web, agents can fully make sense of different datasets only if correspondences between those ontologies are known. Ontology matching tools have been proposed to find such correspondences. While the current research focus is mainly on fully automatic matching tools, some approaches have been proposed that involve the user in the matching process. However, there are currently no benchmarks and test methods to compare such tools. In this paper, we introduce a number of quality measures for interactive ontology matching tools, and we discuss means to automatically run benchmark tests for such tools. To demonstrate how those evaluation can be designed, we show examples on assessing the quality of interactive matching tools which involve the user in matcher selection and matcher parametrization.

[1]  Jan Nößner,et al.  CODI: Combinatorial Optimization for Data Integration: results for OAEI 2011 , 2010, OM.

[2]  Robert Isele,et al.  Active Learning of Expressive Linkage Rules for the Web of Data , 2012, ICWE.

[3]  Tharam S. Dillon,et al.  On the Move to Meaningful Internet Systems, OTM 2010 , 2010, Lecture Notes in Computer Science.

[4]  Mark A. Musen,et al.  The PROMPT suite: interactive tools for ontology merging and mapping , 2003, Int. J. Hum. Comput. Stud..

[5]  Gustavo Rossi,et al.  Web Engineering , 2001, Lecture Notes in Computer Science.

[6]  Heiko Paulheim,et al.  Towards an automatic parameterization of ontology matching tools based on example mappings , 2011, OM.

[7]  Jérôme David,et al.  The Alignment API 4.0 , 2011, Semantic Web.

[8]  Heiner Stuckenschmidt,et al.  Results of the Ontology Alignment Evaluation Initiative 2007 , 2006, OM.

[9]  Heiko Paulheim,et al.  Context-sensitive Referencing for Ontology Mapping Disambiguation , 2007, C&O:RR.

[10]  Deborah L. McGuinness,et al.  An Environment for Merging and Testing Large Ontologies , 2000, KR.

[11]  Heiko Paulheim,et al.  WeSeE-Match results for OEAI 2012 , 2012, OM.

[12]  Heiner Stuckenschmidt,et al.  Improving Ontology Matching Using Meta-level Learning , 2009, ESWC.

[13]  Gisele L. Pappa,et al.  Active Learning Genetic programming for record deduplication , 2010, IEEE Congress on Evolutionary Computation.

[14]  Jeff Heflin,et al.  The Semantic Web – ISWC 2012 , 2012, Lecture Notes in Computer Science.

[15]  Gerhard Friedrich,et al.  Interactive ontology debugging: Two query strategies for efficient fault localization☆ , 2011, J. Web Semant..

[16]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[17]  Jérôme Euzenat,et al.  Ontology Matching: State of the Art and Future Challenges , 2013, IEEE Transactions on Knowledge and Data Engineering.

[18]  Elena Paslaru Bontas Simperl,et al.  SpotTheLink: A Game for Ontology Alignment , 2011, Wissensmanagement.

[19]  Cosmin Stroe,et al.  Interactive User Feedback in Ontology Matching Using Signature Vectors , 2012, 2012 IEEE 28th International Conference on Data Engineering.

[20]  Feng Shi,et al.  Actively Learning Ontology Matching via User Interaction , 2009, SEMWEB.

[21]  Achille Fokoue,et al.  One Size Does Not Fit All: Customizing Ontology Alignment Using User Feedback , 2010, International Semantic Web Conference.

[22]  Ryutaro Ichise,et al.  Eu-An Adaptive Machine Learning Framework with User Interaction for Ontology Matching , 2022 .

[23]  Elena Paslaru Bontas Simperl,et al.  SpotTheLink: playful alignment of ontologies , 2011, SAC '11.

[24]  Hans Chalupsky,et al.  OntoMorph: A Translation System for Symbolic Knowledge , 2000, KR.

[25]  J. Euzenat,et al.  Ontology Matching , 2007, Springer Berlin Heidelberg.

[26]  Heiner Stuckenschmidt,et al.  Results of the Ontology Alignment Evaluation Initiative , 2007 .

[27]  Steffen Staab,et al.  Bootstrapping Ontology Alignment Methods with APFEL , 2005, International Semantic Web Conference.

[28]  Jérôme Euzenat,et al.  Ten Challenges for Ontology Matching , 2008, OTM Conferences.

[29]  Patrick Lambrix,et al.  Evaluation of Ontology Merging Tools in Bioinformatics , 2002, Pacific Symposium on Biocomputing.

[30]  Sean M. Falconer,et al.  Interactive Techniques to Support Ontology Matching , 2011, Schema Matching and Mapping.

[31]  Elena Paslaru Bontas Simperl,et al.  CrowdMap: Crowdsourcing Ontology Alignment with Microtasks , 2012, SEMWEB.

[32]  Enrico Motta,et al.  The Semantic Web - ISWC 2005, 4th International Semantic Web Conference, ISWC 2005, Galway, Ireland, November 6-10, 2005, Proceedings , 2005, SEMWEB.

[33]  Ian Horrocks,et al.  LogMap and LogMapLt results for OAEI 2012 , 2012, OM.

[34]  Prashant Doshi,et al.  Optima+ results for OAEI 2012 , 2011, OM.

[35]  Margaret-Anne D. Storey,et al.  A Cognitive Support Framework for Ontology Mapping , 2007, ISWC/ASWC.

[36]  Abraham Bernstein,et al.  The Semantic Web - ISWC 2009, 8th International Semantic Web Conference, ISWC 2009, Chantilly, VA, USA, October 25-29, 2009. Proceedings , 2009, SEMWEB.

[37]  Isabelle Guyon,et al.  Results of the Active Learning Challenge , 2011, Active Learning and Experimental Design @ AISTATS.

[38]  Ian Horrocks,et al.  The Semantic Web – ISWC 2010: 9th International Semantic Web Conference, ISWC 2010, Shanghai, China, November 7-11, 2010, Revised Selected Papers, Part I , 2010, SEMWEB.

[39]  Lora Aroyo,et al.  The Semantic Web: Research and Applications , 2009, Lecture Notes in Computer Science.

[40]  Laura M. Haas,et al.  Schema Mapping as Query Discovery , 2000, VLDB.

[41]  Ian Horrocks,et al.  Large-scale Interactive Ontology Matching: Algorithms and Implementation , 2012, ECAI.