Evaluation of Ontological Relations in Corpora of Restricted Domain

In this paper we propose a new approach for automatic evaluation of relations in ontologies of restricted domain. In particular, we use various lexico-syntactic patterns with the aim of evaluating the class-inclusionand ontological relations that the ontology holds. Our approach focuses on a reference corpus for finding evidence of the relation validity. The approach is capable to provide an accuracy measure for each ontology evaluated, a value associated in some way with the quality of the ontology relations. This score is given with a certain degree of reliability, and it is obtained by comparing the results given by our approach against the evaluation of human experts and a baseline.

[1]  Saif Mohammad,et al.  SemEval-2012 Task 2: Measuring Degrees of Relational Similarity , 2012, *SEMEVAL.

[2]  Maria Ruiz-Casado,et al.  Automatic Extraction of Semantic Relationships for WordNet by Means of Pattern Learning from Wikipedia , 2005, NLDB.

[3]  George A. Vouros,et al.  Gold Standard Evaluation of Ontology Learning Methods through Ontology Transformation and Alignment , 2011, IEEE Transactions on Knowledge and Data Engineering.

[4]  Svitlana Volkova,et al.  Boosting Biomedical Entity Extraction by Using Syntactic Patterns for Semantic Relation Discovery , 2010 .

[5]  Wim Peters,et al.  SPRAT : a tool for automatic semantic pattern-based ontology population , 2009 .

[6]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[7]  Patrick Saint-Dizier,et al.  Computational lexical semantics: Preface , 1995 .

[8]  Guadalupe Aguado de Cea,et al.  Using Natural Language Patterns for the Development of Ontologies , 2008 .

[9]  Paul Buitelaar,et al.  RelExt: A Tool for Relation Extraction from Text in Ontology Extension , 2005, SEMWEB.

[10]  Acknowledgements iii , 2006 .

[11]  Desislava Zhekova,et al.  Lexico-Syntactic Patterns for Automatic Ontology Building , 2011, RANLP Student Research Workshop.

[12]  Lina Zhou,et al.  A Framework for Ontology Evaluation , 2009, WEB.

[13]  V. Karkaletsis,et al.  Learning of Semantic Relations between Ontology Concepts using Statistical Techniques , 2008 .

[14]  Mirko Čubrilo,et al.  Ontology Evaluation – Comprising Verification and Validation , 2008 .

[15]  Pablo Castells,et al.  A collaborative recommendation framework for ontology evaluation and reuse , 2006 .

[16]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[17]  Samir AbdelRahman,et al.  A Multiple-Domain Ontology Builder , 2010, COLING.

[18]  Aldo Gangemi,et al.  Unsupervised Learning of Semantic Relations between Concepts of a Molecular Biology Ontology , 2005, IJCAI.

[19]  M. Kendall.  A NEW MEASURE OF RANK CORRELATION , 1938 .

[20]  Thomas R. Gruber,et al.  Toward principles for the design of ontologies used for knowledge sharing? , 1995, Int. J. Hum. Comput. Stud..

[21]  VERGINICA BARBU MITITELU.  HYPONYMY PATTERNS IN ROMANIAN , 2011 .

[22]  Víctor Jesús Sosa Sosa,et al.  Learning concept hierarchies from textual resources for ontologies construction , 2013, Expert Syst. Appl..

[23]  L JaimeCerda,et al.  Evaluación de la concordancia inter-observador en investigación pediátrica: Coeficiente de Kappa , 2008 .

[24]  Yorick Wilks,et al.  Data Driven Ontology Evaluation , 2004, LREC.

[25]  Pushpak Bhattacharyya,et al.  Domain Specific Ontology Extractor For Indian Languages , 2012, ALR@COLING.

[26]  Enrico Motta,et al.  Ontology Selection: Ontology Evaluation on the Real Semantic Web , 2006, EON@WWW.

[27]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[28]  Marti A. Hearst.  Automatic Acquisition of Hyponyms from Large Text Corpora , 1992, COLING.

[29]  Marek Hatala,et al.  Linguistic Patterns for Information Extraction in OntoCmaps , 2012, WOP.

[30]  Vojtech Svátek,et al.  Discovery of Lexical Entries for Non-taxonomic Relations in Ontology Learning , 2004, SOFSEM.

[31]  Francoise Pelle.  ISSN , 2002 .

[32]  Steffen Staab,et al.  Strategies for the Evaluation of Ontology Learning , 2008, Ontology Learning and Population.

[33]  Mark Stevenson,et al.  A Semantic Approach to IE Pattern Induction , 2005, ACL.

[34]  Juan Luis Jiménez Ruiz,et al.  Iniciación a la lingüística , 2001 .

[35]  Elena Montiel-Ponsoda,et al.  From Linguistic Patterns to Ontology Structures , 2009, TIA.

[36]  Mathieu Lafourcade,et al.  Inference and Reconciliation in a Crowdsourced Lexical-Semantic Network , 2013, CICLing 2013.

[37]  Gintare Grigonyte.  Building and evaluating domain ontologies: NLP contributions , 2010 .

[38]  Marko Grobelnik,et al.  A SURVEY OF ONTOLOGY EVALUATION TECHNIQUES , 2005 .

[39]  Lluís Padró,et al.  FreeLing 3.0: Towards Wider Multilinguality , 2012, LREC.

[40]  Mark Stevenson,et al.  Learning Information Extraction Patterns Using WordNet , 2006 .

[41]  Steffen Staab,et al.  Measuring Similarity between Ontologies , 2002, EKAW.