Evaluating techniques for learning non-taxonomic relationships of ontologies from text

Abstract Learning non-taxonomic relationships is a sub-field of Ontology Learning that aims at automating the extraction of these relationships from text. Several techniques have been proposed based on Natural Language Processing and Machine Learning. However just like for other techniques for Ontology Learning, evaluating techniques for learning non-taxonomic relationships is an open problem. Three general proposals suggest that the learned ontologies can be evaluated in an executable application or by domain experts or even by a comparison with a predefined reference ontology. This article proposes two procedures to evaluate techniques for learning non-taxonomic relationships based on the comparison of the relationships obtained with those of a reference ontology. Also, these procedures are used in the evaluation of two state of the art techniques performing the extraction of relationships from two corpora in the domains of biology and Family Law.

[1]  Johanna Völker,et al.  Ontologies on demand? : A description of the state-of-the-art, applications, challenges and trends for ontology learning from text , 2006 .

[2]  Paulo Novais,et al.  Reviewing the Problem of Learning Non-Taxonomic Relationships of Ontologies from Text , 2012, Int. J. Semantic Comput..

[3]  William H. Fletcher Making the Web More Useful as a Source for Linguistic Corpora , 2004 .

[4]  Amit P. Sheth,et al.  Ontological Evaluation and Validation , 2010 .

[5]  Steffen Staab,et al.  Mining Non-Taxonomic Conceptual Relations from Text , 2000 .

[6]  L. Floridi Blackwell Guide to the Philosophy of Computing and Information , 2003 .

[7]  Ramakrishnan Srikant,et al.  Mining generalized association rules , 1995, Future Gener. Comput. Syst..

[8]  Dan I. Moldovan,et al.  Learning Semantic Constraints for the Automatic Discovery of Part-Whole Relations , 2003, NAACL.

[9]  Fabio Rinaldi,et al.  Mining relations in the GENIA corpus , 2004 .

[10]  Paulo Novais,et al.  PARNT: A Statistic based Approach to Extract Non-Taxonomic Relationships of Ontologies from Text , 2013, 2013 10th International Conference on Information Technology: New Generations.

[11]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[12]  Rosario Girardi Guiding Ontology Learning and Population by Knowledge System Goals , 2010, KEOD.

[13]  Steffen Staab,et al.  Measuring Similarity between Ontologies , 2002, EKAW.

[14]  Estevam R. Hruschka,et al.  Discovering Relations between Noun Categories , 2011, EMNLP.

[15]  David Sánchez,et al.  Learning non-taxonomic relationships from web documents for domain ontology construction , 2008, Data Knowl. Eng..

[16]  Philipp Cimiano,et al.  Ontology Learning from Text: Methods, Evaluation and Applications , 2005 .

[17]  Steffen Staab,et al.  On How to Perform a Gold Standard Based Evaluation of Ontology Learning , 2006, SEMWEB.

[18]  Oren Etzioni,et al.  Identifying Relations for Open Information Extraction , 2011, EMNLP.

[19]  Richard Xiao,et al.  Corpus Creation , 2010, Handbook of Natural Language Processing.

[20]  Mark A. Bedau,et al.  Blackwell Guide to the Philosophy of Computing and Information , 2003 .

[21]  Yorick Wilks,et al.  Data Driven Ontology Evaluation , 2004, LREC.

[22]  Silvia Bernardini,et al.  BootCaT: Bootstrapping Corpora and Terms from the Web , 2004, LREC.

[23]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[24]  Analía Amandi,et al.  Supporting the discovery and labeling of non-taxonomic relationships in ontology learning , 2009, Expert Syst. Appl..