Online Reasoning for Ontology-Based Error Detection in Text

Detecting error in text is a difficult task. Current methods use a domain ontology to identify elements in the text that contradicts domain knowledge. Yet, these methods require manually defining the type of errors that are expected to be found in the text before applying them. In this paper we propose a new approach that uses logic reasoning to detect errors in a statement from text online. Such approach applies Information Extraction to transform text into a set of logic clauses. The logic clauses are incorporated into the domain ontology to determine if it contradicts the ontology or not. If the statement contradicts the domain ontology, then the statement is incorrect with respect to the domain knowledge. We have evaluated our proposed method by applying it to a set of written summaries from the domain of Ecosystems. We have found that this approach, although depending on the quality of the Information Extraction output, can identify a significant amount of errors. We have also found that modeling elements of the ontology (i.e., property domain and range) likewise affect the capability of detecting errors.

[1]  Ljiljana Stojanovic,et al.  Consistent Evolution of OWL Ontologies , 2005, ESWC.

[2]  Daniel S. Weld,et al.  Autonomously semantifying wikipedia , 2007, CIKM '07.

[3]  Boris Motik,et al.  Hypertableau Reasoning for Description Logics , 2009, J. Artif. Intell. Res..

[4]  Ian Horrocks,et al.  OWL Web Ontology Language Reference-W3C Recommen-dation , 2004 .

[5]  Raymond Reiter,et al.  A Theory of Diagnosis from First Principles , 1986, Artif. Intell..

[6]  Stefan Schlobach,et al.  Non-Standard Reasoning Services for the Debugging of Description Logic Terminologies , 2003, IJCAI.

[7]  Stephen Fickas,et al.  Providing grades and feedback for student summaries by ontology-based information extraction , 2012, CIKM '12.

[8]  Marti A. Hearst Automatic Acquisition of Hyponyms from Large Text Corpora , 1992, COLING.

[9]  Hinrich Schütze,et al.  Crosslingual distant supervision for extracting relations of different complexity , 2012, CIKM '12.

[10]  Oren Etzioni,et al.  Identifying Relations for Open Information Extraction , 2011, EMNLP.

[11]  Peter W. Foltz,et al.  Learning Human-like Knowledge by Singular Value Decomposition: A Progress Report , 1997, NIPS.

[12]  Peter F. Patel-Schneider,et al.  Reducing OWL entailment to description logic satisfiability , 2004, Journal of Web Semantics.

[13]  Jeff Z. Pan,et al.  An Argument-Based Approach to Using Multiple Ontologies , 2009, SUM.

[14]  John Mylopoulos,et al.  The Semantic Web - ISWC 2003 , 2003, Lecture Notes in Computer Science.

[15]  Dejing Dou,et al.  Ontology-based information extraction: An introduction and a survey of current approaches , 2010, J. Inf. Sci..

[16]  Johanna Völker,et al.  Ontology Learning and Reasoning - Dealing with Uncertainty and Inconsistency , 2005, ISWC-URSW.

[17]  Doug Downey,et al.  It’s a Contradiction – no, it’s not: A Case Study using Functional Relations , 2008, EMNLP.

[18]  Stephen Fickas,et al.  Hybrid Ontology-Based Information Extraction for Automated Text Grading , 2013, 2013 12th International Conference on Machine Learning and Applications.

[19]  Oren Etzioni,et al.  Open Language Learning for Information Extraction , 2012, EMNLP.

[20]  Frank van Harmelen,et al.  Reasoning with Inconsistent Ontologies , 2005, IJCAI.

[21]  Chin-Yew Lin,et al.  ROUGE: A Package for Automatic Evaluation of Summaries , 2004, ACL 2004.

[22]  Lora Aroyo,et al.  The Semantic Web: Research and Applications , 2009, Lecture Notes in Computer Science.

[23]  Grigoris Antoniou,et al.  Ontology change: classification and survey , 2008, The Knowledge Engineering Review.

[24]  Daniel Jurafsky,et al.  Distant supervision for relation extraction without labeled data , 2009, ACL.

[25]  Dave Robertson,et al.  Probabilistic Dialogue Models for Dynamic Ontology Mapping , 2006, URSW.

[26]  Frank van Harmelen,et al.  Debugging Incoherent Terminologies , 2007, Journal of Automated Reasoning.

[27]  Bijan Parsia,et al.  Explaining Inconsistencies in OWL Ontologies , 2009, SUM.

[28]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.