Automatising the learning of lexical patterns: An application to the enrichment of WordNet by extracting semantic relationships from Wikipedia

This paper describes an automatic approach to identify lexical patterns that represent semantic relationships between concepts in an on-line encyclopedia. Next, these patterns can be applied to extend existing ontologies or semantic networks with new relations. The experiments have been performed with the Simple English Wikipedia and WordNet 1.7. A new algorithm has been devised for automatically generalising the lexical patterns found in the encyclopedia entries. We have found general patterns for the hyperonymy, hyponymy, holonymy and meronymy relations and, using them, we have extracted more than 2600 new relationships that did not appear in WordNet originally. The precision of these relationships depends on the degree of generality chosen for the patterns and the type of relation, being around 60-70% for the best combinations proposed.

[1]  Alon Itai,et al.  Two Languages Are More Informative Than One , 1991, ACL.

[2]  David Faure,et al.  A corpus-based conceptual clustering method for verb frames and ontology , 1998 .

[3]  Udo Hahn,et al.  Towards Text Knowledge Engineering , 1998, AAAI/IAAI.

[4]  Susan Bonzi.  Syntactic Patterns in Scientific Sublanguages: A Study of Four Disciplines. , 1990 .

[5]  Barry Smith,et al.  GOL: toward an axiomatized upper-level ontology , 2001, FOIS.

[6]  Thomas R. Gruber,et al.  A Translation Approach to Portable Ontologies , 1993 .

[7]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[8]  Steffen Staab,et al.  Clustering Concept Hierarchies from Text , 2004, LREC.

[9]  Doug Downey,et al.  Unsupervised named-entity extraction from the Web: An experimental study , 2005, Artif. Intell..

[10]  J. Batali.  Linguistic Evolution Through Language Acquisition: The negotiation and acquisition of recursive grammars as a result of competition among exemplars , 2002 .

[11]  Uri Zernik,et al.  Lexical acquisition: Exploiting on-line resources to build a lexicon. , 1991 .

[12]  Ted Briscoe,et al.  Automatic Extraction of Subcategorization from Corpora , 1997, ANLP.

[13]  Ted Briscoe,et al.  Linguistic Evolution through Language Acquisition: Formal and Computational Models. , 2002 .

[14]  D. Fensel,et al.  Semantic Web Application Areas , 2002 .

[15]  Valentin Jijkoun,et al.  Information Extraction for Question Answering: Improving Recall Through Syntactic Patterns , 2004, COLING.

[16]  Julio Gonzalo,et al.  Corpus-based terminology extraction applied to information access , 2001 .

[17]  David Yarowsky,et al.  One Sense per Collocation , 1993, HLT.

[18]  Stephen Soderland,et al.  Learning Information Extraction Rules for Semi-Structured and Free Text , 1999, Machine Learning.

[19]  Lillian Lee,et al.  Similarity-Based Approaches to Natural Language Processing , 1997, ArXiv.

[20]  Steffen Staab,et al.  ECAI'2000 Workshop on Ontology Learning, Proceedings of the First Workshop on Ontology Learning OL'2000, Berlin, Germany, August 25, 2000. Held in conjunction with the 14th European Conference on Artificial Intelligence ECAI'2000, Berlin, Germany , 2000, ECAI Workshop on Ontology Learning.

[21]  Marti A. Hearst.  Automatic Acquisition of Hyponyms from Large Text Corpora , 1992, COLING.

[22]  Suresh Manandhar,et al.  Improving an Ontology Refinement Method with Hyponymy Patterns , 2002, LREC.

[23]  Raymond J. Mooney,et al.  Relational learning techniques for natural language information extraction , 1998 .

[24]  Kenneth Ward Church,et al.  Using Statistics in Lexical Analysis , 2003, Lexical Acquisition: Exploiting On-Line Resources to Build a Lexicon.

[25]  George A. Miller,et al.  WordNet 2 - A Morphologically and Semantically Enhanced Resource , 1999 .

[26]  Michael J. Fischer,et al.  The String-to-String Correction Problem , 1974, JACM.

[27]  Christiane Fellbaum,et al.  Knowledge Processing On An Extended Wordnet , 1998 .

[28]  Ido Dagan,et al.  Scaling Web-based Acquisition of Entailment Relations , 2004, EMNLP.

[29]  Marc Moens,et al.  Description of the LTG System Used for MUC-7 , 1998, MUC.

[30]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[31]  Steffen Staab,et al.  Ontology Learning for the Semantic Web , 2002, IEEE Intell. Syst..

[32]  Michel C. A. Klein,et al.  The semantic web: yet another hip? , 2002, Data Knowl. Eng..

[34]  Adrian Novischi.  Accurate Semantic Annotations via Pattern Matching , 2002, FLAIRS Conference.

[35]  Ricardo Baeza-Yates,et al.  Excavando la web , 2004 .

[36]  Eduard H. Hovy,et al.  Learning surface text patterns for a Question Answering System , 2002, ACL.

[37]  Maria Ruiz-Casado,et al.  Learning Sure-Fire Rules for Named Entity Recognition , 2005, RANLP Text Mining Workshop.

[38]  G Stix,et al.  The mice that warred. , 2001, Scientific American.

[39]  Steffen Staab,et al.  Discovering Conceptual Relations from Text , 2000, ECAI.

[40]  Raphael Volz,et al.  Semi-automatic Ontology Acquisition from a Corporate Intranet , 2000 .

[41]  Martha Palmer,et al.  Extracting Tree Adjoining Grammars from Bracketed Corpora , 2009 .

[42]  Sergey Brin,et al.  Extracting Patterns and Relations from the World Wide Web , 1998, WebDB.

[43]  VelardiPaola,et al.  Learning Domain Ontologies from Document Warehouses and Dedicated Web Sites , 2004 .

[44]  Lucy Vanderwende,et al.  Automatically Deriving Structured Knowledge Bases From On-Line Dictionaries , 1993 .

[45]  Lluís Codina,et al.  La Web semántica , 2006 .

[46]  Yorick Wilks,et al.  Providing machine tractable dictionary tools , 1990, Machine Translation.

[47]  Maria Ruiz-Casado,et al.  Automatic Assignment of Wikipedia Encyclopedic Entries to WordNet Synsets , 2005, AWIC.

[48]  Jason Baldridge,et al.  Providing Robustness for a CCG System , 2007 .

[49]  Susan Bonzi,et al.  Syntactic patterns in scientific sublanguages: A study of four disciplines , 1990, J. Am. Soc. Inf. Sci..

[50]  Marti A. Hearst.  Noun Homograph Disambiguation Using Local Context in Large Text Corpora , 1991 .

[51]  Martin M. Soubbotin,et al.  Use of Patterns for Detection of Likely Answer Strings: A Systematic Approach , 2002, TREC.

[52]  Lucy Vanderwende,et al.  MindNet: Acquiring and Structuring Semantic Information from Text , 1998, COLING-ACL.

[53]  Steffen Staab,et al.  Word classification based on combined measures of distributional and semantic similarity , 2003, EACL.

[54]  Emmanuel Morin,et al.  Extracting Semantic Relationships between Terms: Supervised vs. Unsupervised Methods , 1999 .

[55]  Mary E Califf.  Relational Learning Techniques for Natural Language Extraction , 1998 .

[56]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[57]  Eugene Charniak,et al.  Finding Parts in Very Large Corpora , 1999, ACL.

[58]  George A. Miller.  WordNet: A Lexical Database for English , 1992, HLT.

[59]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[60]  Maria Antònia Martí,et al.  MICE: a module for Named Entities Recognition and Classification , 2004 .

[61]  Paola Velardi,et al.  Learning Domain Ontologies from Document Warehouses and Dedicated Web Sites , 2004, CL.

[62]  Marti A. Hearst.  Automated Discovery of WordNet Relations , 2004 .

[63]  Sanda M. Harabagiu,et al.  Knowledge processing on an extended wordnet , 1998 .

[64]  Dayne Freitag,et al.  Machine Learning for Information Extraction in Informal Domains , 2000, Machine Learning.

[65]  Suresh Manandhar,et al.  Extending a Lexical Ontology by a Combination of Distributional Semantics Signatures , 2002, EKAW.

[66]  Peter M. Hastings.  Automatic acquisition of word meaning from context , 1994 .

[67]  David Yarowsky,et al.  Multi-Field Information Extraction and Cross-Document Fusion , 2005, ACL.

[68]  Luis Gravano,et al.  Snowball: extracting relations from large plain-text collections , 2000, DL '00.

[69]  P. Resnik.  Selection and information: a class-based approach to lexical relationships , 1993 .

[70]  German Rigau.  Automatic Acquisition of Lexical Knowl-edge from MRDs , 1998 .

[71]  Marco De Boni,et al.  Automated Discovery of Telic Relations for WordNet , 2002 .

[72]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[73]  Martin M. Soubbotin,et al.  Use of Patterns for Detection of Answer Strings: a Systematic Approach Essentials of the Approach , 2022 .

[74]  David Yarowsky,et al.  Unsupervised Personal Name Disambiguation , 2003, CoNLL.

[75]  James A. Hendler,et al.  The Semantic Web: A new form of Web content that is meaningful to computers will unleash a revolution of new possibilities , 2001 .

[76]  Roberto Basili,et al.  An empirical approach to Lexical Tuning , 2000 .