Inheritance in Natural Language Processing

In this introduction to the special issues, we begin by outlining a concrete example that indicates some of the motivations leading to the widespread use of inheritance networks in computational linguistics. This example allows us to illustrate some of the formal choices that have to be made by those who seek network solutions to natural language processing (NLP) problems. We provide some pointers into the extensive body of AI knowledge representation publications that have been concerned with the theory of inheritance over the last dozen years or so. We go on to identify the three rather separate traditions that have led to the current work in NLP. We then provide a fairly comprehensive literature survey of the use that computational linguists have made of inheritance networks over the last two decades, organized by reference to levels of linguistic description. In the course of this survey, we draw the reader's attention to each of the papers in these issues of Computational Linguistics and set them in the context of related work.

[1]  Luca Cardelli,et al.  A Semantics of Multiple Inheritance , 1984, Information and Computation.

[2]  Diana Archangeli,et al.  Aspects of underspecification theory , 1988, Phonology.

[3]  Chung Hee Hwang,et al.  An Episodic Knowledge Representation for Narrative Texts , 1989, KR.

[4]  Ralph M. Weischedel A Hybrid Approach to Representation in the Janus Natural Language Processor , 1989, ACL.

[5]  F. R. Two Semantic Networks : Their Computation and Use for Understanding English Sentences , 2022 .

[6]  Lauri Karttunen,et al.  D-PATR: A Development Environment for Unification-Based Grammars , 1986, COLING.

[7]  Henry Kautz,et al.  Vivid Knowledge and Tractable Reasoning: Preliminary Report , 1989, IJCAI 1989.

[8]  Dan Flickinger,et al.  Structure-Sharing in Lexical Representation , 1985, ACL.

[9]  Stuart M. Shieber,et al.  A Simple Reconstruction of GPSG , 1986, COLING.

[10]  Robert Hetzron,et al.  Where the Grammar Fails. , 1975 .

[11]  Ronald J. Brachman,et al.  The Future of Knowledge Representation , 1990, AAAI.

[12]  Richard Hudson,et al.  English word grammar , 1995 .

[13]  C. Raymond Perrault An application of default logic to speech act theory , 1987 .

[14]  Dan Flickinger,et al.  Inheritance and Complementation: a Case Study of Easy Adjectives and Related Nouns , 1992, CL.

[15]  David S. Touretzky,et al.  Inheritance Theory and Networks with Roles , 1991, Principles of Semantic Networks.

[16]  Norman M. Fraser,et al.  Making DATR Work for Speech: Lexicon Compilation in SUNDIAL , 1992, Comput. Linguistics.

[17]  James Pustejovsky,et al.  The Generative Lexicon , 1995, CL.

[18]  Geoffrey K. Pullum,et al.  Generalized Phrase Structure Grammar , 1985 .

[19]  Paul S. Jacobs A Knowledge Framework for Natural Language Analysis , 1987, IJCAI.

[20]  Erik-Jan van der Linden,et al.  Incremental Processing and the Hierarchical Lexicon , 1992, Comput. Linguistics.

[21]  Hector J. Levesque,et al.  The Tractability of Path-Based Inheritance , 1989, IJCAI.

[22]  Harry H. Porter Incorporating Inheritance and Feature Structures into a Logic Grammar Formalism , 1987, ACL.

[23]  Bonnie L. Webber,et al.  Default Reasoning in Interaction , 1984, NMR.

[24]  Walter Daelemans A Tool For The Automatic Creation, Extension And Updating Of Lexical Knowledge Bases , 1987, EACL.

[25]  Norman M. Fraser,et al.  Inheritance in Word Grammar , 1992, Comput. Linguistics.

[26]  Douglas E. Appelt,et al.  A Practical Nonmonotonic Theory for Reasoning about Speech Acts , 1988, ACL.

[27]  Ivan A. Sag,et al.  Book Reviews: Head-driven Phrase Structure Grammar and German in Head-driven Phrase-structure Grammar , 1996, CL.

[28]  James Pustejovsky Current Issues In Computational Lexical Semantics , 1989, ACL 1989.

[29]  Ivan A. Sag,et al.  Information-based syntax and semantics , 1987 .

[30]  Harold L. Somers,et al.  Linguistic Theory and Computer Applications , 1987 .

[31]  Geoffrey K. Pullum,et al.  Rule interaction and the organization of a grammar , 1979 .

[32]  Ingrid Renz,et al.  DATR As A Lexical Component For PATR , 1991, EACL.

[33]  Gert Smolka,et al.  A Feature Logic with Subsorts , 1988, LILOG-Report.

[34]  Alexander Borgida,et al.  Vivid Knowledge and Tractable Reasoning , 1989, IJCAI.

[35]  Megumi Kameyama Atomization in Grammar Sharing , 1988, ACL.

[36]  David S. Touretzky,et al.  The Mathematics of Inheritance Systems , 1984 .

[37]  Jonathan Calder,et al.  Paradigmatic Morphology , 1989, EACL.

[38]  Scott E. Fahlman,et al.  NETL: A System for Representing and Using Real-World Knowledge , 1979, CL.

[39]  Gerald Gazdar,et al.  Inference in DATR , 1989, EACL.

[40]  Norbert Reithinger,et al.  Bidirectional Use of Knowledge in the Multi-modal NL Access System XTRA , 1989, IJCAI.

[41]  Marc Moens,et al.  Expressing generalizations in unification-based grammar formalisms , 1989, EACL.

[42]  Ted Briscoe,et al.  Enjoy the Paper: Lexicology , 1990, COLING.

[43]  Gerald Gazdar,et al.  The semantics of DATR , 1989 .

[44]  Alex Lascarides,et al.  Discourse Relations and Defeasible Knowledge , 1991, ACL.

[45]  Stanley Peters,et al.  Resolving Translation Mismatches With Information Flow , 1991, ACL.

[46]  Gerard Kempen,et al.  A Framework for Incremental Syntactic Tree Formation , 1987, IJCAI.

[47]  Robert C. Moore Semantical Considerations on Nonmonotonic Logic , 1985, IJCAI.

[48]  Gosse Bouma Feature Structures and Nonmonotonicity , 1992, Comput. Linguistics.

[49]  Ronald J. Brachman,et al.  An Overview of the KL-ONE Knowledge Representation System , 1985, Cogn. Sci..

[50]  N. Curteanu Book Reviews: Lecture on Contemporary Syntactic Theories: An Introduction to Unification-Based Approaches to Grammar , 1987, CL.

[51]  Ulrich Heid,et al.  Organizing linguistic knowledge for multilingual generation , 1990, COLING.

[52]  Bob Carpenter,et al.  Inclusion, Disjointness and Choice: The Logic of Linguistic Classification , 1991, ACL.

[53]  R. Jackendoff Morphological and semantic regularities in the lexicon , 1975 .

[54]  Ivan A. Sag,et al.  Information-Based Syntax and Semantics: Volume 1, Fundamentals , 1987 .

[55]  D. Flickinger Lexical rules in the hierarchical lexicon , 1989 .

[56]  John A. Carroll,et al.  A Practical Approach to Multiple Default Inheritance for Unification-Based Lexicons , 1992, CL.

[57]  H. Aït-Kaci A lattice theoretic approach to computation based on a calculus of partially ordered type structures (property inheritance, semantic nets, graph unification) , 1984 .

[58]  Walter Daelemans,et al.  A Model of Dutch Morphophonology and its Applications , 1988, AI Commun..

[59]  Bonnie L. Webber,et al.  Knowledge Representation for Syntactic/Semantic Processing , 1980, AAAI.

[60]  Roger Evans,et al.  An Application of DATR: The TIC Lexicon , 1990, ECAI.

[61]  Paul S. Jacobs Knowledge Structures for Natural Language Generation , 1986, COLING.

[62]  van der LindenErik-Jan Incremental processing and the hierarchical lexicon , 1992 .

[63]  Sabine Reinhard,et al.  Verarbeitungsprobleme nichtlinearer Morphologien Umlautbeschreibung in einem hierarchischen Lexikon , 1990, GLDV-Jahrestagung.

[64]  Inderjeet Mani,et al.  Knowledge and natural language processing , 1990, CACM.

[65]  Dafydd Gibbon,et al.  Prosodic Inheritance And Morphological Generalisations , 1991, EACL.

[66]  Ted Briscoe,et al.  Lexical Operations in a Unification-based Framework , 1991, SIGLEX Workshop.

[67]  Luc Steels,et al.  INTRODUCING CONCEPTUAL GRAMMAR , 1978 .

[68]  David S. Touretzky,et al.  A Skeptical Theory of Inheritance in Nonmonotonic Semantic Networks , 1987, Artif. Intell..

[69]  Rémi Zajac,et al.  Inheritance and Constraint-Based Grammar Formalisms , 1992, Comput. Linguistics.

[70]  Noam Chomsky,et al.  The Sound Pattern of English , 1968 .

[71]  Martin C. Emele,et al.  Typed Unification Grammars , 1990, COLING.

[72]  Gerald Gazdar,et al.  Prioritised multiple inheritance in DATR , 1994 .