Proceedings of Formal Grammar 2004

This paper is concerned with learning in the model of Gold the Categorial Dependency Grammars (CDG), which express discontinuous (non-projective) dependencies. We show that rigid and k-valued CDG (without optional and iterative types) are learnable from strings. In fact, we prove that the languages of dependency nets coding rigid CDGs have finite elasticity, and we show a learning algorithm. As a standard corollary, this result leads to the learnability of rigid or kvalued CDGs (without optional and iterative types) from strings.

[1]  Aarne Ranta,et al.  An Extensible Proof Text Editor , 2000, LPAR.

[2]  Aarne Ranta,et al.  An Authoring Tool for Informal and Formal Requirements Specifications , 2002, FASE.

[3]  Christian Wartena.  Grammars with Composite Storages , 1998, LACL.

[4]  Gerald Penn,et al.  In search of epistemic primitives in the English Resource Grammar (or Why HPSG can't live without higher-order datatypes) , 2003, Proceedings of the International Conference on Head-Driven Phrase Structure Grammar.

[5]  Reinhard Blutner,et al.  Some Aspects of Optimality in Natural Language Interpretation , 2000, J. Semant..

[6]  A. Abeillé,et al.  The Syntactic Structure of French Auxiliaries , 2002 .

[7]  Nathan Vaillette,et al.  Hebrew relative clauses in HPSG , 2001, Proceedings of the International Conference on Head-Driven Phrase Structure Grammar.

[8]  Eugene Charniak,et al.  Statistical language learning , 1997 .

[9]  Hans den Besten,et al.  On the Interaction of Root Transformations and Lexical Deletive Rules , 1983 .

[10]  Alexander Dikovsky,et al.  DEPENDENCIES ON THE OTHER SIDE OF THE CURTAIN , 2000 .

[11]  Makoto Kanazawa.  Learnable Classes of Categorial Grammars , 1998 .

[12]  Stefan Dyla,et al.  Across-the board dependencies and case in Polish , 1984 .

[13]  Olivier Bonami,et al.  Constituency and word order in French subject inversion , 1999 .

[14]  李幼升,et al.  Ph , 1989 .

[15]  Pierre Encrevé,et al.  La liaison avec et sans enchaînement : phonologie tridimensionnelle et usages du français , 1988 .

[16]  Stefan Müller,et al.  Zur Analyse der deutschen Satzstruktur , 2005 .

[17]  Reinhard Blutner,et al.  Lexical Pragmatics , 1998, J. Semant..

[18]  D. W. Barron.  Machine Translation , 1968, Nature.

[19]  Manfred Sailer,et al.  Combinatorial Semantics and Idiomatic Expressions in Head-Driven Phrase Structure Grammar , 2000 .

[20]  Gisela Zifonun,et al.  C Zur Grammatik von Text und Diskurs , 1997 .

[21]  Wolfgang Wahlster,et al.  Verbmobil: Foundations of Speech-to-Speech Translation , 2000, Artificial Intelligence.

[22]  Carl Pollard,et al.  Higher-Order Categorical Grammar , 2004 .

[23]  William C. Frederick,et al.  A Combinatory Logic , 1995 .

[24]  Daniel Gallin,et al.  Intensional and Higher-Order Modal Logic , 1975 .

[25]  Marga Reis,et al.  On Justifying Topological Frames : 'Positional Field' and the Order of Nonverbal Constituents in German ⁰ , 1980 .

[26]  E. Williams,et al.  On the definition of word , 1987 .

[27]  J. Lambek,et al.  Categorial and Categorical Grammars , 1988 .

[28]  Andreas Kathol,et al.  Linearization-based German syntax , 1995 .

[29]  J. Besombes,et al.  Apprentissage des langages réguliers d'arbres et applications , 2003 .

[30]  Uwe Reyle,et al.  Natural Language Parsing and Linguistic Theories , 1988 .

[31]  Dana Angluin,et al.  Queries and concept learning , 1988, Machine Learning.

[32]  Gisela Zifonun,et al.  Grammatik der deutschen Sprache , 1997 .

[33]  Richard Montague,et al.  The Proper Treatment of Quantification in Ordinary English , 1973 .

[34]  R. Borsley.  The Nature and Function of Syntactic Categories , 1999 .

[35]  Menno van Zaanen,et al.  Bootstrapping structure into language : alignment-based learning , 2001, ArXiv.

[36]  Carl Pollard,et al.  On head non-movement , 1996 .

[37]  Jean Christophe Verstraeh.  Frequency and the emergence of linguistic structure , 2005 .

[38]  Philip H. Miller,et al.  Clitics and constituents in phrase structure grammar , 1992 .

[39]  J. Lambek,et al.  Introduction to higher order categorical logic , 1986 .

[40]  Glenn Ehlers.  Up the tree , 1999 .

[41]  Emily M. Bender.  Syntactic Variation and Linguistic Competence: The Case of Aave Copula Absence , 2000 .

[42]  Lucien Tesnière.  Éléments de syntaxe structurale , 1959 .

[43]  Sam Bayer,et al.  The Coordination of Unlike Categories. , 1996 .

[44]  José M. Castaño.  Global Index Grammars and Descriptive Power , 2004, J. Log. Lang. Inf..

[45]  Richard T. Oehrle,et al.  Term-labeled categorial type systems , 1994 .

[46]  Geoffrey K. Pullum,et al.  Phonological Resolution of Syntactic Feature Conflict , 1986 .

[47]  Birgit Wesche,et al.  Verb Order and Head Movement , 1991, Text Understanding in LILOG.

[48]  Mike Reape,et al.  A formal theory of word order : a case study in West Germanic , 1994 .

[49]  P. Grünwald.  The Minimum Description Length Principle and Reasoning under Uncertainty , 1998 .

[50]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[51]  Aarne Ranta,et al.  XML and Multilingual Document Authoring: Convergent Trends , 2000, COLING.

[52]  Yasubumi Sakakibara,et al.  Learning context-free grammars from structural data in polynomial time , 1988, COLT '88.

[53]  Marc Van De Velde,et al.  Zur mehrfachen Vorfeldbesetzung im Deutschen , 1978 .

[54]  Anssi Yli-Jyrä,et al.  Multiplanarity - a model for dependency structures in treebanks , 2003 .

[55]  Cécile Fougeron,et al.  Influence de facteurs stylistiques, syntaxiques et lexicaux sur la réalisation de la liaison en français , 2001, JEPTALNRECITAL.

[56]  Aarne Ranta,et al.  Dialogue Systems as Proof Editors , 2004, J. Log. Lang. Inf..

[57]  Ferenc Gécseg,et al.  Tree Languages , 1997, Handbook of Formal Languages.

[58]  Joachim Lambek,et al.  DEDUCTIVE SYSTEMS AND CATEGORIES IN LINGUISTICS , 1999 .

[59]  I. Sag.  English relative clause constructions , 1997, Journal of Linguistics.

[60]  William A. Howard,et al.  The formulae-as-types notion of construction , 1969 .

[61]  David J. Weir,et al.  LINEAR ITERATED PUSHDOWNS , 1994, Comput. Intell..

[62]  Ivan A. Sag,et al.  Book Reviews: Head-driven Phrase Structure Grammar and German in Head-driven Phrase-structure Grammar , 1996, CL.

[63]  Dana Angluin,et al.  Learning Regular Sets from Queries and Counterexamples , 1987, Inf. Comput..

[64]  Olivier Bonami,et al.  La nature morphologique des allomorphies conditionnées : les formes de liaison des adjectifs en français , 2003 .

[65]  Philip Neal Whitman,et al.  Category Neutrality: A Type-Logical Investigation , 2004 .

[66]  Giorgio Satta,et al.  Optimality Theory and the Generative Complexity of Constraint Violability , 1998, CL.

[67]  S. J. Keyser.  Linguistic inquiry monographs , 1976 .

[68]  Y. Morin.  Remarks on prenominal liaison consonants in French , 2003 .

[69]  Hubert Comon,et al.  Tree automata techniques and applications , 1997 .

[70]  Hans Uszkoreit,et al.  Word Order and Constituent Structure in German , 1987, CSLI Lecture Notes.

[71]  Anne Abeillé,et al.  French Word Order And Lexical Weight , 1999 .

[72]  Geoffrey K. Pullum,et al.  Generalized Phrase Structure Grammar , 1985 .

[73]  Walt Detmar Meurers,et al.  Lexical Generalizations in the Syntax of German Non-Finite Constructions , 1999 .

[74]  Takeshi Shinohara.  Inductive inference from positive data is powerful , 1990, COLT '90.

[75]  Deirdre Winston Wheeler,et al.  ASPECTS OF A CATEGORIAL THEORY OF PHONOLOGY , 1981 .

[76]  Stefan Müller.  Complex Predicates: Verbal Complexes, Resultative Constructions, and Particle Verbs in German , 2002 .

[77]  Haim Gaifman,et al.  Dependency Systems and Phrase-Structure Systems , 1965, Inf. Control..

[78]  G. Kurtz,et al.  Deutsche Syntax deklarativ. Head- Driven Phrase Structure Grammar für das Deutsche , 2001 .

[79]  D. G. Hays.  Dependency Theory: A Formalism and Some Observations , 1964 .

[80]  Daniel Dominic Sleator,et al.  Parsing English with a Link Grammar , 1995, IWPT.

[81]  Norbert Fries,et al.  Über das Null-Topik im Deutschen , 1988 .

[82]  Gerhard Jäger,et al.  Some Notes on the Formal Properties of Bidirectional Optimality Theory , 2002, J. Log. Lang. Inf..

[83]  Bob Carpenter,et al.  The logic of typed feature structures , 1992 .

[84]  Ivan A. Sag,et al.  French Clitic Movement Without Clitics or Movement , 1997 .

[85]  Anssi Yli-Jyrä,et al.  Approximating dependency grammars through intersection of star-free regular languages , 2005, Int. J. Found. Comput. Sci..

[86]  Sophia Ananiadou,et al.  On the definition of word , 2004, Machine Translation.

[87]  Glyn MorrillCentre,et al.  Grammar and Logical Types , 1990 .

[88]  IVAN A. SAG, GERALD GAZDAR, THOMAS WASOW, AND STEVEN WEISLER COORDINATION AND HOW TO DISTINGUISH , .

[89]  Ewan Klein,et al.  Shape conditions and phonological context , 2002, Proceedings of the International Conference on Head-Driven Phrase Structure Grammar.

[90]  E. Selkirk.  On derived domains in sentence phonology , 1986, Phonology.

[91]  J. Van Leeuwen,et al.  Handbook of theoretical computer science - Part A: Algorithms and complexity; Part B: Formal models and semantics , 1990 .

[92]  Mark Johnson,et al.  Features and Agreement , 1995, ACL.

[93]  Susanne Z. Riehemann,et al.  A constructional approach to idioms and word formation , 2001 .

[94]  Donca Steriade,et al.  Lexical conservatism in French adjectival liaison , 1999 .

[95]  Solomon Marcus,et al.  Algebraic Linguistics Analytical Models , 1967 .

[96]  C. Huang.  On the distribution and reference of empty pronouns , 1984 .

[97]  Bruno Courcelle,et al.  Graph Rewriting: An Algebraic and Logic Approach , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[98]  Johannes Matiasek,et al.  ARGUMENT STRUCTURE AND CASE ASSIGN-MENT IN GERMAN , 1994 .

[99]  J. Lambek.  The Mathematics of Sentence Structure , 1958 .

[100]  Igor Mel’čuk,et al.  Dependency Syntax: Theory and Practice , 1987 .

[101]  P. Smolensky,et al.  Optimality Theory: Constraint Interaction in Generative Grammar , 2004 .

[102]  H. E. de Swart,et al.  Handbook of French Semantics , 2004 .

[103]  Joachim Lambek,et al.  On the Calculus of Syntactic Types , 1961 .

[104]  Gerald Gazdar,et al.  Applicability of Indexed Grammars to Natural Languages , 1988 .

[105]  青木 昌吉.  Deutsche Grammatik = 獨逸小文典 , 1921 .

[106]  John Corcoran,et al.  Church, Alonzo , 2003 .

[107]  S. Pinker.  The Language Instinct , 1994 .

[108]  Brechtje Post.  Pitch accents, Liaison and the Phonological Phrase in French , 2000 .

[109]  Leon Henkin,et al.  Completeness in the theory of types , 1950, Journal of Symbolic Logic.

[110]  Ivan A. Sag,et al.  Syntactic Theory: A Formal Introduction , 1999, Computational Linguistics.

[111]  Geoffrey K. Pullum,et al.  On the Distinction between Model-Theoretic and Generative-Enumerative Syntactic Frameworks , 2001, LACL.

[112]  Craig Lee Thiersch,et al.  Topics in German syntax. , 1978 .

[113]  P. Fouché.  Traité de prononciation française , 1956 .

[114]  Stuart M. Shieber,et al.  Evidence against the context-freeness of natural language , 1985 .

[115]  David J. Weir,et al.  Characterizing Structural Descriptions Produced by Various Grammatical Formalisms , 1987, ACL.

[116]  Gerhard Jäger,et al.  Recursion by optimization: on the complexity of bidirectional optimality theory , 2003, Natural Language Engineering.

[117]  Haskell B. Curry,et al.  Some logical aspects of grammatical structure , 1961 .

[118]  Perdita Stevens,et al.  Modelling Recursive Calls with UML State Diagrams , 2003, FASE.

[119]  C. Pollard,et al.  Chapter 1 Ambiguity , Neutrality , and Coordination in Higher-Order Grammar , 2003 .

[120]  Carl de Marcken,et al.  Unsupervised language acquisition , 1996, ArXiv.

[121]  Stephan Kepser,et al.  On the Complexity of RSRL , 2004, FGMOL.

[122]  Anssi Yli-Jyrä.  Axiomatization of Restricted Non-Projective Dependency Trees through Finite-State Constraints that Analyse Crossing Bracketings , 2004 .

[123]  M. de Rijke,et al.  Logic, language and computation, vol. 2 , 1999 .

[124]  Stefan Müller,et al.  HPSG Analysis of German , 2000 .

[125]  Aravind K. Joshi,et al.  Natural language parsing: Tree adjoining grammars: How much context-sensitivity is required to provide reasonable structural descriptions? , 1985 .

[126]  Elisabeth Selkirk,et al.  The phrase phonology of English and French , 1972 .

[127]  Erich Drach,et al.  Grundgedanken der deutschen Satzlehre , 1963 .

[128]  J. Kaye,et al.  The syntactic bases for French liaison , 1982, Journal of Linguistics.

[129]  Walt Detmar Meurers,et al.  A Web-based Instructional Platform for Contraint-Based Grammar Formalisms and Parsing , 2002, ACL 2002.

[130]  Noam Chomsky,et al.  The Logical Structure of Linguistic Theory , 1975 .

[131]  Andreas Kathol,et al.  Positional effects in a monostratal grammar of German , 2001 .

[132]  Stefan Müller,et al.  Zur Analyse der scheinbar mehrfachen Vorfeldbesetzung , 2005 .

[133]  Johan van Benthem,et al.  Handbook of Logic and Language , 1996 .

[134]  Alonzo Church,et al.  A formulation of the simple theory of types , 1940, Journal of Symbolic Logic.

[135]  Marga Reis.  Satzeinleitende Strukturen im Deutschen: über COMP, Haupt- und Nebensätze, w-Bewegung und die Doppelkopfanalyse , 1992 .

[136]  Mike Reape,et al.  Getting things in order , 1996 .