Best-fit constructional analysis

This dissertation describes a process called best-fit constructional analysis and the associated implementation called the Constructional Analyzer. The constructional analyzer takes an utterance as input and performs deep semantic analysis, mapping the utterance onto its most likely interpretation. The best-fit constructional analyzer is unique because it combines Embodied Construction Grammar with the power of best-fit processing. This combination enables the constructional analyzer to be both a cognitive model of interpretation and a practical semantic analysis system. The best-fit constructional analyzer performs incremental unification grammar parsing, using a factored probabilistic model over syntax and semantics to guide interpretation. The constructional analyzer has been applied to a range of applications: (a) It is a tool for building and testing construction grammars. (b) It is a psychologically plausible model of human interpretation that makes predictions about reading time that match experimental evidence. (c) It is a practical system for semantic analysis that has been tested on a corpus of Mandarin child-parent dialogues.

[1]  Mark Johnson,et al.  Robust probabilistic predictive syntactic processing: motivations, models, and applications , 2001 .

[2]  Jerome A. Feldman,et al.  A (Somewhat) New Solution to the Variable Binding Problem , 2008, Neural Computation.

[3]  Chris Brew,et al.  Stochastic HPSG , 1995, EACL.

[4]  Brian Roark,et al.  Robust Probabilistic Predictive Syntactic Processing , 2001, ArXiv.

[5]  Daniel C. Richardson,et al.  Effects of merely local syntactic coherence on sentence processing , 2004 .

[6]  Bob Carpenter,et al.  Probabilistic Parsing using Left Corner Language Models , 1997, IWPT.

[7]  Dong Hoon Van Uytsel,et al.  Probabilistic language modeling with left corner parsing , 2003 .

[8]  Wayne H. Ward,et al.  Towards Robust Semantic Role Labeling , 2007, CL.

[9]  C. Fillmore,et al.  Grammatical constructions and linguistic generalizations: The What's X doing Y? construction , 1999 .

[10]  John Bryant.  Constructional Analysis , 2022 .

[11]  Dan Klein,et al.  Fast Exact Inference with a Factored Model for Natural Language Parsing , 2002, NIPS.

[12]  Srini Narayanan,et al.  A Bayesian Model of Human Sentence Processing , 1998 .

[13]  Adwait Ratnaparkhi,et al.  Learning to Parse Natural Language with Maximum Entropy Models , 1999, Machine Learning.

[14]  Eugene Charniak,et al.  A Maximum-Entropy-Inspired Parser , 2000, ANLP.

[15]  Raymond J. Mooney,et al.  Learning Synchronous Grammars for Semantic Parsing with Lambda Calculus , 2007, ACL.

[16]  John Bryant,et al.  A Best-Fit Approach to Productive Omission of Arguments , 2006 .

[17]  Hwee Tou Ng,et al.  A Machine Learning Approach to Coreference Resolution of Noun Phrases , 2001, CL.

[18]  Andreas Stolcke,et al.  An Efficient Probabilistic Context-Free Parsing Algorithm that Computes Prefix Probabilities , 1994, CL.

[19]  Ulrike Padó,et al.  The integration of syntax and semantic plausibility in a wide-coverage model of human sentence processing , 2007 .

[20]  Jerome A. Feldman,et al.  From Molecule to Metaphor - A Neural Theory of Language , 2006 .

[21]  Mark Johnson,et al.  Lexicalized Stochastic Modeling of Constraint-Based Grammars using Log-Linear Measures and EM Training , 2000, ACL.

[22]  Daniel Gildea,et al.  The Proposition Bank: An Annotated Corpus of Semantic Roles , 2005, CL.

[23]  Julian M. Pine,et al.  Constructing a Language: A Usage-Based Theory of Language Acquisition. , 2004 .

[24]  Dan Klein,et al.  A* Parsing: Fast Exact Viterbi Parse Selection , 2003, NAACL.

[25]  Noriko Tomuro,et al.  Left-corner parsing algorithm for unification grammars , 1999 .

[26]  Tiago V. Maia,et al.  Learning Grammatical Constructions , 2001 .

[27]  James Henderson,et al.  Discriminative Training of a Neural Network Statistical Parser , 2004, ACL.

[28]  Mark Steedman,et al.  The nite connectivity of linguistic structure , 1999 .

[29]  Peter W. Culicover,et al.  Why Simpler Syntax , 2005 .

[30]  Uwe Reyle,et al.  From Discourse to Logic - Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory , 1993, Studies in linguistics and philosophy.

[31]  Beate Hamp,et al.  The Fundamental System of Spatial Schemas in Language , 2022 .

[32]  Raymond J. Mooney,et al.  A Statistical Semantic Parser that Integrates Syntax and Semantics , 2005, CoNLL.

[33]  Benjamin K. Bergen,et al.  Embodied Construction Grammar in Simulation-Based Language Understanding , 2003 .

[34]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[35]  M. Tomasello.  Regularity and Idiomaticity in Grammatical Constructions: The Case of Let Alone , 2003 .

[36]  Luke S. Zettlemoyer,et al.  Online Learning of Relaxed CCG Grammars for Parsing to Logical Form , 2007, EMNLP.

[37]  Mark Johnson,et al.  Estimators for Stochastic “Unification-Based” Grammars , 1999, ACL.

[38]  Alan J. Demers,et al.  Generalized left corner parsing , 1977, POPL.

[39]  Brian Roark,et al.  Incremental Parsing with the Perceptron Algorithm , 2004, ACL.

[40]  Daniel J. Rosenkrantz,et al.  Deterministic Left Corner Parsing (Extended Abstract) , 1970, SWAT.

[41]  Jean-Claude Junqua,et al.  Robustness in Language and Speech Technology , 2001, Text, Speech and Language Technology.

[42]  M. Tanenhaus,et al.  Modeling the Influence of Thematic Fit (and Other Constraints) in On-line Sentence Comprehension , 1998 .

[43]  Luke S. Zettlemoyer,et al.  Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars , 2005, UAI.

[44]  Daniel Jurafsky,et al.  A Bayesian Model Predicts Human Parse Preference and Reading Times in Sentence Processing , 2001, NIPS.

[45]  Mark Johnson,et al.  Parsing the Wall Street Journal using a Lexical-Functional Grammar and Discriminative Estimation Techniques , 2002, ACL.

[46]  Stephan Oepen,et al.  Stochastic HPSG Parse Disambiguation using the Redwoods Corpus , 2005 .

[47]  G. Lakoff,et al.  Metaphors We Live by , 1981 .

[48]  Andrew McCallum,et al.  Conditional Models of Identity Uncertainty with Application to Noun Coreference , 2004, NIPS.

[49]  Dan Klein,et al.  Improved Inference for Unlexicalized Parsing , 2007, NAACL.

[50]  John Hale,et al.  Uncertainty About the Rest of the Sentence , 2006, Cogn. Sci..

[51]  L. Shastri,et al.  From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony , 1993, Behavioral and Brain Sciences.

[52]  Luc Steels,et al.  A (very) Brief Introduction to Fluid Construction Grammar , 2006 .

[53]  Jonathan Ginzburg,et al.  Interrogative Investigations: The Form, Meaning, and Use of English Interrogatives , 2001 .

[54]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[55]  John DeNero,et al.  Approximate Factoring for A* Search , 2007, HLT-NAACL.

[56]  Paul Kay,et al.  An Informal Sketch of a Formal Architecture for Construction Grammar , 2002, Grammars.

[57]  Dan Klein,et al.  Unsupervised Coreference Resolution in a Nonparametric Bayesian Model , 2007, ACL.

[58]  Frank Keller,et al.  Combining Syntax and Thematic Fit in a Probabilistic Model of Sentence Processing , 2006 .

[59]  Jay Earley,et al.  An efficient context-free parsing algorithm , 1970, Commun. ACM.

[60]  Michael Collins,et al.  Three Generative, Lexicalised Models for Statistical Parsing , 1997, ACL.

[61]  G. Fauconnier.  Mappings in thought and language , 1997 .

[62]  Steven P. Abney.  Stochastic Attribute-Value Grammars , 1996, CL.

[63]  Ivan A. Sag,et al.  Book Reviews: Head-driven Phrase Structure Grammar and German in Head-driven Phrase-structure Grammar , 1996, CL.

[64]  Ivan Titov,et al.  Constituent Parsing with Incremental Sigmoid Belief Networks , 2007, ACL.

[65]  Michael Collins,et al.  Discriminative Reranking for Natural Language Parsing , 2000, CL.

[66]  Dan Klein,et al.  Accurate Unlexicalized Parsing , 2003, ACL.

[67]  James B. Henderson.  Lookahead in Deterministic Left-Corner Parsing , 2004 .

[68]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[69]  John Hale,et al.  A Probabilistic Earley Parser as a Psycholinguistic Model , 2001, NAACL.

[70]  Alon Lavie,et al.  Automatic parsing of parental verbal input , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[71]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[72]  Claire Gardent,et al.  Improving Machine Learning Approaches to Coreference Resolution , 2002, ACL.

[73]  Daniel Jurafsky,et al.  Automatic Labeling of Semantic Roles , 2002, CL.

[74]  Eugene Charniak,et al.  Figures of Merit for Best-First Probabilistic Chart Parsing , 1998, Comput. Linguistics.

[75]  James Henderson,et al.  Incremental Syntactic Parsing of Natural Language Corpora with Simple Synchrony Networks , 2001, IEEE Trans. Knowl. Data Eng..

[76]  Christopher D. Manning,et al.  Probabilistic models of word order and syntactic discontinuity , 2005 .

[77]  George Lakoff,et al.  Women, Fire, and Dangerous Things , 1987 .