Starting from Scratch in Semantic Role Labeling

A fundamental step in sentence comprehension involves assigning semantic roles to sentence constituents. To accomplish this, the listener must parse the sentence, find constituents that are candidate arguments, and assign semantic roles to those constituents. Each step depends on prior lexical and syntactic knowledge. Where do children learning their first languages begin in solving this problem? In this paper we focus on the parsing and argument-identification steps that precede Semantic Role Labeling (SRL) training. We combine a simplified SRL with an un-supervised HMM part of speech tagger, and experiment with psycholinguistically-motivated ways to label clusters resulting from the HMM so that they can be used to parse input for the SRL system. The results show that proposed shallow representations of sentence structure are robust to reductions in parsing accuracy, and that the contribution of alternative representations of sentence structure to successful semantic role labeling varies with the integrity of the parsing and argument-identification stages.

[1]  M. H. Kelly,et al.  Using sound to solve syntactic problems: the role of phonology in grammatical category assignments. , 1992, Psychological review.

[2]  Chris Quirk,et al.  Discriminative, Syntactic Language Modeling through Latent SVMs , 2008 .

[3]  Martha Palmer,et al.  From TreeBank to PropBank , 2002, LREC.

[4]  E. Clark Awareness of Language: Some Evidence from what Children Say and Do , 1978 .

[5]  Daniel Gildea,et al.  The Proposition Bank: An Annotated Corpus of Semantic Roles , 2005, CL.

[6]  C. Fisher,et al.  Learning Words and Rules , 2006, Psychological science.

[7]  M. Brent,et al.  The role of exposure to isolated words in early vocabulary development , 2001, Cognition.

[8]  Kevin Knight,et al.  Minimized Models for Unsupervised Part-of-Speech Tagging , 2009, ACL/IJCNLP.

[9]  L. Bloom Language Development: Form and Function in Emerging Grammars , 1970 .

[10]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[11]  Eytan Ruppin,et al.  Unsupervised learning of natural languages , 2006 .

[12]  Toben H. Mintz Frequent frames as a cue for grammatical categories in child directed speech , 2003, Cognition.

[13]  Dan Roth,et al.  Baby SRL: Modeling Early Language Acquisition , 2008, CoNLL.

[14]  Kentaro Torisawa,et al.  A New Perceptron Algorithm for Sequence Labeling with Non-Local Features , 2007, EMNLP.

[15]  Shimon Edelman,et al.  An empirical generative framework for computational modeling of language acquisition. , 2010, Journal of child language.

[16]  Richard Johansson,et al.  The CoNLL 2008 Shared Task on Joint Parsing of Syntactic and Semantic Dependencies , 2008, CoNLL.

[17]  Dan Roth,et al.  Minimally Supervised Model of Early Language Acquisition , 2009, CoNLL.

[18]  Paul D. Allopenna,et al.  Phonological and acoustic bases for earliest grammatical category assignment: a cross-linguistic perspective , 1998, Journal of Child Language.

[19]  L. Fenson,et al.  Lexical development norms for young children , 1996 .

[20]  Thorsten Joachims,et al.  Learning structural SVMs with latent variables , 2009, ICML '09.

[21]  Thomas L. Griffiths,et al.  A fully Bayesian approach to unsupervised part-of-speech tagging , 2007, ACL.

[22]  Robert L. Mercer,et al.  Class-Based n-gram Models of Natural Language , 1992, CL.

[23]  Jianfeng Gao,et al.  A comparison of Bayesian estimators for unsupervised Hidden Markov Model POS taggers , 2008, EMNLP.

[24]  Dan Roth,et al.  The Importance of Syntactic Parsing and Inference in Semantic Role Labeling , 2008, CL.

[25]  Toben H. Mintz,et al.  The distributional structure of grammatical categories in speech to young children , 2002 .

[26]  Charles Yang,et al.  A Statistical Test for Grammar , 2011, CMCL@ACL.

[27]  Jacques Mehler,et al.  Word frequency as a cue for identifying function words in infancy , 2010, Cognition.

[28]  Lois Bloom,et al.  One Word at a Time: The Use of Single Word Utterances Before Syntax , 1976 .

[29]  Sylvia Yuan,et al.  “Really? She Blicked the Baby?” , 2009, Psychological science.

[30]  Xavier Carreras,et al.  Semantic Role Labeling: An Introduction to the Special Issue , 2008, Computational Linguistics.

[31]  D. O'Neill,et al.  First Language , 2009 .

[32]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[33]  Dan Roth,et al.  Online Latent Structure Training for Language Acquisition , 2011, IJCAI.

[34]  Ming-Wei Chang,et al.  Discriminative Learning over Constrained Latent Representations , 2010, NAACL.

[35]  Daniel Gildea,et al.  The Necessity of Parsing for Predicate Argument Recognition , 2002, ACL.

[36]  Marina MeWi Comparing Clusterings , 2002 .

[37]  Dan Klein,et al.  Prototype-Driven Learning for Sequence Models , 2006, NAACL.

[38]  Matthew J. Beal Variational algorithms for approximate Bayesian inference , 2003 .

[39]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Burton H. Bloom,et al.  Space/time trade-offs in hash coding with allowable errors , 1970, CACM.

[41]  Cynthia Fisher,et al.  On the semantic content of subcategorization frames , 1991, Cognitive Psychology.

[42]  Z. Harris,et al.  Methods in structural linguistics. , 1952 .

[43]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[44]  Brian MacWhinney,et al.  The CHILDES Project: Tools for Analyzing Talk (third edition): Volume I: Transcription format and programs, Volume II: The database , 2000, Computational Linguistics.

[45]  Matthew Rispoli,et al.  Encounters with Japanese verbs: caregiver sentences and the categorization of transitive and intransitive action verbs , 1989 .

[46]  Rens Bod,et al.  From Exemplar to Grammar: A Probabilistic Analogy-Based Model of Language Learning , 2009, Cogn. Sci..

[47]  Suzanne Stevenson,et al.  Learning verb alternations in a usage-based Bayesian model , 2010 .

[48]  R. Gómez,et al.  Artificial grammar learning by 1-year-olds leads to specific and abstract knowledge , 1999, Cognition.

[49]  Mark Johnson,et al.  A Bayesian LDA-based model for semi-supervised part-of-speech tagging , 2007, NIPS.

[50]  Xavier Carreras,et al.  Introduction to the CoNLL-2004 Shared Task: Semantic Role Labeling , 2004, CoNLL.

[51]  Jennifer Culbertson,et al.  Word-minimality, Epenthesis and Coda Licensing in the Early Acquisition of English , 2006, Language and speech.

[52]  Willem J. M. Levelt,et al.  The child's conception of language , 1978 .

[53]  Alexander Yates,et al.  Distributional Representations for Handling Sparsity in Supervised Sequence-Labeling , 2009, ACL.

[54]  M. R. Manzini Learnability and Cognition , 1991 .

[55]  Michael Collins,et al.  Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms , 2002, EMNLP.

[56]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[57]  D. Gentner Why verbs are hard to learn , 2006 .

[58]  Letitia R. Naigles,et al.  Children use syntax to learn verb meanings , 1990, Journal of Child Language.

[59]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[60]  Eugene Charniak,et al.  Statistical Parsing with a Context-Free Grammar and Word Statistics , 1997, AAAI/IAAI.

[61]  Richard Johansson,et al.  The CoNLL-2009 Shared Task: Syntactic and Semantic Dependencies in Multiple Languages , 2009, CoNLL Shared Task.

[62]  H. Gleitman,et al.  Human simulations of vocabulary learning , 1999, Cognition.

[63]  C. Snow,et al.  Feedback to first language learners: the role of repetitions and clarification questions , 1986, Journal of Child Language.

[64]  Eric Brill,et al.  Unsupervised Learning of Disambiguation Rules for Part of Speech Tagging , 1995, VLC@ACL.

[65]  J. Werker,et al.  Newborn infants’ sensitivity to perceptual cues to lexical and grammatical words , 1999, Cognition.

[66]  Morten H. Christiansen,et al.  The differential role of phonological and distributional cues in grammatical categorisation , 2005, Cognition.

[67]  J. Tenenbaum,et al.  Variability, negative evidence, and the acquisition of verb argument constructions. , 2010, Journal of child language.

[68]  Cynthia L Fisher,et al.  Predicted Errors in Early Verb Learning , 2005 .

[69]  H. Gleitman,et al.  Understanding how input matters: verb learning and the footprint of universal grammar , 2003, Cognition.

[70]  Dan Klein,et al.  Corpus-Based Induction of Syntactic Structure: Models of Dependency and Constituency , 2004, ACL.

[71]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[72]  B. Landau Language and experience , 1985 .

[73]  E. Clark,et al.  Speaker perspective in language acquisition , 1990 .

[74]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[75]  Mark Johnson,et al.  Why Doesn’t EM Find Good HMM POS-Taggers? , 2007, EMNLP.

[76]  C. Fisher Structural Limits on Verb Mapping: The Role of Analogy in Children's Interpretations of Sentences , 1996, Cognitive Psychology.

[77]  Linda B. Smith,et al.  Infants rapidly learn word-referent mappings via cross-situational statistics , 2008, Cognition.

[78]  Roberta Michnick Golinkoff,et al.  Action Meets Word: How Children Learn Verbs , 1995 .

[79]  Lila R. Gleitman,et al.  Why It Is Hard to Label Our Concepts. , 2004 .