Two Layers of Annotation for Representing Event Mentions in News Stories

In this paper, we describe our preliminary study on annotating event mention as a part of our research on high-precision news event extraction models. To this end, we propose a two-layer annotation scheme, designed to separately capture the functional and conceptual aspects of event mentions. We hypothesize that the precision of models can be improved by modeling and extracting separately the different aspects of news events, and then combining the extracted information by leveraging the complementarities of the models. In addition, we carry out a preliminary annotation using the proposed scheme and analyze the annotation quality in terms of inter-annotator agreement.

[1]  Nadeschda Nikitina,et al.  The newsEvents Ontology - An Ontology for Describing Business Events , 2009, WOP.

[2]  Sampo Pyysalo,et al.  brat: a Web-based Tool for NLP-Assisted Text Annotation , 2012, EACL.

[3]  Antske Fokkens,et al.  Building event-centric knowledge graphs from news , 2016, J. Web Semant..

[4]  Daniel Gildea,et al.  The Proposition Bank: An Annotated Corpus of Semantic Roles , 2005, CL.

[5]  Erik F. Tjong Kim Sang,et al.  Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition , 2003, CoNLL.

[6]  S. Laurence,et al.  The Conceptual Mind: New Directions in the Study of Concepts , 2015 .

[7]  German Rigau,et al.  Robust multilingual Named Entity Recognition with shallow semi-supervised features , 2016, Artif. Intell..

[8]  Tommaso Caselli,et al.  The EVALITA 2016 Event Factuality Annotation Task (FactA) , 2016, CLiC-it/EVALITA.

[9]  Mark C. Baker,et al.  Thematic Roles and Syntactic Structure , 1997 .

[10]  James Pustejovsky,et al.  TimeML: Robust Specification of Event and Temporal Expressions in Text , 2003, New Directions in Question Answering.

[11]  Klaus Bruhn Jensen,et al.  A Handbook of Qualitative Methodologies for Mass Communication Research , 1992 .

[12]  Chantal van Son,et al.  MEANTIME, the NewsReader Multilingual Event and Time Corpus , 2016, LREC.

[13]  Steffen Staab,et al.  F--a model of events based on the foundational ontology dolce+DnS ultralight , 2009, K-CAP '09.

[14]  Zellig S. Harris,et al.  Language and information , 1988 .

[15]  Nicola Guarino,et al.  Sweetening Ontologies with DOLCE , 2002, EKAW.

[16]  C. Gibson.  From knowledge accumulation to accommodation: cycles of collective cognition in work groups , 2001 .

[17]  Antske Fokkens,et al.  NewsReader: Using knowledge resources in a cross-lingual reading machine to generate more knowledge from massive streams of news , 2016, Knowl. Based Syst..

[18]  Michael Uschold,et al.  Ontologies: principles, methods and applications , 1996, The Knowledge Engineering Review.

[19]  Piek T. J. M. Vossen,et al.  Using a sledgehammer to crack a nut? Lexical diversity and event coreference resolution , 2014, LREC.

[20]  Chantal van Son,et al.  GRaSP: A Multilayered Annotation Scheme for Perspectives , 2016, LREC.

[21]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[22]  D. Rader.  Social Semiotics , 2013 .

[23]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[24]  Robert J. Gaizauskas,et al.  Annotating Events and Temporal Information in Newswire Texts , 2000, LREC.