CorEA: Italian News Corpus with Emotions and Agreement

English. In this paper, we describe an Italian corpus of news blogs, including bloggers’ emotion tags, and annotations of agreement relations amongst bloggercomment pairs. The main contributions of this work are: the formalization of the agreement relation, the design of guidelines for its annotation, the quantitative analysis of the annotators’ agreement. Italiano. In questo articolo descriviamo la raccolta di un corpus di blog giornalistici in Italiano che include le emozioni etichettate dai blogger e l’annotazione manuale con la relazione di approvazione tra commenti. I contributi principali di questo articolo sono: la formalizzazione della relazione di approvazione, le linee guida per la sua annotazione e l’analisi quantitativa dell’accordo tra annotatori.

[1]  Carlo Strapparava,et al.  SemEval-2007 Task 14: Affective Text , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[2]  M. Walker,et al.  How can you say such things?!?: Recognizing Disagreement in Informal Political Argument , 2011 .

[3]  Malvina Nissim,et al.  Sentiment analysis on Italian tweets , 2013, WASSA@NAACL-HLT.

[4]  Elizabeth Shriberg,et al.  The ICSI Meeting Recorder Dialog Act (MRDA) Corpus , 2004, SIGDIAL Workshop.

[5]  Susan C. Herring,et al.  A Faceted Classification Scheme for Computer-Mediated Discourse , 2007 .

[6]  Marilyn A. Walker,et al.  A Corpus for Research on Deliberation and Debate , 2012, LREC.

[7]  Jacob Andreas,et al.  Annotating Agreement and Disagreement in Threaded Discussion , 2012, LREC.

[8]  Ron Artstein,et al.  Survey Article: Inter-Coder Agreement for Computational Linguistics , 2008, CL.

[9]  Erik Cambria,et al.  SenticNet 2: A Semantic and Affective Resource for Opinion Mining and Sentiment Analysis , 2012, FLAIRS.

[10]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[11]  Klaus krippendorff,et al.  Measuring the Reliability of Qualitative Text Analysis Data , 2004 .

[12]  Emily M. Bender,et al.  Are We There Yet?: The Development of a Corpus Annotated for Social Acts in Multilingual Online Discourse , 2013, Dialogue Discourse.

[13]  J. Fleiss,et al.  The measurement of interrater agreement , 2004 .

[14]  Jonathan T. Morgan,et al.  Annotating Social Acts: Authority Claims and Alignment Moves in Wikipedia Talk Pages , 2011 .