IGGSA-STEPS: Shared Task on Source and Target Extraction from Political Speeches

Accurate opinion mining requires the exact identification of the source and target of an opinion. To evaluate diverse tools, the research community relies on the existence of a gold standard corpus covering this need. Since such a corpus is currently not available for German, the Interest Group on German Sentiment Analysis decided to create such a resource and make it available to the research community in the context of a shared task. In this paper, we describe the selection of textual sources, development of annotation guidelines, and first evaluation results in the creation of a gold standard corpus for the German language.

[1]  Matt Thomas,et al.  Get out the vote: Determining support or opposition from Congressional floor-debate transcripts , 2006, EMNLP.

[2]  Yves Scherrer,et al.  Natural Language Processing for the Swiss German Dialect Area , 2010, KONVENS.

[3]  Dan Klein,et al.  Improved Inference for Unlexicalized Parsing , 2007, NAACL.

[4]  Hsin-Hsi Chen,et al.  Overview of Multilingual Opinion Analysis Task at NTCIR-8: A Step Toward Cross Lingual Opinion Analysis , 2010, NTCIR.

[5]  Claire Cardie,et al.  Topic Identification for Fine-Grained Opinion Analysis , 2008, COLING.

[6]  Katrin Erk,et al.  SALTO - A Versatile Multi-Level Annotation Tool , 2006, LREC.

[7]  Carlo Strapparava,et al.  CORPS: A Corpus of Tagged Political Speeches for Persuasive Communication Processing , 2008 .

[8]  Isa Maks,et al.  A verb lexicon model for deep sentiment analysis and opinion mining applications , 2011, WASSA@ACL.

[9]  Peng Jin,et al.  SemEval-2010 task 18: disambiguating sentiment ambiguous adjectives , 2010, SemEval@ACL.

[10]  Hsin-Hsi Chen,et al.  Overview of Opinion Analysis Pilot Task at NTCIR-6 , 2007, NTCIR.

[11]  Helmut Schmidt,et al.  Probabilistic part-of-speech tagging using decision trees , 1994 .

[12]  Simon Clematide,et al.  MLSA - A Multi-layered Reference Corpus for German Sentiment Analysis , 2012, LREC.

[13]  Adrien Barbaresi German Political Speeches - Corpus and Visualization , 2012 .

[14]  Hsin-Hsi Chen,et al.  Overview of Multilingual Opinion Analysis Task at NTCIR-7 , 2008, NTCIR.

[15]  Kiril Ivanov Simov,et al.  The Political Speech Corpus of Bulgarian , 2012, LREC.

[16]  Isa Maks,et al.  A lexicon model for deep sentiment analysis and opinion mining applications , 2012, Decis. Support Syst..

[17]  Swapna Somasundaran,et al.  Finding the Sources and Targets of Subjective Expressions , 2008, LREC.

[18]  Jan Svartvik,et al.  A __ comprehensive grammar of the English language , 1988 .

[19]  Claire Cardie,et al.  Annotating Expressions of Opinions and Emotions in Language , 2005, Lang. Resour. Evaluation.

[20]  Gertrud Faaß,et al.  SdeWaC - A Corpus of Parsable Sentences from the Web , 2013, GSCL.

[21]  Carlo Strapparava,et al.  SemEval-2007 Task 14: Affective Text , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[22]  Preslav Nakov,et al.  SemEval-2013 Task 2: Sentiment Analysis in Twitter , 2013, *SEMEVAL.