This paper describes an annotation scheme for argumentation in opinionated texts such as newspaper editorials, developed from a corpus of approximately 500 English texts from Nepali and international newspaper sources. We present the results of analysis and evaluation of the corpus annotation ― currently, the inter-annotator agreement kappa value being 0.80 which indicates substantial agreement between the annotators. We also discuss some of linguistic resources (key factors for distinguishing facts from opinions, opinion lexicon, intensifier lexicon, pre-modifier lexicon, modal verb lexicon, reporting verb lexicon, general opinion patterns from the corpus etc.) developed as a result of our corpus analysis, which can be used to identify an opinion or a controversial issue, arguments supporting an opinion, orientation of the supporting arguments and their strength (intrinsic, relative and in terms of persuasion). These resources form the backbone of our work especially for performing the opinion analysis in the lower levels, i.e., in the lexical and sentence levels. Finally, we shed light on the perspectives of the given work clearly outlining the challenges.
[1]
Daniel Marcu,et al.
Building a Discourse-Tagged Corpus in the Framework of Rhetorical Structure Theory
,
2001,
SIGDIAL Workshop.
[2]
M. Taboada,et al.
Discourse relations reference corpus
,
2008
.
[3]
Janyce Wiebe,et al.
Annotating Opinions in the World Press
,
2003,
SIGDIAL Workshop.
[4]
Jonathon Read,et al.
Annotating expressions of Appraisal in English
,
2007,
Language Resources and Evaluation.
[5]
Jeannett Martin,et al.
The Language of Evaluation: Appraisal in English
,
2005
.
[6]
Janyce Wiebe,et al.
Annotating Attributions and Private States
,
2005,
FCA@ACL.
[7]
Claire Cardie,et al.
Evaluating an Opinion Annotation Scheme Using a New Multi-Perspective Question and Answer Corpus
,
2006,
Computing Attitude and Affect in Text.
[8]
Claire Cardie,et al.
Annotating Expressions of Opinions and Emotions in Language
,
2005,
Lang. Resour. Evaluation.