A New Dataset and Evaluation for Belief/Factuality

The terms “belief” and “factuality” both refer to the intention of the writer to present the propositional content of an utterance as firmly believed by the writer, not firmly believed, or having some other status. This paper presents an ongoing annotation effort and an associated evaluation.

[1]  Weiwei Guo,et al.  Committed Belief Annotation and Tagging , 2009, Linguistic Annotation Workshop.

[2]  Sergei Nirenburg,et al.  Mood and modality: out of theory and into the fray , 2004, Nat. Lang. Eng..

[3]  Michael Potter.  Facts , 2014, The Rise of Analytic Philosophy 1879–1930.

[4]  Owen Rambow,et al.  Committed Belief Tagging on the Factbank and LU Corpora: A Comparative Study , 2015 .

[5]  Mark A. Przybocki,et al.  The Automatic Content Extraction (ACE) Program – Tasks, Data, and Evaluation , 2004, LREC.

[6]  János Csirik,et al.  The CoNLL-2010 Shared Task: Learning to Detect Hedges and their Scope in Natural Language Text , 2010, CoNLL Shared Task.

[7]  Valentina Harizanov,et al.  Formal Approaches to Modality , 2005 .

[8]  Michael E. Bratman,et al.  Intention, Plans, and Practical Reason , 1991 .

[9]  Carlo Strapparava,et al.  The Lie Detector: Explorations in the Automatic Recognition of Deceptive Language , 2009, ACL.

[10]  Arnim von Stechow,et al.  Semantik : ein internationales Handbuch der zeitgenössischen Forschung = Semantics : an international handbook of contemporary research , 1991 .

[11]  Claire Cardie,et al.  Finding Deceptive Opinion Spam by Any Stretch of the Imagination , 2011, ACL.

[12]  Christine D. Piatko,et al.  A Modality Lexicon and its use in Automatic Tagging , 2010, LREC.

[13]  Nina Wacholder,et al.  Identifying Sarcasm in Twitter: A Closer Look , 2011, ACL.

[14]  Julia Hirschberg,et al.  Hedging and Speaker Commitment , 2014 .

[15]  Claire Cardie,et al.  Annotating Expressions of Opinions and Emotions in Language , 2005, Lang. Resour. Evaluation.

[16]  James Pustejovsky,et al.  Are You Sure That This Happened? Assessing the Factuality Degree of Events in Text , 2012, CL.

[17]  Owen Rambow,et al.  Automatic Committed Belief Tagging , 2010, COLING.

[18]  Philipp Koehn,et al.  Abstract Meaning Representation for Sembanking , 2013, LAW@ACL.

[19]  Mitchell P. Marcus,et al.  Adding Semantic Annotation to the Penn TreeBank , 1998 .

[20]  John B. Lowe,et al.  The Berkeley FrameNet Project , 1998, ACL.

[21]  Christine D. Piatko,et al.  Statistical Modality Tagging from Rule-based Annotations and Crowdsourcing , 2012, ExProM@ACL.