论文信息 - Pair Annotation: Adaption of Pair Programming to Corpus Annotation

Pair Annotation: Adaption of Pair Programming to Corpus Annotation

This paper will introduce a procedure that we call pair annotation after pair programming. We describe initial annotation procedure of the TDB, followed by the inception of the pair annotation idea and how it came to be used in the Turkish Discourse Bank. We discuss the observed benefits and issues encountered during the process, and conclude by discussing the major benefit of pair annotation, namely higher inter-annotator agreement values.

Deniz Zeyrek | Isin Demirsahin | Ihsan Yalcinkaya

[1] Laurie A. Williams,et al. Strengthening the Case for Pair Programming , 2000, IEEE Softw..

[2] Laurie A. Williams,et al. All I really need to know about pair programming I learned in kindergarten , 2000, Commun. ACM.

[3] JacquesLebrun. 人的问题：关于《Peopleware》 , 2002 .

[4] Rashmi Prasad,et al. Annotating Discourse Connectives and Their Arguments , 2004, FCP@NAACL-HLT.

[5] Jr. Frederick P. Brooks,et al. The Mythical Man-Month: Essays on Softw , 1978 .

[6] Fred P. Brooks,et al. The Mythical Man-Month , 1975, Reliable Software.

[7] Jean Carletta,et al. Squibs: Reliability Measurement without Limits , 2008, CL.

[8] Livio Robaldo,et al. The Penn Discourse TreeBank 2.0. , 2008, LREC.

[9] Deniz Zeyrek,et al. Discourse Relation Configurations in Turkish and an Annotation Environment , 2010, Linguistic Annotation Workshop.

[10] Laurie A. Williams,et al. Pair Programming Illuminated , 2002 .

[11] Beata Beigman Klebanov,et al. Squibs: From Annotator Agreement to Noise Models , 2009, CL.

[12] Deniz Zeyrek,et al. The Annotation Scheme of the Turkish Discourse Bank and an Evaluation of Inconsistent Annotations , 2010, Linguistic Annotation Workshop.

[13] Nicholas Asher,et al. Reference to abstract objects in discourse , 1993, Studies in linguistics and philosophy.

[14] Kent L. Beck,et al. Extreme programming explained - embrace change , 1990 .