论文信息 - Simple Annotation Tools for Complex Annotation Tasks : an Evaluation

Simple Annotation Tools for Complex Annotation Tasks : an Evaluation

This paper presents a comparative evaluation of ready-to-use, XML-based tools for annotating linguistic data. We start by describing our research project that deals with the creation and annotation of empirical data related to information structure. Based on the requirements of this project and the data, we develop a set of evaluation criteria and apply them in the evaluation of five selected annotation tools.

Stefanie Dipper | Manfred Stede | Michael Götze

[1] Margaret King,et al. Evaluation of natural language processing systems , 1991 .

[2] Thomas C. Schmidt. The transcription system EXMARaLDA: An application of the annotation graph formalism as the basis of a database of multilingual spoken discourse , 2001 .

[3] Michael Strube,et al. MMAX: A Tool for the Annotation of Multi-modal Corpora , 2001, IJCAI 2001.

[4] Ulrike Gut,et al. The TASX-environment: an XML-based toolset for time aligned speech corpora , 2002, LREC.

[5] Constantin Orasan,et al. PALinkA: A highly customisable tool for discourse annotation , 2003, SIGDIAL Workshop.