论文信息 - A Gold Standard Corpus of Early Modern German

A Gold Standard Corpus of Early Modern German

This paper describes an annotated gold standard sample corpus of Early Modern German containing over 50,000 tokens of text manually annotated with POS tags, lemmas, and normalised spelling variants. The corpus is the first resource of its kind for this variant of German, and represents an ideal test bed for evaluating and adapting existing NLP tools on historical data. We describe the corpus format, annotation levels, and challenges, providing an example of the requirements and needs of smaller humanities-based corpus projects.

[1] Thorsten Brants,et al. TnT – A Statistical Part-of-Speech Tagger , 2000, ANLP.

[2] D. Biber,et al. Drift and the Evolution of English Style: A History of Three Genres , 1989 .

[3] Helmut Schmidt,et al. Probabilistic part-of-speech tagging using decision trees , 1994 .

[4] Stefanie Dipper. POS-Tagging of Historical Language Data: First Experiments , 2010, KONVENS.

[5] P. Bennett,et al. Annotating a historical corpus of German : A case study , 2010 .

[6] Norbert Fuhr,et al. Generating Search Term Variants for Text Collections with Historic Spellings , 2006, ECIR.

[7] Paul Rayson,et al. VARD2 : a tool for dealing with spelling variation in historical corpora , 2008 .

[8] Wolfram Luther,et al. Automated support for evidence retrieval in documents with nonstandard orthography , 2009 .

[9] Bryan Jurish,et al. Comparing Canonicalizations of Historical German Text , 2010, SIGMORPHON.

[10] Thorsten Brants,et al. Inter-annotator Agreement for a German Newspaper Corpus , 2000, LREC.

[11] Dawn Archer,et al. Tagging the Bard: Evaluating the accuracy of a modern POS tagger on Early Modern English corpora , 2007 .