论文信息 - Methods for the Qualitative Evaluation of Lexical Association Measures

Methods for the Qualitative Evaluation of Lexical Association Measures

This paper presents methods for a qualitative, unbiased comparison of lexical association measures and the results we have obtained for adjective-noun pairs and preposition-noun-verb triples extracted from German corpora. In our approach, we compare the entire list of candidates, sorted according to the particular measures, to a reference set of manually identified "true positives". We also show how estimates for the very large number of hapaxlegomena and double occurrences can be inferred from random samples.

Stefan Evert | Brigitte Krenn | S. Evert | Brigitte Krenn

[1] Hinrich Schütze,et al. Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[2] Adam Kilgarriff,et al. Which words are particularly characteristic of a text? a survey of statistical approaches , 1996 .

[3] John Nerbonne. Lexikon der Sprachwissenschaft , 1984 .

[4] S. Evert,et al. Can we do better than frequency ? A case study on extracting PP-verb collocations , 2001 .

[5] Brigitte Krenn,et al. The usual suspects: data-oriented models for identification und representation of lexical collocations , 1999 .

[6] Helmut Schmid,et al. Improvements in Part-of-Speech Tagging with an Application to German , 1999 .

[7] Ted Dunning,et al. Accurate Methods for the Statistics of Surprise and Coincidence , 1993, CL.

[8] Stefan Evert,et al. Methoden zum qualitativen Vergleich von Signifikanzmaßen zur Kollokationsidentifikation , 2000, KONVENS.

[9] Marc Weeber,et al. Extracting the lowest-frequency words: pitfalls and possibilities , 2000, CL.

[10] Kenneth Ward Church,et al. Word Association Norms, Mutual Information, and Lexicography , 1989, ACL.

[11] Ted Pedersen,et al. Fishing for Exactness , 1996, ArXiv.