论文信息 - Evaluation of named entity recognition tools on microposts

Evaluation of named entity recognition tools on microposts

In this paper we evaluate eight well-known Information Extraction (IE) tools on a task of Named Entity Recognition (NER) in microposts. We have chosen six NLP tools and two Wikipedia concept extractors for the evaluation. Our intent was to see how these tools would perform on relatively short texts of microposts. Evaluation dataset has been adopted from the MSM 2013 IE Challenge. This dataset contained manually annotated microposts with classification restricted to four entity types: PER, LOC, ORG and MISC.

[1] Kalina Bontcheva,et al. Text Processing with GATE , 2011 .

[2] Satoshi Sekine,et al. A survey of named entity recognition and classification , 2007 .

[3] Oren Etzioni,et al. Named Entity Recognition in Tweets: An Experimental Study , 2011, EMNLP.

[4] Hyoil Han,et al. Survey of semantic annotation platforms , 2005, SAC '05.

[5] Dan Roth,et al. Design Challenges and Misconceptions in Named Entity Recognition , 2009, CoNLL.

[6] Brian Locke. Named Entity Recognition : Adapting to Microblogging , 2009 .

[7] Doug Downey,et al. Local and Global Algorithms for Disambiguation to Wikipedia , 2011, ACL.

[8] Christopher D. Manning,et al. Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling , 2005, ACL.

[9] Andrew McCallum,et al. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.