论文信息 - Named Entity Recognition through Redundancy Driven Classifiers

Named Entity Recognition through Redundancy Driven Classifiers

We present Typhoon, a classifier combination system for Named Entity Recognition (NER), in which two different classifiers are combined to exploit Data Redundancy and Patterns extracted from a large text corpus. Data Redundancy is attained when the same entity occurs in different places in documents, whereas Patterns are 2-grams, 3-grams, 4-grams and 5-grams preceding, and following entities in documents. The system consists of two classifiers in cascade, but it is possible to use a single classifier making the system faster (100 times faster, with a speed rate of about 20,000 tokens/sec); whereas the second classifier in the cascade can be used when more accuracy is needed. Moreover the system can use additional features such as that given by using a Text Classifier able to recognize the category to which the story belongs. The system performed the best on the task of Italian NER at EVALITA 2009, with an F1 of 0.82.

Roberto Zanoli | E. Pianta | C. Giuliano

[1] Marc Moens,et al. Description of the LTG System Used for MUC-7 , 1998, MUC.

[2] Ralph Grishman,et al. A Maximum Entropy Approach to Named Entity Recognition , 1999 .

[3] Andrew McCallum,et al. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[4] Hwee Tou Ng,et al. Named Entity Recognition: A Maximum Entropy Approach Using Global Information , 2002, COLING.

[5] Wei Li,et al. Early results for Named Entity Recognition with Conditional Random Fields, Feature Induction and Web-Enhanced Lexicons , 2003, CoNLL.

[6] Richard M. Schwartz,et al. An Algorithm that Learns What's in a Name , 1999, Machine Learning.

[7] Emanuele Pianta,et al. TAGPRO: UN SISTEMA PER IL POS- TAGGING DELL'ITALIANO BASATO SU SVM TAGPRO: A SYSTEM FOR ITALIAN POS TAGGING BASED ON SVM , 2007 .