Chinese Governmental Named Entity Recognition

Named entity recognition (NER) is a fundamental task in natural language processing and there is a lot of interest on vertical NER such as medical NER, short text NER etc. In this paper, we study the problem of Chinese governmental NER (CGNER). CGNER serves as the basis for automatic governmental text analysis, which can greatly benefit the public. Considering the characteristics of the governmental text, we first formulate the task of CGNER, adding one new entity type, i.e., policy (POL) in addition to the generic types such as person (PER), location (LOC), organization (ORG) and title (TIT) for recognition. Then we constructed a dataset called GOV for CGNER. We empirically evaluate the performances of mainstream NER tools and state-of-the-art BiLSTM-CRF method on the GOV dataset. It was found that there is a performance decline compared to applying these methods on generic NER dataset. Further studies show that compound entities account for a non-negligible proportion and using the classical BIO (Begin-Inside-Outside) annotation cannot encode the entity type combination effectively. To alleviate the problem, we propose to utilize the compound tagging and BiLSTM-CRF for doing CGNER. Experiments show that our proposed methods can significantly improve the CGNER performance, especially for the LOC, ORG and TIT entity types.

[1]  Richard M. Schwartz,et al.  Nymble: a High-Performance Learning Name-finder , 1997, ANLP.

[2]  Gina-Anne Levow,et al.  The Third International Chinese Language Processing Bakeoff: Word Segmentation and Named Entity Recognition , 2006, SIGHAN@COLING/ACL.

[3]  Masanori Hattori,et al.  Character-Based LSTM-CRF with Radical-Level Features for Chinese Named Entity Recognition , 2016, NLPCC/ICCPOL.

[4]  Eric Nichols,et al.  Named Entity Recognition with Bidirectional LSTM-CNNs , 2015, TACL.

[5]  Guohong Fu,et al.  Morpheme-based chinese nested named entity recognition , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[6]  Wei Xu,et al.  Bidirectional LSTM-CRF Models for Sequence Tagging , 2015, ArXiv.

[7]  Peng Zhou,et al.  Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme , 2017, ACL.

[8]  Franck Dernoncourt,et al.  NeuroNER: an easy-to-use program for named-entity recognition based on neural networks , 2017, EMNLP.

[9]  Wei Li,et al.  Early results for Named Entity Recognition with Conditional Random Fields, Feature Induction and Web-Enhanced Lexicons , 2003, CoNLL.

[10]  Aixin Sun,et al.  Mobile phone name extraction from internet forums: a semi-supervised approach , 2016, World Wide Web.

[11]  Shuying Shen,et al.  2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text , 2011, J. Am. Medical Informatics Assoc..

[12]  Yuji Matsumoto,et al.  Japanese Named Entity Extraction with Redundant Morphological Analysis , 2003, NAACL.

[13]  Ralph Grishman,et al.  NYU: Description of the MENE Named Entity System as Used in MUC-7 , 1998, MUC.

[14]  Guillaume Lample,et al.  Neural Architectures for Named Entity Recognition , 2016, NAACL.

[15]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[16]  Eduard H. Hovy,et al.  End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF , 2016, ACL.

[17]  Satoshi Sekine,et al.  Description of the Japanese NE System Used for MET-2 , 1998, MUC.

[18]  Ralph Grishman,et al.  Message Understanding Conference- 6: A Brief History , 1996, COLING.