Named Entity Recognition (NER) is the process of identifying the elementary units in a text document and classifying them into predefined categories such as person, location, organization and so forth. NER plays an important role in many Natural Language Processing applications like information retrieval, question answering, machine translation and so forth. Resolving the ambiguities of lexical items involved in a text document is a challenging task. NER in Indian languages is always a complex task due to their morphological richness and agglutinative nature. Even though different solutions were proposed for NER, it is still an unsolved problem. Traditional approaches to Named Entity Recognition were based on the application of hand-crafted features to classical machine learning techniques such as Hidden Markov Model (HMM), Support Vector Machine (SVM), Conditional Random Field (CRF) and so forth. But the introduction of deep learning techniques to the NER problem changed the scenario, where the state of art results have been achieved using deep learning architectures. In this paper, we address the problem of effective word representation for NER in Indian languages by capturing the syntactic, semantic and morphological information. We propose a deep learning based entity extraction system for Indian languages using a novel combined word representation, including character-level, word-level and affix-level embeddings. We have used ‘ARNEKT-IECSIL 2018’ shared data for training and testing. Our results highlight the improvement that we obtained over the existing pre-trained word representations.
[1]
Hyun Kim,et al.
Improving LSTM CRFs using character-based compositions for Korean named entity recognition
,
2019,
Comput. Speech Lang..
[2]
Nitish Srivastava,et al.
Dropout: a simple way to prevent neural networks from overfitting
,
2014,
J. Mach. Learn. Res..
[3]
Pushpak Bhattacharyya,et al.
Improving NER Tagging Performance in Low-Resource Languages via Multilingual Learning
,
2018,
ACM Trans. Asian Low Resour. Lang. Inf. Process..
[4]
Tome Eftimov,et al.
A rule-based named-entity recognition method for knowledge extraction of evidence-based dietary recommendations
,
2017,
PloS one.
[5]
Flora Amato,et al.
Semantic processing of multimedia data for e-government applications
,
2016,
J. Vis. Lang. Comput..
[6]
Tomas Mikolov,et al.
Enriching Word Vectors with Subword Information
,
2016,
TACL.
[7]
Shuying Shen,et al.
2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text
,
2011,
J. Am. Medical Informatics Assoc..
[8]
Arafat Awajan,et al.
Statistical Arabic Name Entity Recognition Approaches: A Survey
,
2017,
EUSPN/ICTH.
[9]
Jason Weston,et al.
Natural Language Processing (Almost) from Scratch
,
2011,
J. Mach. Learn. Res..