Evaluation of Named Entity Features for Punjabi Language

Abstract Named entity recognition is a task to identify and classify the words in the given text to some predetermined categories like Organization, Location, Time, Number, Person etc. In this paper, NER system for Punjabi language has been evaluated on various combinations of features including context word window feature of 3, 5 and 7, various digit features, infrequent word and length of word features. After evaluation it has been found that the feature set comprising of word window 5, digit features, Infrequent word and Length of word feature has confirmed the highest f-score value of 87.46% with Precision and Recall values of 90.99% and 84.19% respectively. It has been realized that the feature set consisting of all language independent features give better results with word window 5 as compared to word window 3 and 7.

[1]  Dipti Misra Sharma,et al.  Aggregating Machine Learning and Rule Based Heuristics for Named Entity Recognition , 2008, IJCNLP.

[2]  Anil Kumar Singh,et al.  Named Entity Recognition for South and South East Asian Languages: Taking Stock , 2008, IJCNLP.

[3]  Vasudeva Varma,et al.  Experiments in Telugu NER: A Conditional Random Field Approach , 2008, IJCNLP.

[4]  Bidyut Baran Chaudhuri,et al.  An Experiment on Automatic Detection of Named Entities in Bangla , 2008, IJCNLP.

[5]  Pabitra Mitra,et al.  A Hybrid Named Entity Recognition System for South and South East Asian Languages , 2008, IJCNLP.

[6]  Erik F. Tjong Kim Sang,et al.  Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition , 2003, CoNLL.

[7]  Sivaji Bandyopadhyay,et al.  Bengali Named Entity Recognition Using Support Vector Machine , 2008, IJCNLP.

[8]  Satoshi Sekine,et al.  Extended Named Entity Hierarchy , 2002, LREC.

[9]  Lilly Suriani Affendey,et al.  Named entity recognition approaches , 2008 .

[10]  Hitoshi Isahara,et al.  IREX: IR & IE Evaluation Project in Japanese , 2000, LREC.

[11]  Sivaji Bandyopadhyay,et al.  Language Independent Named Entity Recognition in Indian Languages , 2008, IJCNLP.

[12]  Ralph Grishman,et al.  A Maximum Entropy Approach to Named Entity Recognition , 1999 .

[13]  Kavi Narayana Murthy,et al.  Named Entity Recognition for Telugu , 2008, IJCNLP.

[14]  Amandeep Kaur,et al.  Improved Named Entity Tagset for Punjabi Language , 2014, 2014 Recent Advances in Engineering and Computational Sciences (RAECS).

[15]  Ralph Grishman,et al.  Message Understanding Conference- 6: A Brief History , 1996, COLING.