Cascaded RBF-CBiLSTM for Arabic Named Entity Recognition

In this paper, an Arabic dataset known as ANERCorp is classified into three name entities: Person, Location, and Organization. This classification process aims to design a model that used to facilitate the searching tasks of the Arabic named entities. The classification process was done by proposing a hybrid model which consists of Radial Basis Function (RBF) cascaded with a sequential Convolutional Neural Network (CNN) and Bidirectional Long-Short Term Memory (BiLSTM). The performance of the proposed model was compared with stand-alone machine learning models: Multilayer Perceptron (MLP), K-Nearest Neighbors (KNN), Naïve Bayes (NB), Support Vector Machine (SVM), RBF, CNN, and BiLSTM. In addition, the performance of the hybrid model was compared with models from the literature. The attained results show that the proposed model outperforms the other stand-alone models and the models from the literature in term of precision, recall, and F1-score.

[1]  Khaled Shaalan,et al.  A hybrid approach to Arabic named entity recognition , 2014, J. Inf. Sci..

[2]  Ashraf Elnagar,et al.  Automatic Arabic Dialect Classification Using Deep Learning Models , 2018, ACLING.

[3]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[4]  Ashraf Elnagar,et al.  BRAD 1.0: Book reviews in Arabic dataset , 2016, 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA).

[5]  Danny Ho,et al.  A comparison between decision trees and decision tree forest models for software development effort estimation , 2013, 2013 Third International Conference on Communications and Information Technology (ICCIT).

[6]  Ismail Shahin,et al.  Novel cascaded Gaussian mixture model-deep neural network classifier for speaker identification in emotional talking environments , 2018, Neural Computing and Applications.

[7]  Anca L. Ralescu,et al.  Confusion Matrix-based Feature Selection , 2011, MAICS.

[8]  Guanzheng Tan,et al.  Boosting Arabic Named-Entity Recognition With Multi-Attention Layer , 2019, IEEE Access.

[9]  Yaser Jararweh,et al.  Transfer Learning for Arabic Named Entity Recognition With Deep Neural Networks , 2020, IEEE Access.

[10]  Shu Yang,et al.  A survey on application of machine learning for Internet of Things , 2018, International Journal of Machine Learning and Cybernetics.

[11]  Mohammed Attia,et al.  GHHT at CALCS 2018: Named Entity Recognition for Dialectal Arabic Using Neural Networks , 2018, CodeSwitch@ACL.

[12]  Ismail Shahin,et al.  Emotion Recognition Using Hybrid Gaussian Mixture Model and Deep Neural Network , 2019, IEEE Access.

[13]  Khaled Shaalan,et al.  Arabic Named Entity Recognition from Diverse Text Types , 2008, GoTAL.

[14]  Khaled Shaalan,et al.  Speech Recognition Using Deep Neural Networks: A Systematic Review , 2019, IEEE Access.

[15]  Khaled Shaalan,et al.  A Novel Hybrid Approach to Arabic Named Entity Recognition , 2014 .

[16]  Abdallah Shami,et al.  Bayesian Optimization with Machine Learning Algorithms Towards Anomaly Detection , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[17]  Guanzheng Tan,et al.  Bidirectional Encoder–Decoder Model for Arabic Named Entity Recognition , 2019, Arabian Journal for Science and Engineering.

[18]  Mourad Gridach,et al.  Character-Aware Neural Networks for Arabic Named Entity Recognition for Social Media , 2016, WSSANLP@COLING.

[19]  Ashraf Elnagar,et al.  Arabic text classification using deep learning models , 2020, Inf. Process. Manag..

[20]  Fredric C. Gey,et al.  The Relationship between Recall and Precision , 1994, J. Am. Soc. Inf. Sci..

[21]  Slim Abdennadher,et al.  Arabic Name Entity Recognition Using Deep Learning , 2018, SLSP.

[22]  Guanzheng Tan,et al.  Bidirectional Recurrent Neural Network Approach for Arabic Named Entity Recognition , 2018, Future Internet.

[23]  Yassine Benajiba,et al.  Arabic Named Entity Recognition using Conditional Random Fields , 2008 .

[24]  Sreekanth Madisetty,et al.  Aggression Detection in Social Media using Deep Neural Networks , 2018, TRAC@COLING 2018.

[25]  Ashraf Elnagar,et al.  Arabic audio clips: Identification and discrimination of authentic Cantillations from imitations , 2020, Neurocomputing.

[26]  Alain Abran,et al.  On the value of parameter tuning in heterogeneous ensembles effort estimation , 2017, Soft Computing.

[27]  Yassine Benajiba,et al.  ANERsys 2.0: Conquering the NER Task for the Arabic Language by Combining the Maximum Entropy with POS-tag Information , 2007, IICAI.