Relation Detection for Indonesian Language Using Deep Neural Network - Support Vector Machine

Relation Detection is a task to determine whether two entities is related or not. In this paper, we employ neural network to do relation detection between two named entities for Indonesian Language. We used feature such as word embedding, position embedding, POS-Tag embedding, and character embedding. For the model, we divide the model into two parts: Front-part classifier (Convolutional layer or LSTM layer)and Back-part classifier (Dense layer or SVM). We did grid search method of neural network hyper parameter and SVM. We used 6000 Indonesian sentences for training process and 1,125 for testing. The best result is 0.8083 on F1-Score using Convolutional Layer as front-part and SVM as back-part.

[1]  Sergey Brin,et al.  Extracting Patterns and Relations from the World Wide Web , 1998, WebDB.

[2]  Pushpak Bhattacharyya,et al.  Relation Extraction : A Survey , 2017, ArXiv.

[3]  Peng Zhou,et al.  Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max Pooling , 2016, COLING.

[4]  Zhiyuan Liu,et al.  A C-LSTM Neural Network for Text Classification , 2015, ArXiv.

[5]  Ayu Purwarianti,et al.  Relation extraction using dependency tree kernel for Bahasa Indonesia , 2016, 2016 International Conference On Advanced Informatics: Concepts, Theory And Application (ICAICTA).

[6]  Ralph Grishman,et al.  Relation Extraction: Perspective from Convolutional Neural Networks , 2015, VS@HLT-NAACL.

[7]  ITO WASITO,et al.  A novel rule based approach for entity relations extraction , 2015 .

[8]  Wiwin Suwarningsih,et al.  Relation extraction with tree kernel for Indonesian sentences , 2014, 2014 International Conference on ICT For Smart Society (ICISS).

[9]  Naoaki Okazaki,et al.  Fast and Large-scale Unsupervised Relation Extraction , 2015, PACLIC.

[10]  Xuanjing Huang,et al.  Recurrent Neural Network for Text Classification with Multi-Task Learning , 2016, IJCAI.

[11]  Zhoujun Li,et al.  Ensemble Neural Relation Extraction with Adaptive Boosting , 2018, IJCAI.

[12]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[13]  Jian Su,et al.  Exploring Various Knowledge in Relation Extraction , 2005, ACL.

[14]  Nanda Kambhatla,et al.  Combining Lexical, Syntactic, and Semantic Features with Maximum Entropy Models for Information Extraction , 2004, ACL.