Spatial Role Labeling based on Improved Pre-trained Word Embeddings and Transfer Learning

Abstract In several real-world applications, extracting spatial semantics from text is critical. Spatial Role Labeling (SpRL) introduces a language-independent annotation scheme used in these applications, particularly for reasoning purposes. This paper proposes, first of all, a transfer learning method with a word embeddings-based approach for SpRL. Then, we enhance the word vectors with POS tags and CNN-based character-level representations. Finally, we propose a Residual BiLSTM CRF deep learning model to identify the spatial roles. The experimental results on two datasets: SemEval-2012 and SemEval-2013 Task 3, show that the proposed model outperforms other machine learning approaches.