The purpose of this work is to explore the applicability and effectiveness of deep learning methods for the task–moves recognition in abstract of research paper. We firstly build a large corpus for moves recognition. Then we choose the traditional machine learning method SVM as a benchmark, and develop four moves recognition methods based on DNN, LSTM, Attention-BiLSTM and BERT. Finally, we design two groups of experiments with sample size 10,000 and 50,000 and then compare experimental results. The results show that most of the deep learning methods outperform the traditional machine learning method SVM especially in large-scale sample experiments, in which the BERT with a re-pre-trained model achieves the best results in both groups of experiments. Deep learning methods are proved applicable and effective for moves recognition in research paper abstracts.
[1]
Wayne Trotman.
Research Genres: Explorations and Applications
,
2005
.
[2]
Naoaki Okazaki,et al.
Identifying Sections in Scientific Abstracts using Conditional Random Fields
,
2008,
IJCNLP.
[3]
Alex Graves,et al.
Recurrent Models of Visual Attention
,
2014,
NIPS.
[4]
Ming-Wei Chang,et al.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
,
2019,
NAACL.
[5]
Claire Cardie,et al.
Opinion Mining with Deep Recurrent Neural Networks
,
2014,
EMNLP.
[6]
Michael I. Jordan,et al.
Advances in Neural Information Processing Systems 30
,
1995
.