MF-COTE: A chinese opinion target extraction model based on multiple features

Recently, deep learning methods have been applied to deal with the opinion target extraction (OTE) task with fruitful achievements. On the other hand, since the features captured by the embedding layer can make a multiple-perspective analysis from a sentence, an embedding layer that can grasp the high-level semantics of the sentences is of essence for processing the OTE task and can improve the performance of model into a more efficient manner. However, most of the existing studies focused on the network structure rather than the significant embedded layer, which may be the fundamental reason for the problem of relatively poor performance in this field, not mention the Chinese extraction model. To compensate these shortcomings, this paper proposes a model using multiple effective features and Bidirectional Encoder Representations from Transformers (BERT) on the architecture of Bidirectional Long Short-Term Memory (BiLSTM) and Conditional Random Field (CRF) for Chinese opinion target extraction task, namely MF-COTE, which can construct features from different perspectives to capture the context and local features of the sentences. Besides, to handle the difficult case of multiple nouns in one sentence, we innovatively propose noting words feature to regulate the model emphasize on the noun near the transition or contrast word, thus leading a better opinion target location. Moreover, to demonstrate the superiorities of the proposed model, extensive comparison experiments are systematically conducted compared with other existing state-of-the-art methods, with the F1-score of 90.76%, 92.10%, 89.63% on the Baidu, the Dianping, and the Mafengwo dataset, respectively.

[1]  Zhan-Yang Xu,et al.  A Clustering Sleep Scheduling Mechanism Based on Sentinel Nodes Monitor for WSN , 2015 .

[2]  Xiang Ren,et al.  Empower Sequence Labeling with Task-Aware Neural Language Model , 2017, AAAI.

[3]  Hao Yu,et al.  Opinion Analysis of Product Reviews , 2009, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.

[4]  Raymond Y. K. Lau,et al.  Product aspect extraction supervised with online domain knowledge , 2014, Knowl. Based Syst..

[5]  Liang Liu,et al.  Automatic Detection of Pornographic and Gambling Websites Based on Visual and Textual Content Using a Decision Mechanism , 2020, Sensors.

[6]  Xiaokui Xiao,et al.  Coupled Multi-Layer Attentions for Co-Extraction of Aspect and Opinion Terms , 2017, AAAI.

[7]  Erik Cambria,et al.  Aspect extraction for opinion mining with a deep convolutional neural network , 2016, Knowl. Based Syst..

[8]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[9]  Xiaojun Wan,et al.  CMiner: Opinion Extraction and Summarization for Chinese Microblogs , 2016, IEEE Transactions on Knowledge and Data Engineering.

[10]  Wenwen Li,et al.  Chinese Syntactic and Typological Properties Based on Dependency Syntactic Treebanks , 2009 .

[11]  Yuefeng Li,et al.  Aspect-Based Opinion Extraction from Customer reviews , 2014, CSE 2014.

[12]  Pin Yang,et al.  An Automatic Generation Approach of the Cyber Threat Intelligence Records Based on Multi-Source Information Fusion , 2021, Future Internet.

[13]  Heng Yang,et al.  A Multi-task Learning Model for Chinese-oriented Aspect Polarity Classification and Aspect Term Extraction , 2021, Neurocomputing.

[14]  Xiuchun Xiao,et al.  Modified gradient neural networks for solving the time-varying Sylvester equation with adaptive coefficients and elimination of matrix inversion , 2020, Neurocomputing.

[15]  Chun Chen,et al.  Opinion Word Expansion and Target Extraction through Double Propagation , 2011, CL.

[16]  Ahmad Baraani-Dastjerdi,et al.  Enriched LDA (ELDA): Combination of latent Dirichlet allocation with word co-occurrence analysis for aspect extraction , 2017, Expert Syst. Appl..

[17]  Yan Zhao,et al.  Effect Research of Aspects Extraction for Chinese Hotel Reviews Based on Machine Learning Method , 2015 .

[18]  Zhao Tie Extraction of Opinion Targets Based on Shallow Parsing Features , 2011 .

[19]  Yu-N Cheah,et al.  Sequential patterns rule-based approach for opinion target extraction from customer reviews , 2019, J. Inf. Sci..