Integrating Neural and Syntactic Features on the Helpfulness Analysis of the Online Customer Reviews

Before purchasing a product online, customers often read the reviews posted by people who also brought the product. Customer reviews provide opinions and relevant information such as comparisons among similar products or usage experiences about the product. Previous studies addressed on the prediction of the helpfulness of customer reviews to predict the helpfulness voting results. However, the voting result of an online review is not a constant over time; predicting the voting result based on the analysis of text is not practical. Therefore, we collect the voting results of the same online customer review over time, and observe whether the number of votes will increase or not. We construct a dataset with 10,195 online reviews in six different product categories (Computer Hardware, Drink, Makeup, Pen, Shoes, and Toys) from Amazon.cn with the voting result on the helpfulness of the reviews, and monitor the helpfulness voting in six weeks. Experiments are conducted on the dataset to predict whether the helpfulness voting result of each review will increase or not. We propose a classification system that can classify the online reviews into more helpful ones, based on a set of syntactic features and neural features trained via CNN. The results show that integrating the syntactic features with the neural features can get better result.

[1]  Hongyan Liu,et al.  Extracting Feature and Opinion Words Effectively from Chinese Product Reviews , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[2]  Yue Lu,et al.  Exploiting social context for review quality prediction , 2010, WWW '10.

[3]  Chia Chun Shih,et al.  Using Chinese part-of-speech patterns for sentiment phrase identification and opinion extraction in user generated reviews , 2010, 2010 Fifth International Conference on Digital Information Management (ICDIM).

[4]  Jin Zhang,et al.  An empirical study of sentiment analysis for chinese documents , 2008, Expert Syst. Appl..

[5]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[6]  Vitaly Klyuev,et al.  SVR-based outlier detection and its application to hotel ranking , 2014, 2014 IEEE 6th International Conference on Awareness Science and Technology (iCAST).

[7]  Wenji Mao,et al.  Extracting opinion explanations from Chinese online reviews , 2012, 2012 IEEE International Conference on Intelligence and Security Informatics.

[8]  Shih-Hung Wu,et al.  Temporal Model of the Online Customer Review Helpfulness Prediction , 2017, ASONAM.

[9]  Xiaoyong Du,et al.  Analogical Reasoning on Chinese Morphological and Semantic Relations , 2018, ACL.

[10]  Jo Mackiewicz,et al.  Product Review Users' Perceptions of Review Quality: The Role of Credibility, Informativeness, and Readability , 2014, IEEE Transactions on Professional Communication.

[11]  Jun Iio.  Evaluating the Usefulness of Online Reviews , 2012, 2012 15th International Conference on Network-Based Information Systems.

[12]  Aoying Zhou,et al.  Online evaluation re-scoring based on review behavior analysis , 2014, 2014 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2014).

[13]  Tsun Ku,et al.  Modeling the Helpful Opinion Mining of Online Consumer Reviews as a Classification Problem , 2013, ROCLING/IJCLCLP.

[14]  Jiayin Qi,et al.  Mining Customer Requirement from Helpful Online Reviews , 2014, 2014 Enterprise Systems Conference.

[15]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[16]  Xiaojun Li,et al.  A sentiment analysis model for hotel reviews based on supervised learning , 2011, 2011 International Conference on Machine Learning and Cybernetics.

[17]  Wang Hui-po.  The evolution analysis of the opinion network of Chinese farmers' adoption of mobile commerce , 2013, 2013 International Conference on Management Science and Engineering 20th Annual Conference Proceedings.