An Attention Model of Customer Expectation to Improve Review Helpfulness Prediction

Many people browse reviews online before making purchasing decisions. It is essential to identify the subset of helpful reviews from the large number of reviews of varying quality. This paper aims to build a model to predict review helpfulness automatically. Our work is inspired by the observation that a customer’s expectation of a review can be greatly affected by review sentiment and the degree to which the customer is aware of pertinent product information. Consequently, a customer may pay more attention to that specific content of a review which contributes more to its helpfulness from their perspective. To model such customer expectations and capture important information from a review text, we propose a novel neural network which leverages review sentiment and product information. Specifically, we encode the sentiment of a review through an attention module, to get sentiment-driven information from review text. We also introduce a product attention layer that fuses information from both the target product and related products, in order to capture the product related information from review text. Our experimental results show an AUC improvement of 5.4% and 1.5% over the previous state of the art model on Amazon and Yelp data sets, respectively.

[1]  Vincent Ng,et al.  Modeling and Prediction of Online Product Review Helpfulness: A Survey , 2018, ACL.

[2]  Diane J. Litman,et al.  Automatically Predicting Peer-Review Helpfulness , 2011, ACL.

[3]  Xi Liu,et al.  A Dynamic Neural Network Model for Click-Through Rate Prediction in Real-Time Bidding , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[4]  SchuffDavid,et al.  What makes a helpful online review? a study of customer reviews on amazon.com , 2010 .

[5]  Yue Lu,et al.  Exploiting social context for review quality prediction , 2010, WWW '10.

[6]  Alessandro Moschitti,et al.  Twitter Sentiment Analysis with Deep Convolutional Neural Networks , 2015, SIGIR.

[7]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[8]  Ido Dagan,et al.  context2vec: Learning Generic Context Embedding with Bidirectional LSTM , 2016, CoNLL.

[9]  Xiang Zhang,et al.  Character-level Convolutional Networks for Text Classification , 2015, NIPS.

[10]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[11]  Hao Wang,et al.  Using Argument-based Features to Predict and Analyse Review Helpfulness , 2017, EMNLP.

[12]  Pearl Pu,et al.  Prediction of Helpful Reviews Using Emotions Extraction , 2014, AAAI.

[13]  Ming Zhou,et al.  Low-Quality Product Review Detection in Opinion Summarization , 2007, EMNLP.

[14]  Miao Fan,et al.  Product-Aware Helpfulness Prediction of Online Reviews , 2019, WWW.

[15]  Soo-Min Kim,et al.  Automatically Assessing Review Helpfulness , 2006, EMNLP.

[16]  Jun Zhou,et al.  Multi-Domain Gated CNN for Review Helpfulness Prediction , 2019, WWW.

[17]  Julian J. McAuley,et al.  Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering , 2016, WWW.

[18]  Xiang Zhang,et al.  Text Understanding from Scratch , 2015, ArXiv.

[19]  Barry Smyth,et al.  Learning to recommend helpful hotel reviews , 2009, RecSys '09.

[20]  Guodong Zhou,et al.  What reviews are satisfactory: novel features for automatic helpfulness voting , 2012, SIGIR '12.

[21]  Tong Zhang,et al.  Effective Use of Word Order for Text Categorization with Convolutional Neural Networks , 2014, NAACL.

[22]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[23]  Gerhard Weikum,et al.  Exploring Latent Semantic Factors to Find Useful Product Reviews , 2017, SDM.

[24]  Jun Zhou,et al.  Cross-Domain Review Helpfulness Prediction Based on Convolutional Neural Networks with Auxiliary Domain Discriminators , 2018, NAACL.

[25]  Xiaopeng Li,et al.  Review Helpfulness Assessment based on Convolutional Neural Network , 2018, ArXiv.

[26]  Miao Fan,et al.  Multi-Task Neural Learning Architecture for End-to-End Identification of Helpful Reviews , 2018, 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[27]  Huan Liu,et al.  Context-aware review helpfulness rating prediction , 2013, RecSys.

[28]  Zhen Wu,et al.  Improving Review Representations with User Attention and Product Attention for Sentiment Classification , 2018, AAAI.

[29]  Forrest Sheng Bao,et al.  Semantic Analysis and Helpfulness Prediction of Text for Online Product Reviews , 2015, ACL.

[30]  David C. Yen,et al.  A study of factors that contribute to online review helpfulness , 2015, Comput. Hum. Behav..