Prediction of Helpful Reviews Using Emotions Extraction

Reviews keep playing an increasingly important role in the decision process of buying products and booking hotels. However, the large amount of available information can be confusing to users. A more succinct interface, gathering only the most helpful reviews, can reduce information processing time and save effort. To create such an interface in real time, we need reliable prediction algorithms to classify and predict new reviews which have not been voted but are potentially helpful. So far such helpfulness prediction algorithms have benefited from structural aspects, such as the length and readability score. Since emotional words are at the heart of our written communication and are powerful to trigger listeners' attention, we believe that emotional words can serve as important parameters for predicting helpfulness of review text. Using GALC, a general lexicon of emotional words associated with a model representing 20 different categories, we extracted the emotionality from the review text and applied supervised classification method to derive the emotion-based helpful review prediction. As the second contribution, we propose an evaluation framework comparing three different real-world datasets extracted from the most well-known product review websites. This framework shows that emotion-based methods are outperforming the structure-based approach, by up to 9%.

[1]  Yue Lu Exploiting Social Context for Review Quality Prediction , 2010 .

[2]  Xiaohui Yu,et al.  Modeling and Predicting the Helpfulness of Online Reviews , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[3]  Soo-Min Kim,et al.  Automatically Assessing Review Helpfulness , 2006, EMNLP.

[4]  Wolfgang Nejdl,et al.  How useful are your comments?: analyzing and predicting youtube comments and comment ratings , 2010, WWW '10.

[5]  Barry Smyth,et al.  Learning to recommend helpful hotel reviews , 2009, RecSys '09.

[6]  P. Ekman An argument for basic emotions , 1992 .

[7]  Andrew Whinston,et al.  The Dynamics of Online Word-of-Mouth and Product Sales: An Empirical Investigation of the Movie Industry , 2008 .

[8]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[9]  Jahna Otterbacher,et al.  'Helpfulness' in online communities: a measure of message quality , 2009, CHI.

[10]  N. Malhotra Reflections on the Information Overload Paradigm in Consumer Decision Making , 1984 .

[11]  Panagiotis G. Ipeirotis,et al.  Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics , 2010, IEEE Transactions on Knowledge and Data Engineering.

[12]  Barry Smyth,et al.  Using readability tests to predict helpful product reviews , 2010, RIAO.

[13]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[14]  Gary M. Weiss Mining with rarity: a unifying framework , 2004, SKDD.

[15]  Jon M. Kleinberg,et al.  WWW 2009 MADRID! Track: Data Mining / Session: Opinions How Opinions are Received by Online Communities: A Case Study on Amazon.com Helpfulness Votes , 2022 .

[16]  Saif Mohammad,et al.  From Once Upon a Time to Happily Ever After: Tracking Emotions in Novels and Fairy Tales , 2011, LaTeCH@ACL.

[17]  Peter D. Turney Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews , 2002, ACL.

[18]  R. Plutchik A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION , 1980 .

[19]  Qing Cao,et al.  Exploring determinants of voting for the "helpfulness" of online user reviews: A text mining approach , 2011, Decis. Support Syst..

[20]  Peter C. Neijens,et al.  "Highly Recommended!" The Content Characteristics and Perceived Usefulness of Online Consumer Reviews , 2011, J. Comput. Mediat. Commun..

[21]  K. Scherer What are emotions? And how can they be measured? , 2005 .

[22]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[23]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[24]  C. Spearman The proof and measurement of association between two things. , 2015, International journal of epidemiology.

[25]  Pearl Pu,et al.  Are influential writers more objective?: an analysis of emotionality in review comments , 2014, WWW.

[26]  Do-Hyung Park,et al.  eWOM overload and its effect on consumer behavioral intention depending on consumer involvement , 2008, Electron. Commer. Res. Appl..