Reviews' length and sentiment as correlates of online reviews' ratings

The purpose of this paper is twofold: first, to identify and validate reviews’ length and sentiment as correlates of online reviews’ ratings; and second, to understand the emotions embedded in online reviews and how they associate with specific words used in such reviews.,A panel data set of customer reviews was collected for auto, life, and home insurance from January 2012 to December 2015 using a web scraping technique. Using a sentiment analysis approach, 1,584 reviews for the auto, home, and life insurance services of 156 insurance companies were analyzed.,The results indicate that, since 2013, consumers have generally had more negative emotions than positive ones toward insurance services. The results also show that consumer review sentiment correlates positively and review length correlates negatively with consumer online review ratings. Furthermore, a two-way ANOVA analysis shows that, in general, short reviews with positive sentiment are associated with high review ratings.,The findings of this study provide service companies, in general, and insurance companies, in particular, with important guidelines that should be considered to increase consumers’ positive attitude toward their services.,This paper highlights the importance of sentiment analysis in identifying consumer reviews’ emotions and understanding the associations and interactions of reviews’ length and sentiment on online review rating, which can lead to improved marketing strategies.

[1]  C. W. Park,et al.  Consumer Response to Television Commercials: The Impact of Involvement and Background Music on Brand Attitude Formation , 1986 .

[2]  Tao Zhou,et al.  Understanding Online Community User Participation: A Social Influence Perspective , 2011, Internet Res..

[3]  Freimut Bodendorf,et al.  Mining Consumer Dialog in Online Forums , 2012, Internet Res..

[4]  K. Vohs,et al.  Case Western Reserve University , 1990 .

[5]  R. Schindler,et al.  Perceived Helpfulness of Online Consumer Reviews: The Role of Message Content and Style , 2010 .

[6]  Mira Lee,et al.  Effects of Valence and Extremity of eWOM on Attitude toward the Brand and Website , 2009 .

[7]  Desheng Dash Wu,et al.  Using text mining and sentiment analysis for online forums hotspot detection and forecast , 2010, Decis. Support Syst..

[8]  Hang Zhou,et al.  Examining the influence of online retailers' micro-blogs on consumers' purchase intention , 2017, Internet Res..

[9]  Rob Malouf,et al.  Taking sides: user classification for informal online political discourse , 2008, Internet Res..

[10]  Jacob Goldenberg,et al.  Mine Your Own Business: Market-Structure Surveillance Through Text Mining , 2012, Mark. Sci..

[11]  Bernard Rimé,et al.  Long-lasting Cognitive and Social Consequences of Emotion: Social Sharing and Rumination , 1992 .

[12]  Mohammad Salehan,et al.  Predicting the performance of online consumer reviews: A sentiment mining approach to big data analytics , 2014, Decis. Support Syst..

[13]  Xiaowen Xu,et al.  Effectiveness of online consumer reviews: The influence of valence, reviewer ethnicity, social distance and source trustworthiness , 2017, Internet Res..

[14]  Ronen Feldman,et al.  Techniques and applications for sentiment analysis , 2013, CACM.

[15]  Khaled Hassanein,et al.  Consumers' Attitude toward Insurance Companies: A Sentiment Analysis of Online Consumer Reviews , 2016, AMCIS.

[16]  Jonah Berger,et al.  Positive Effects of Negative Publicity: When Negative Reviews Increase Sales , 2009, Mark. Sci..

[17]  Hsi-Peng Lu,et al.  Understanding intention to continuously share information on weblogs , 2007, Internet Res..

[18]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[19]  Do-Hyung Park,et al.  eWOM overload and its effect on consumer behavioral intention depending on consumer involvement , 2008, Electron. Commer. Res. Appl..

[20]  Maryam Ghasemaghaei,et al.  Identifying the Conditions under Which Online Reviews Translate into Product Sales: A Sentiment Analysis Approach , 2017, AMCIS.

[21]  Angelika Dimoka,et al.  The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for Trust Building, Price Premiums, and Seller Differentiation , 2006, Inf. Syst. Res..

[22]  Stephen J. Hoch,et al.  Ambiguity, Processing Strategy, and Advertising-Evidence Interactions , 1989 .

[23]  JoongHo Ahn,et al.  Helpfulness of Online Consumer Reviews: Readers' Objectives and Review Cues , 2012, Int. J. Electron. Commer..

[24]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[25]  Ling Liu,et al.  Do online reviews affect product sales? The role of reviewer characteristics and temporal effects , 2008, Inf. Technol. Manag..

[26]  Qing Cao,et al.  RETRACTED: Sentiment Analysis in Decision Sciences Research: An Illustration to IT Governance , 2013, Decision Support Systems.

[27]  Mike Y. Chen,et al.  Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web , 2001 .

[28]  Isa Maks,et al.  Analysis of patient satisfaction in Dutch and Spanish online reviews , 2017, Proces. del Leng. Natural.

[29]  Anindya Ghose,et al.  Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets , 2008, Inf. Syst. Res..

[30]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[31]  Bin Gu,et al.  Do online reviews matter? - An empirical investigation of panel data , 2008, Decis. Support Syst..

[32]  Bo Pang,et al.  A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts , 2004, ACL.

[33]  Wei Peng,et al.  Consumer reviews: reviewer avatar facial expression and review valence , 2013, Internet Res..

[34]  Bing Liu,et al.  Sentiment Analysis and Subjectivity , 2010, Handbook of Natural Language Processing.

[35]  Detmar W. Straub,et al.  Specifying Formative Constructs in Information Systems Research , 2007, MIS Q..

[36]  David Yarowsky,et al.  Word-Sense Disambiguation Using Statistical Models of Roget’s Categories Trained on Large Corpora , 2010, COLING.

[37]  Elena García Barriocanal,et al.  Evaluating content quality and helpfulness of online product reviews: The interplay of review helpfulness vs. review content , 2012, Electron. Commer. Res. Appl..

[38]  Sharon L. Oviatt,et al.  Human-centered design meets cognitive load theory: designing interfaces that help people think , 2006, MM '06.

[39]  Patrick Hartmann,et al.  Consumer attitude and purchase intention toward green energy brands: The roles of psychological benefits and environmental concern , 2012 .

[40]  Rayid Ghani,et al.  Analyzing the effectiveness and applicability of co-training , 2000, CIKM '00.

[41]  Hsinchun Chen,et al.  Sentiment analysis in multiple languages: Feature selection for opinion classification in Web forums , 2008, TOIS.

[42]  Peeter W. J. Verlegh,et al.  The social sharing of emotion (SSE) in online social networks: A case study in Live Journal , 2015, Comput. Hum. Behav..

[43]  Izak Benbasat,et al.  The Effects of Presentation Formats and Task Complexity on Online Consumers' Product Understanding , 2007, MIS Q..

[44]  Inés López-López,et al.  Is a most helpful eWOM review really helpful? The impact of conflicting aggregate valence and consumer's goals on product attitude , 2016, Internet Res..

[45]  Uzay Kaymak,et al.  Multi-lingual support for lexicon-based sentiment analysis guided by semantics , 2014, Decis. Support Syst..

[46]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[47]  Alton Yeow-Kuan Chua,et al.  Theorizing the textual differences between authentic and fictitious reviews: Validation across positive, negative and moderate polarities , 2017, Internet Res..

[48]  S. Shyam Sundar,et al.  Interactivity and memory: Information processing of interactive versus non-interactive content , 2016, Comput. Hum. Behav..

[49]  Ram Gopal Raj,et al.  A systematic literature review on opinion types and sentiment analysis techniques: Tasks and challenges , 2017, Internet Res..

[50]  James H. Martin,et al.  Detecting deception in text: a corpus-driven approach , 2012 .

[51]  Yubo Chen,et al.  Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix , 2004, Manag. Sci..

[52]  Sung-Byung Yang,et al.  Online consumers' reactions to price decreases: Amazon's Kindle 2 case , 2016, Internet Res..

[53]  Edna B. Johnson.  Cognitive Age: Understanding Consumer Alienation in the Mature Market , 1996 .

[54]  David D. Lewis,et al.  Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval , 1998, ECML.

[55]  Xiangji Huang,et al.  Mining Online Reviews for Predicting Sales Performance: A Case Study in the Movie Domain , 2012, IEEE Transactions on Knowledge and Data Engineering.

[56]  Edward B. Royzman,et al.  Negativity Bias, Negativity Dominance, and Contagion , 2001 .

[57]  R. Pieters,et al.  Beyond valence in customer dissatisfaction: A review and new findings on behavioral responses to regret and disappointment in failed services , 2004 .

[58]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[59]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[60]  D. Albarracín,et al.  Forming attitudes that predict future behavior: a meta-analysis of the attitude-behavior relation. , 2006, Psychological bulletin.

[61]  Matthew K. O. Lee,et al.  The impact of electronic word-of-mouth: The adoption of online opinions in online customer communities , 2008, Internet Res..

[62]  C. Osgood,et al.  The principle of congruity in the prediction of attitude change. , 1955, Psychological review.

[63]  Xi Zhang,et al.  From e-learning to social-learning: Mapping development of studies on social media-supported knowledge management , 2015, Comput. Hum. Behav..

[64]  Nan Hu,et al.  Ratings lead you to the product, reviews help you clinch it? The mediating role of online review sentiments on product sales , 2014, Decis. Support Syst..

[65]  Cheng-Chieh Hsiao,et al.  Whose online reviews have the most influences on consumers in cultural offerings? Professional vs consumer commentators , 2014, Internet Res..

[66]  Lu Liu,et al.  Determinants of information retweeting in microblogging , 2012, Internet Res..

[67]  B. Rimé.  Emotion Elicits the Social Sharing of Emotion: Theory and Empirical Review , 2009 .

[68]  Judy A. Siguaw,et al.  Formative versus Reflective Indicators in Organizational Measure Development: A Comparison and Empirical Illustration , 2006 .

[69]  Tibert Verhagen,et al.  Negative online word-of-mouth: Behavioral indicator or emotional release? , 2013, Comput. Hum. Behav..

[70]  Miyoung Jeong,et al.  Enhancing online brand experiences: An application of congruity theory , 2014 .

[71]  Efthimios Tambouris,et al.  Understanding the Predictive Power of Social Media This is a pre-print version of the following article : , 2013 .

[72]  R. Schindler,et al.  Perceived helpfulness of online consumer reviews: The role of message content and style: Perceived helpfulness of online consumer reviews , 2012 .