Quality in Product Reviews: What Technical Communicators Should Know

Purpose: Measuring the quality of product reviews via helpfulness votes is problematic for several reasons. I delineate the components of product review quality in order to assist technical communicators who manage their organizations' user-generated content in identifying quality content and in helping reviewers produce quality content. Method/Corpus: I analyze results from secondary research on product reviews and discuss six important components of review quality. I focus most attention on five components of review quality that technical communicators can assess-informativeness, valance, credibility, conformity, and readability-and briefly describe a sixth component-user characteristics. I also exemplify these components, drawing from a corpus of 8,973 product reviews gathered in 2013 from a variety of retail and review websites. Results: Based on this analysis, I recommend strategies that technical communicators can use (1) to identify these components of review quality, (2) to develop a rich data set from which they can glean consumer wants and needs as well as trends related to their organizations' products, and (3) to help reviewers write better reviews. Conclusions: As the amount of user-generated content grows, the need to learn from it and the need to improve it grow. By using their knowledge and skills in new ways, technical communicators who manage and develop product reviews can stay relevant and necessary as organizations rely more and more heavily on user-generated content.

[1]  Ricardo Baeza-Yates,et al.  Social Media Is NOT that Bad! The Lexical Quality of Social Media , 2012, ICWSM.

[2]  Norazah Mohd Suki,et al.  STRUCTURAL RELATIONSHIPS BETWEEN PERCEIVED RISK AND CONSUMERS UNWILLINGNESS TO BUY HOME APPLIANCES ONLINE WITH MODERATION OF ONLINE CONSUMER REVIEWS , 2014 .

[3]  Barry Smyth,et al.  A classification-based review recommender , 2010, Knowl. Based Syst..

[4]  H. Kelley,et al.  Communication And Persuasion , 1953 .

[5]  Edward B. Royzman,et al.  Negativity Bias, Negativity Dominance, and Contagion , 2001 .

[6]  Miriam J. Metzger,et al.  Social and Heuristic Approaches to Credibility Evaluation Online , 2010 .

[7]  Ann E. Schlosser Can including pros and cons increase the helpfulness and persuasiveness of online reviews? The interactive effects of ratings and arguments ☆ , 2011 .

[8]  Pranjal Gupta,et al.  How e-WOM recommendations influence product consideration and quality of choice: A motivation to process information perspective , 2010 .

[9]  Jaideep Srivastava,et al.  Predicting trusts among users of online communities: an epinions case study , 2008, EC '08.

[10]  Shelley E. Taylor,et al.  Social cognition, 2nd ed. , 1991 .

[11]  X. Zhang,et al.  Impact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics , 2010 .

[12]  S. Feldman,et al.  Motivational Aspects of Attitudinal Elements and Their Place in Cognitive Interaction , 1966 .

[13]  Panagiotis G. Ipeirotis,et al.  Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics , 2010, IEEE Transactions on Knowledge and Data Engineering.

[14]  S. M. Sales,et al.  Attitudinal effects of “mere exposure”: A reevaluation , 1971 .

[15]  David E. Kanouse,et al.  Negativity in evaluations. , 1987 .

[16]  Michael V. Mannino,et al.  Linguistic characteristics of shill reviews , 2014, Electron. Commer. Res. Appl..

[17]  Paul van Schaik,et al.  The role of context in perceptions of the aesthetics of web pages over time , 2009, Int. J. Hum. Comput. Stud..

[18]  Jun Yang,et al.  Experiential goods with network externalities effects: An empirical study of online rating system , 2010 .

[19]  Jo Mackiewicz Assertions of Expertise in Online Reviews , 2013 .

[20]  Ling Liu,et al.  Do online reviews affect product sales? The role of reviewer characteristics and temporal effects , 2008, Inf. Technol. Manag..

[21]  Elena García Barriocanal,et al.  Evaluating content quality and helpfulness of online product reviews: The interplay of review helpfulness vs. review content , 2012, Electron. Commer. Res. Appl..

[22]  Claire Cardie,et al.  Finding Deceptive Opinion Spam by Any Stretch of the Imagination , 2011, ACL.

[23]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[24]  Paul A. Pavlou,et al.  Overcoming the J-shaped distribution of product reviews , 2009, CACM.

[25]  Annette N. Shelby,et al.  Communication Quality Revisited: Exploring the Link with Persuasive Effects , 1998 .

[26]  Gita Venkataramani Johar,et al.  Perceived Source Variability Versus Familiarity: Testing Competing Explanations for the Truth Effect , 2002 .

[27]  Jo Mackiewicz,et al.  Visual Composing: Document Design for Print and Digital Media , 2010 .

[28]  Natalie S. Glance,et al.  Star Quality: Aggregating Reviews to Rank Products and Merchants , 2010, ICWSM.

[29]  B. Sparks,et al.  The impact of online reviews on hotel booking intentions and perception of trust. , 2011 .

[30]  Anindya Ghose,et al.  Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets , 2008, Inf. Syst. Res..

[31]  Jon M. Kleinberg,et al.  WWW 2009 MADRID! Track: Data Mining / Session: Opinions How Opinions are Received by Online Communities: A Case Study on Amazon.com Helpfulness Votes , 2022 .

[32]  Jahna Otterbacher,et al.  Being Heard in Review Communities: Communication Tactics and Review Prominence , 2011, J. Comput. Mediat. Commun..

[33]  Qing Cao,et al.  Exploring determinants of voting for the "helpfulness" of online user reviews: A text mining approach , 2011, Decis. Support Syst..

[34]  Yue Pan,et al.  Born Unequal: A Study of the Helpfulness of User-Generated Product Reviews , 2011 .

[35]  R. Schindler,et al.  Perceived Helpfulness of Online Consumer Reviews: The Role of Message Content and Style , 2010 .

[36]  Ann E. Schlosser Posting versus Lurking: Communicating in a Multiple Audience Context , 2005 .

[37]  K. Vohs,et al.  Case Western Reserve University , 1990 .

[38]  Ming Zhou,et al.  Low-Quality Product Review Detection in Opinion Summarization , 2007, EMNLP.

[39]  David Schuff,et al.  Is It the Review or the Reviewer? a Multi-Method Approach to Determine the Antecedents of Online Review Helpfulness , 2011, 2011 44th Hawaii International Conference on System Sciences.

[40]  Jo Mackiewicz,et al.  Product Review Users' Perceptions of Review Quality: The Role of Credibility, Informativeness, and Readability , 2014, IEEE Transactions on Professional Communication.

[41]  S. Sen,et al.  Why are you telling me this? An examination into negative consumer reviews on the Web , 2007 .

[42]  S. Crowley Ancient rhetorics for contemporary students , 1994 .

[43]  Alexis Papathanassis,et al.  Exploring the adoption and processing of online holiday reviews: A grounded theory approach , 2011 .

[44]  Jason Q. Zhang,et al.  When does electronic word-of-mouth matter? A study of consumer product reviews☆ , 2010 .

[45]  S. Fiske Social cognition and social perception. , 1993, Annual review of psychology.

[46]  Jo Mackiewicz,et al.  The Impact of Review Environment on Review Credibility , 2016, IEEE Transactions on Professional Communication.