Vocal Minority and Silent Majority: How Do Online Ratings Reflect Population Perceptions of Quality?

Consumer-generated ratings typically share an objective of illuminating the quality of a product or service for other buyers. While ratings have become ubiquitous and influential on the Internet, surprisingly little empirical research has investigated how these online assessments reflect the opinion of the population at large, especially in the domain of professional services where quality is often opaque to consumers. Building on the word-of-mouth literature, we examine the relationship between online ratings and population perceptions of physician quality. We leverage a unique dataset which includes direct measures of both the offline population's perception of physician quality and consumer-generated online reviews. As a result, we are able to examine how online ratings reflect patients' opinions about physician quality. In sharp contrast to the widely voiced concerns by medical practitioners, we find that physicians who are rated lower in quality by the patient population are less likely to be rated online. Although ratings provided online are positively correlated with patient population opinions, the online ratings tend to be exaggerated at the upper end of the quality spectrum. This study is the first to provide empirical evidence of the relationship between online ratings and the underlying consumer-perceived quality, and extends prior research on online word-of-mouth to the domain of professional services.

[1]  Sheldon Greenfield,et al.  Measuring Quality of Care in Patients With Multiple Clinical Conditions: Summary of a Conference Conducted by the Society of General Internal Medicine , 2007, Journal of General Internal Medicine.

[2]  Lorin M. Hitt,et al.  Self Selection and Information Role of Online Product Reviews , 2007, Inf. Syst. Res..

[3]  Dwayne D. Gremler,et al.  Electronic word-of-mouth via consumer-opinion platforms: What motivates consumers to articulate themselves on the Internet? , 2004 .

[4]  A. Jha,et al.  Patients' perception of hospital care in the United States. , 2008, The New England journal of medicine.

[5]  Il Im,et al.  CAUSES AND OUTCOMES OF ONLINE CUSTOMER COMPLAINING BEHAVIOR: IMPLICATIONS FOR CUSTOMER RELATIONSHIP MANAGEMENT (CRM) , 2001 .

[6]  Michael B. Rothberg,et al.  Patients’ Evaluations of Health Care Providers in the Era of Social Networking: An Analysis of Physician-Rating Websites , 2010, Journal of general internal medicine.

[7]  Caroline Wiertz,et al.  Exploring the "Twitter Effect:" An Investigation of the Impact of Microblogging Word of Mouth on Consumers' Early Adoption of New Products , 2012 .

[8]  J. Arndt Role of Product-Related Conversations in the Diffusion of a New Product , 1967 .

[9]  Il Im,et al.  An analysis of online customer complaints: implications for Web complaint management , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[10]  Chrysanthos Dellarocas,et al.  Are Consumers More Likely to Contribute Online Reviews for Hit or Niche Products? , 2010, J. Manag. Inf. Syst..

[11]  B. Gu,et al.  First Step in Social Media - Measuring the Influence of Online Management Responses on Customer Satisfaction , 2011 .

[12]  A. Jha,et al.  A Changing Landscape of Physician Quality Reporting: Analysis of Patients’ Online Ratings of Their Physicians Over a 5-Year Period , 2012, Journal of medical Internet research.

[13]  Chun Liu,et al.  Social Influence Bias : A Randomized Experiment , 2014 .

[14]  Andrew Whinston,et al.  The Dynamics of Online Word-of-Mouth and Product Sales: An Empirical Investigation of the Movie Industry , 2008 .

[15]  Melinda Beeuwkes Buntin,et al.  Choosing a Health Care Provider: The Role of Quality Information , 2008 .

[16]  S. Sénécal,et al.  The influence of online product recommendations on consumers' online choices , 2004 .

[17]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[18]  Bin Gu,et al.  Research Note - The Impact of External Word-of-Mouth Sources on Retailer Sales of High-Involvement Products , 2012, Inf. Syst. Res..

[19]  Pei-Yu Sharon Chen,et al.  The Impact of Online Recommendations and Consumer Feedback on Sales , 2004, ICIS.

[20]  SchuffDavid,et al.  What makes a helpful online review? a study of customer reviews on amazon.com , 2010 .

[21]  Paul A. Pavlou,et al.  Overcoming the J-shaped distribution of product reviews , 2009, CACM.

[22]  Marsha L. Richins Negative Word-of-Mouth by Dissatisfied Consumers: A Pilot Study , 1983 .

[23]  AgarwalRitu,et al.  Research Commentary---The Digital Transformation of Healthcare , 2010 .

[24]  Ritu Agarwal,et al.  The Digital Transformation of Healthcare: Current Status and the Road Ahead , 2010 .

[25]  Chrysanthos Dellarocas,et al.  The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias , 2006, Manag. Sci..

[26]  E. Clemons,et al.  When Online Reviews Meet Hyperdifferentiation: A Study of the Craft Beer Industry , 2006 .

[27]  Juanjuan Zhang,et al.  How Does Popularity Information Affect Choices? A Field Experiment , 2009 .

[28]  Peter H. Reingen,et al.  Social Ties and Word-of-Mouth Referral Behavior , 1987 .

[29]  Raghuram Iyengar,et al.  How Interest Shapes Word-of-Mouth Over Different Channels , 2012 .

[30]  Yong Liu Word-of-Mouth for Movies: Its Dynamics and Impact on Box Office Revenue , 2006 .

[31]  Shoshannah A. Pearlman The Patient Protection and Affordable Care Act , 2013, Journal of the American Psychiatric Nurses Association.

[32]  J. Holmes,et al.  Product sampling and word of mouth. , 1977 .

[33]  L. J. Harrison‐Walker The Measurement of Word-of-Mouth Communication and an Investigation of Service Quality and Customer Commitment As Potential Antecedents , 2001 .

[34]  J. Alexander,et al.  A Report Card on Provider Report Cards: Current Status of the Health Care Transparency Movement , 2010, Journal of General Internal Medicine.

[35]  C. Darby,et al.  Measuring hospital care from the patients' perspective: an overview of the CAHPS Hospital Survey development process. , 2005, Health services research.

[36]  Ritu Agarwal,et al.  The Digitization of Healthcare: Boundary Risks, Emotion, and Consumer Willingness to Disclose Personal Health Information , 2011, Inf. Syst. Res..

[37]  David O Meltzer,et al.  Barriers to patient-physician communication about out-of-pocket costs , 2004, Journal of general internal medicine.

[38]  M. McCartney Will doctor rating sites improve the quality of care? No , 2009, BMJ : British Medical Journal.

[39]  N. Lee,et al.  Word of mouth communication within online communities: Conceptualizing the online social network , 2007 .

[40]  S. Woolf,et al.  A vision for patient-centered health information systems. , 2011, JAMA.

[41]  Jagdip Singh Consumer Complaint Intentions and Behavior: Definitional and Taxonomical Issues , 1988 .

[42]  Ritu Agarwal,et al.  The Creation of Social Value: Can an Online Health Community Reduce Rural-Urban Health Disparities? , 2016, MIS Q..

[43]  Donna Fuscaldo How to Spot Fake Online Reviews , 2014 .

[44]  E. Anderson Customer Satisfaction and Word of Mouth , 1998 .

[45]  D. Blumenthal,et al.  Patient Protection and Affordable Care Act , 2010 .

[46]  A James O'Malley,et al.  Case-mix adjustment of the CAHPS Hospital Survey. , 2005, Health services research.

[47]  A. Blenkinsopp,et al.  Patient reporting of suspected adverse drug reactions: a review of published literature and international experience. , 2007, British journal of clinical pharmacology.

[48]  Junji Nakanishi A study on the theory of consumer complaint behavior in sport management : Toward a model of consumer complaint behavior , 1994 .

[49]  Frank M. Bass,et al.  A New Product Growth for Model Consumer Durables , 2004, Manag. Sci..

[50]  Pradeep Chintagunta,et al.  The Effects of Online User Reviews on Movie Box Office Performance: Accounting for Sequential Rollout and Aggregation Across Local Markets , 2010, Mark. Sci..

[51]  Peter E. Kennedy A Guide to Econometrics , 1979 .

[52]  X. Zhang,et al.  Impact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics , 2010 .

[53]  Monic Sun,et al.  How Does the Variance of Product Ratings Matter? , 2010, Manag. Sci..

[54]  David Godes,et al.  Sequential and Temporal Dynamics of Online Opinion , 2012, Mark. Sci..

[55]  Xiaoquan Zhang,et al.  AIS Electronic Library (AISeL) , 2017 .

[56]  Zizhuo Wang,et al.  A unified framework for dynamic pari-mutuel information market design , 2009, EC '09.

[57]  Ritu Agarwal,et al.  Electronic Health Records Assimilation and Physician Identity Evolution: An Identity Theory Perspective , 2012, Inf. Syst. Res..

[58]  Gary Fanjiang,et al.  Providing Patients Web-based Data to Inform Physician Choice: If You Build It, Will They Come? , 2007, Journal of General Internal Medicine.

[59]  Philip Henning EVERYDAY COGNITION AND SITUATED LEARNING , 2003 .

[60]  Paul A. Pavlou,et al.  Can online reviews reveal a product's true quality?: empirical findings and analytical modeling of Online word-of-mouth communication , 2006, EC '06.

[61]  Wendy W. Moe,et al.  Measuring the Value of Social Dynamics in Online Product Ratings Forums , 2010 .

[62]  R. Kane,et al.  The relationship of patient satisfaction with care and clinical outcomes. , 1997, Medical care.

[63]  K. Arrow Uncertainty and the welfare economics of medical care. 1963. , 2004, Bulletin of the World Health Organization.

[64]  David Godes,et al.  Using Online Conversations to Study Word-of-Mouth Communication , 2004 .

[65]  J E Ware,et al.  Organizational and financial characteristics of health plans: are they related to primary care performance? , 2000, Archives of internal medicine.

[66]  Jacqueline Levine Welcoming Transparency: Some Physicians Find Merit in Online Ratings , 2009, Journal of Perinatal Education.

[67]  Anindya Ghose,et al.  Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets , 2008, Inf. Syst. Res..

[68]  K. Pauwels,et al.  Effects of Word-of-Mouth versus Traditional Marketing: Findings from an Internet Social Networking Site , 2009 .

[69]  Ann E. Schlosser Posting versus Lurking: Communicating in a Multiple Audience Context , 2005 .

[70]  H. Hunt Consumer Satisfaction, Dissatisfaction, and Complaining Behavior , 1991 .

[71]  Paul D Cleary,et al.  Development of a New Patient-Based Measure of Pediatric Ambulatory Care , 2009, Pediatrics.

[72]  Sandra E. Ward,et al.  Patient-related barriers to management of cancer pain , 1993, Pain.

[73]  Chrysanthos Dellarocas,et al.  A Statistical Measure of a Population’s Propensity to Engage in Post-Purchase Online Word-of-Mouth , 2006 .

[74]  Kathy Hammond,et al.  The relative incidence of positive and negative word of mouth: A multi-category study , 2007 .

[75]  Yubo Chen,et al.  Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix , 2004, Manag. Sci..

[76]  Russell A. Sabella Cyberbullying and Cyberthreats: Responding to the Challenge of Online Social Aggression, Threats, and Distress , 2007 .