How Patient Comments Affect Consumers’ Use of Physician Performance Measures

Background:Patients’ comments about doctors are increasingly available on the internet. The effects of these anecdotal accounts on consumers’ engagement with reports on doctor quality, use of more statistically reliable performance measures, and ability to choose doctors wisely are unknown. Objective:To examine the effects of providing patient comments along with standardized performance information in a web-based public report. Design:Participants were randomly assigned to view 1 of 6 versions of a website presenting comparative performance information on fictitious primary care doctors. Versions varied by the combination of information types [Consumer Assessment of Healthcare Providers and Systems (CAHPS), Healthcare Effectiveness Data and Information Set (HEDIS), and patient comments] and number of doctors. Participants:A random sample of working-age adults (N=848) from an online panel representing the noninstitutionalized population of the United States. Main Measures:Time spent and actions taken on the website, probing of standardized measures, and decision quality (chosen doctor rated highest on quantifiable metrics, chosen doctor not dominated by another choice). Secondary outcomes were perceived usefulness and trustworthiness of performance metrics and evaluations of the website. Key Results:Inclusion of patient comments increased time spent on the website by 35%–42% and actions taken (clicks) by 106%–117% compared with versions presenting only CAHPS and HEDIS measures (P<0.01). It also reduced participants’ attention to standardized measures (eg, percentage of time probing HEDIS measures dropped by 67%, P<0.01). When patient comments were present, fewer participants chose the doctor scoring highest on standardized metrics (44%–49% vs. 61%–62%, P<0.01). Conclusions:Including patient comments in physician performance reports enhances consumers’ engagement but reduces their attention to standardized measures and substantially increases suboptimal choices. More research is needed to explore whether integrated reporting strategies could leverage the positive effects of patient comments on consumer engagement without undermining consumers’ use of other important metrics for informing choice among doctors.

[1]  Steven C Martino,et al.  Taking Patients' Narratives about Clinicians from Anecdote to Science. , 2015, The New England journal of medicine.

[2]  Steven C. Martino,et al.  Complexity, Public Reporting, and Choice of Doctors , 2014, Medical care research and review : MCRR.

[3]  Harold S. Luft,et al.  Public Reporting of Provider Performance at a Crossroads in the United States , 2014, Medical care research and review : MCRR.

[4]  Steven C. Martino,et al.  Consumer Response to Patient Experience Measures in Complex Information Environments , 2012, Medical care.

[5]  M. Rosenthal,et al.  How report cards on physicians, physician groups, and hospitals can have greater impact on consumer choices. , 2012, Health affairs.

[6]  A. Jha,et al.  A Changing Landscape of Physician Quality Reporting: Analysis of Patients’ Online Ratings of Their Physicians Over a 5-Year Period , 2012, Journal of medical Internet research.

[7]  U. Sarkar,et al.  What Patients Say About Their Doctors Online: A Qualitative Content Analysis , 2012, Journal of General Internal Medicine.

[8]  David Lansky,et al.  Numbers to crunch. Better public data needed to help patients compare and choose physicians. , 2011, Modern healthcare.

[9]  Jay P. Carlson,et al.  Consumers' use of HCAHPS ratings and word-of-mouth in hospital choice. , 2010, Health services research.

[10]  Peter K Lindenauer,et al.  Putting the public back in public reporting of health care quality. , 2010, JAMA.

[11]  R. Blendon,et al.  American Public Opinion and Health Care , 2010 .

[12]  J. Alexander,et al.  A Report Card on Provider Report Cards: Current Status of the Health Care Transparency Movement , 2010, Journal of General Internal Medicine.

[13]  Rui Mata,et al.  When less is enough: Cognitive aging, information search, and decision quality in consumer choice. , 2010, Psychology and aging.

[14]  T. Lagu,et al.  Patients’ Evaluations of Health Care Providers in the Era of Social Networking: An Analysis of Physician-Rating Websites , 2010, Journal of General Internal Medicine.

[15]  J. Krosnick,et al.  National Surveys Via Rdd Telephone Interviewing Versus the Internet Comparing Sample Representativeness and Response Quality , 2009 .

[16]  M. McCartney.  Will doctor rating sites improve the quality of care? No , 2009, BMJ : British Medical Journal.

[17]  Michael E Chernew,et al.  Quality and Consumer Decision Making in the Market for Health Insurance and Health Care Services , 2009, Medical care research and review : MCRR.

[18]  Marije Bosch,et al.  Public Reporting in Health Care: How Do Consumers Use Quality-of-Care Information?: A Systematic Review , 2009, Medical care.

[19]  J. Hibbard.  What Can We Say about the Impact of Public Reporting? Inconsistent Execution Yields Variable Results , 2008, Annals of Internal Medicine.

[20]  R. Dudley,et al.  Public reporting of provider performance: can its impact be made greater? , 2006, Annual review of public health.

[21]  Paul Slovic,et al.  Task complexity and older adults' decision-making competence. , 2005, Psychology and aging.

[22]  Byung-Kwan Lee,et al.  The effect of information overload on consumer choice quality in an on-line environment , 2004 .

[23]  Judith H Hibbard,et al.  Supporting informed consumer health care decisions: data presentation approaches that facilitate the use of information in choice. , 2003, Annual review of public health.

[24]  R. Dhar,et al.  The Effect of Forced Choice on Choice , 2003 .

[25]  Robin Gregory,et al.  Narrative valuation in a policy judgment context , 2000 .

[26]  John W. Payne,et al.  Measuring Constructed Preferences: Towards a Building Code , 1999 .

[27]  Mark I. Hwang,et al.  Information dimension, information overload and decision quality , 1999, J. Inf. Sci..

[28]  D. Mechanic,et al.  The impact of managed care on patients' trust in medical care and their physicians. , 1996, JAMA.

[29]  Leonard M. Lodish,et al.  Comparing Dynamic Consumer Choice in Real and Computer-simulated Environments , 1992 .

[30]  Richard T. Carson,et al.  Experimental analysis of choice , 1991 .

[31]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[32]  Jeannine S. Schiller,et al.  Summary health statistics for U.S. adults: National Health Interview Survey, 2010. , 2012, Vital and health statistics. Series 10, Data from the National Health Survey.

[33]  M. Marshall,et al.  How do patients use information on providers , 2010 .

[34]  M. Spranca,et al.  Disenrollment Information and Medicare Plan Choice: Is More Information Better? , 2007, Health care financing review.

[35]  Jeannine S. Schiller,et al.  Summary health statistics for U.S. adults: National Health Interview Survey, 2001. , 2004, Vital and health statistics. Series 10, Data from the National Health Survey.

[36]  Stephen M. Johnson,et al.  The affect heuristic in judgments of risks and benefits , 2000 .

[37]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .