League Tables for Performance Improvement in Health Care

Objectives: Increasingly health care performance data are being disseminated in the form of ‘league tables' of health care providers, with the implication that such publication helps purchasers select the better providers, and spurs providers into improvements. This paper examines progress to date. Methods: Three stages of the league table process are considered: measurement, analysis and action. Results: A wide range of measurement schemes are now in place, although the emphasis has been on process variables and mortality as a measure of outcome. Several analytical techniques have been deployed to help users make sense of league tables, and to help determine the causes of variations in reported performance. The weakest aspect of current methods relates to the use to which such analysis is put. Conclusions: A haphazard approach to using league table data exists, with few reports on the impact of publication. A variety of directions for future research into the use of performance data are needed.

[1]  H. Davies,et al.  Assessing the quality of care , 1995, BMJ.

[2]  J. Moller,et al.  The pediatric cardiac care consortium--revisited. , 1994, The Joint Commission journal on quality improvement.

[3]  R. Hayward,et al.  Identifying poor-quality hospitals. Can hospital mortality rates detect quality problems for medical diagnoses? , 1996, Medical care.

[4]  A Millar,et al.  Risk‐adjusted analysis of surgeon performance: A 1‐year study , 1995, The British journal of surgery.

[5]  Alan Meekings.  Unlocking the potential of performance measurement: A practical implementation guide , 1995 .

[6]  N. Wintfeld,et al.  Report cards on cardiac surgeons. Assessing New York State's approach. , 1995, The New England journal of medicine.

[7]  E. Kuhn,et al.  Comparing hospitals that perform coronary artery bypass surgery: the effect of outcome measures and data sources. , 1994, American journal of public health.

[8]  J H Kerr,et al.  Intensive Care Society's APACHE II study in Britain and Ireland--II: Outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method. , 1993, BMJ.

[9]  A. Fitzgerald,et al.  Heaven can wait. , 1994, Journal of public health medicine.

[10]  Nigel Rice,et al.  Multilevel Models: Applications to Health Data , 1996, Journal of health services research & policy.

[11]  R. Seifert.  Performance indicators in the NHS. , 1989, Radiography today.

[12]  J. Straus,et al.  Reporting and using health plan performance information in Massachusetts. , 1995, The Joint Commission journal on quality improvement.

[13]  D. Nash.  Is the quality cart before the horse? , 1992, JAMA.

[14]  T. Rockall,et al.  Variation in outcome after acute upper gastrointestinal haemorrhage , 1995, The Lancet.

[15]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[16]  L I Iezzoni,et al.  Using severity-adjusted stroke mortality rates to judge hospitals. , 1995, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[17]  Peter C Smith,et al.  On the unintended consequences of publishing performance data in the public sector , 1995 .

[18]  C Orchard,et al.  Comparing healthcare outcomes , 1994, BMJ.

[19]  E L Hannan,et al.  Benefits and hazards of reporting medical outcomes publicly. , 1996, The New England journal of medicine.

[20]  S. Jencks,et al.  The health care quality improvement initiative. A new approach to quality assurance in Medicare. , 1992, JAMA.

[21]  Harvey Goldstein,et al.  League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance , 1996 .

[22]  L. Iezzoni,et al.  Widespread assessment of risk-adjusted outcomes: lessons from local initiatives. , 1994, The Joint Commission journal on quality improvement.

[23]  D Draper,et al.  Hospital characteristics and quality of care. , 1992, JAMA.

[24]  Jonathan Mant,et al.  Detecting differences in quality of care: the sensitivity of measures of process and outcome in treating acute myocardial infarction , 1995, BMJ.

[25]  Using mortality rates as a screening tool: the experience of the Department of Veterans Affairs. , 1994, The Joint Commission journal on quality improvement.

[26]  D. Hunter,et al.  Mortality league tables: do they inform or mislead? , 1995, Quality in health care : QHC.

[27]  P B Batalden,et al.  Report cards or instrument panels: who needs what? , 1995, The Joint Commission journal on quality improvement.

[28]  W. Ghali,et al.  Statewide quality improvement initiatives and mortality after cardiac surgery. , 1997, JAMA.

[29]  D. V. van Leeuwen.  Are medication error rates useful as comparative measures of organizational performance? , 1994, The Joint Commission journal on quality improvement.

[30]  M. Epstein,et al.  Statewide health information: a tool for improving hospital accountability. , 1994, The Joint Commission journal on quality improvement.

[31]  J. Ehreth,et al.  The Development and Evaluation of Hospital Performance Measures for Policy Analysis , 1994, Medical care.

[32]  C. Lennox.  Measures of performance in Scottish maternity hospitals , 1991 .

[33]  D. O'leary.  Measurement and accountability: taking careful aim. , 1995, The Joint Commission journal on quality improvement.

[34]  Stafford Beer,et al.  Decision and Control: The Meaning of Operational Research and Management Cybernetics , 1966 .

[35]  G. Murray,et al.  Case mix adjustment in comparative audit. , 1995, Journal of evaluation in clinical practice.

[36]  D. V. Leeuwen.  Are Medication Error Rates Useful as Comparative Measures of Organizational Performance , 1994 .

[37]  D. Nash.  Quality of measurement or quality of medicine? , 1995, JAMA.

[38]  A. C. Conway,et al.  Partnering with physicians to achieve quality improvement. , 1995, The Joint Commission journal on quality improvement.

[39]  L. Iezzoni,et al.  Severity measurement methods and judging hospital death rates for pneumonia. , 1996, Medical care.

[40]  G. Rosenthal,et al.  Cleveland health quality choice: a model for collaborative community-based outcomes assessment. , 1994, The Joint Commission journal on quality improvement.

[41]  T Bowen,et al.  Expert Systems for Performance Review , 1987, The Journal of the Operational Research Society.

[42]  J O Sundin,et al.  Assessing quality of care. , 2000, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[43]  Peter Smith,et al.  Data envelopment analysis applied to quality in primary health care , 1996, Ann. Oper. Res..

[44]  Peter C. Smith,et al.  Outcome‐related Performance Indicators and Organizational Control in the Public Sector1 , 1993 .