Statistical methodology for classifying units on the basis of multiple‐related measures

Both the private and public sectors have begun giving financial incentives to healthcare providers, such as hospitals, delivering superior 'quality of care'. Quality of care is assessed through a set of disease-specific measures that characterize the performance of healthcare providers. These measures are then combined into a unidimensional composite score. Most of the programs that reward superior performance use raw averages of the measures as the composite score. The scores based on raw averages fail to take into account typical characteristics of data used for performance evaluation, such as within-patient and within-hospital correlations, variable number of measures available in different hospitals, and missing data. In this paper, we contrast two different versions of composites based on raw average scores with a model-based score constructed using a latent variable model. We also present two methods to identify hospitals with superior performance. The methods are illustrated using national data collected to evaluate quality of care delivered by the U.S. acute care hospitals.

[1]  Thomas A Louis,et al.  Uncertainty in Rank Estimation: Implications for Value-Added Modeling Accountability Systems , 2002, Journal of educational and behavioral statistics : a quarterly publication sponsored by the American Educational Research Association and the American Statistical Association.

[2]  R. Hambleton,et al.  Handbook of Modern Item Response Theory , 1997 .

[3]  Sharon-Lise T. Normand,et al.  Selection of Related Multivariate Means , 2003 .

[4]  D. Blumenthal,et al.  Quality of health care. Part 6: The role of physicians in the future of quality management. , 1996, The New England journal of medicine.

[5]  S. Normand,et al.  The volume-outcome relationship: from Luft to Leapfrog. , 2003, The Annals of thoracic surgery.

[6]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[7]  D. Berwick Quality of health care. Part 5: Payment by capitation and the quality of care. , 1996, The New England journal of medicine.

[8]  Sivakumar Alagumalai,et al.  Applied Rasch measurement : a book of exemplars : papers in honour of John P. Keeves , 2005 .

[9]  M. Chassin Quality of health care. Part 3: improving the quality of care. , 1996, The New England journal of medicine.

[10]  Sharon-Lise T. Normand,et al.  Analytic Methods for Constructing Cross-Sectional Profiles of Health Care Providers , 2000, Health Services and Outcomes Research Methodology.

[11]  Fritz Drasgow,et al.  Item response theory : application to psychological measurement , 1983 .

[12]  Wim Jansen,et al.  Multilog: Multiple, Categorical Item Analysis and Test Scoring Using Item Response Theory , 1994 .

[13]  Michael J Daniels,et al.  Longitudinal profiling of health care units based on continuous and discrete patient outcomes. , 2005, Biostatistics.

[14]  M. Glickman,et al.  Statistical Methods for Profiling Providers of Medical Care: Issues and Applications , 1997 .

[15]  Atanu Biswas,et al.  A new bivariate binomial distribution , 2002 .

[16]  Erling B. Andersen,et al.  Sufficient statistics and latent trait models , 1977 .

[17]  Nanny Wermuth,et al.  On some models for multivariate binary variables parallel in complexity with the multivariate Gaussian distribution , 2002 .

[18]  S. Normand,et al.  American College of Cardiology and American Heart Association Methodology for the Selection and Creation of Performance Measures for Quantifying the Quality of Cardiovascular Care , 2005 .

[19]  Scott C. Williams,et al.  Performance of Top-Ranked Heart Care Hospitals on Evidence-Based Process Measures , 2006, Circulation.

[20]  C D Naylor,et al.  A comparison of a Bayesian vs. a frequentist method for profiling hospital performance. , 2001, Journal of evaluation in clinical practice.

[21]  G. W. Snedecor Statistical Methods , 1964 .

[22]  S Y Lee,et al.  Latent variable models with mixed continuous and polytomous data , 2001, Biometrics.

[23]  D. Blumenthal Part 1: Quality of care--what is it? , 1996, The New England journal of medicine.

[24]  S. Normand,et al.  Correlated bivariate continuous and binary outcomes: Issues and applications , 2009, Statistics in medicine.

[25]  D Blumenthal,et al.  Quality of health care. Part 4: The origins of the quality-of-care debate. , 1996, The New England journal of medicine.

[26]  R D Bock,et al.  High-dimensional multivariate probit analysis. , 1996, Biometrics.

[27]  T. Louis,et al.  Triple‐goal estimates in two‐stage hierarchical models , 1998 .

[28]  A. Jha,et al.  Care in U.S. hospitals--the Hospital Quality Alliance program. , 2005, The New England journal of medicine.

[29]  Walter R. Gilks,et al.  A Language and Program for Complex Bayesian Modelling , 1994 .

[30]  Harlan M Krumholz,et al.  ACC/AHA Clinical Performance Measures for Adults with Chronic Heart Failure: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures (Writing Committee to Develop Heart Failure Clinical Performance Measures): endorsed by the Heart Failure Society , 2005, Circulation.

[31]  Peter C Austin,et al.  A Comparison of Bayesian Methods for Profiling Hospital Performance , 2002, Medical decision making : an international journal of the Society for Medical Decision Making.

[32]  Frederic M. Lord MAXIMUM LIKELIHOOD AND BAYESIAN PARAMETER ESTIMATION IN ITEM RESPONSE THEORY , 1986 .

[33]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[34]  Harvey Goldstein,et al.  League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance , 1996 .

[35]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[36]  D. Dunson,et al.  Bayesian latent variable models for clustered mixed outcomes , 2000 .

[37]  Mark A. Hlatky,et al.  ACC/AHA Clinical Performance Measures for Adults With Chronic Heart Failure , 2005 .

[38]  E. McGlynn,et al.  Part 2: Measuring Quality of Care , 1996 .

[39]  Thomas A. Louis,et al.  Empirical Bayes Ranking Methods , 1989 .

[40]  Jian Qing Shi,et al.  Maximum Likelihood Estimation of Two‐Level Latent Variable Models with Mixed Continuous and Polytomous Data , 2001 .