Use of Statistical Control Charts to Assess Outcomes of Medical Care: Pneumonia in Medicare Patients

Detection of nonrandom variation in outcomes with statistical control charts is at the heart of quality improvement techniques. The authors examined the charts ability to detect variations in outcome of pneumonia. They surveyed Medicare claims data for DRG 89, pneumonia with complications or co-morbidities, from November 1988 through October 1991 at 20 Illinois hospitals with the most Medicare discharges for DRG 89. Control charts were constructed on five outcomes—mean length of stay, range of length of stay, mortality, readmissions, and complications. Standard techniques from industrial statistics were used to construct the historical means and control limits derived from 2 years of data, to plot the monthly samples from the 3rd year of data and to score the control charts for nonrandom variation at less than 1% probability. The observed number of control charts with nonrandom variation was 33 of 100; the expected number was 9.18 (p < 0.0001). Nineteen hospitals had 1 to 3 control charts with nonrandom variation on the five outcomes, whereas only one hospital had none. The number of control charts with nonrandom variation per hospital did not correlate with hospital size, occupancy, teaching status, location, or payer-mix. Statistical control charts provide simple tools for identification of nonrandom variation in outcomes. To the extent that these variations can be related to quality issues, the charts will be useful for quality management.

[1]  W. Deming.  Quality, productivity, and competitive position , 1982 .

[2]  J. Herndon,et al.  Unexplained deaths in a children's hospital. An epidemiologic assessment. , 1985, The New England journal of medicine.

[3]  N. Roos,et al.  Use of claims data systems to evaluate health care outcomes. Mortality and reoperation following prostatectomy. , 1987, JAMA.

[4]  L. Wyszewiański.  The emphasis on measurement in quality assurance: reasons and implications. , 1988, Inquiry : a journal of medical care organization, provision and financing.

[5]  Predicting hospital-associated mortality for Medicare patients. A method for patients with stroke, pneumonia, acute myocardial infarction, and congestive heart failure. , 1988 .

[6]  D Blumenthal,et al.  The case for using industrial quality management science in health care organizations. , 1989, JAMA.

[7]  D M Berwick,et al.  Continuous improvement as an ideal in health care. , 1989, The New England journal of medicine.

[8]  L. Iezzoni,et al.  Using Administrative Diagnostic Data to Assess the Quality of Hospital Care: Pitfalls and Potential of ICD-9-CM , 1990, International Journal of Technology Assessment in Health Care.

[9]  S. Desharnais.  Current Uses of Large Data Sets to Assess the Quality of Providers: Construction of Risk-Adjusted Indexes of Hospital Performance , 1990, International Journal of Technology Assessment in Health Care.

[10]  K N Lohr,et al.  A strategy for quality assurance in Medicare. , 1990, The New England journal of medicine.

[11]  R H Brook,et al.  Explaining variations in hospital death rates. Randomness, severity of illness, quality of care. , 1990, JAMA.

[12]  S. Schoenbaum,et al.  Clinical practice guidelines at an HMO: development and implementation in a quality improvement model. , 1990, QRB. Quality review bulletin.

[13]  B. Simmons,et al.  Continuous quality improvement. Concepts and applications for physician care. , 1991, JAMA.

[14]  T. Wan,et al.  Modeling organizational determinants of hospital mortality. , 1991, Health services research.

[15]  G. Coffman,et al.  Admission and mid-stay MedisGroups scores as predictors of death within 30 days of hospital admission. , 1991, American journal of public health.

[16]  M. Pine,et al.  Using Clinical Variables to Estimate the Risk of Patient Mortality , 1991, Medical care.

[17]  L. McMahon,et al.  Measuring outcomes of hospital care using multiple risk-adjusted indexes. , 1991, Health services research.

[18]  L. Eskildson,et al.  Lessons from industry: revising organizational structure to improve health care quality assurance. , 1991, QRB. Quality review bulletin.

[19]  J. Chmiel,et al.  Hospital variables associated with quality of care for breast cancer patients. , 1991, JAMA.

[20]  S. Jencks,et al.  The health care quality improvement initiative. A new approach to quality assurance in Medicare. , 1992, Journal of the American Medical Association (JAMA).

[21]  G. Coffman,et al.  Predicting In-Hospital Mortality: A Comparison of Severity Measurement Approaches , 1992, Medical care.