An overview of risk‐adjusted charts

The paper provides an overview of risk-adjusted charts, with examples based on two data sets: the first consisting of outcomes following cardiac surgery and patient factors contributing to the Parsonnet score; the second being age-sex-adjusted death-rates per year under a single general practitioner. Charts presented include the cumulative sum (CUSUM), resetting sequential probability ratio test, the sets method and Shewhart chart. Comparisons between the charts are made. Estimation of the process parameter and two-sided charts are also discussed. The CUSUM is found to be the least efficient, under the average run length (ARL) criterion, of the resetting sequential probability ratio test class of charts, but the ARL criterion is thought not to be sensible for comparisons within that class. An empirical comparison of the sets method and CUSUM, for binary data, shows that the sets method is more efficient when the in-control ARL is small and more efficient for a slightly larger range of in-control ARLs when the change in parameter being tested for is larger. The Shewart "p"-chart is found to be less efficient than the CUSUM even when the change in parameter being tested for is large. Copyright 2004 Royal Statistical Society.

[1]  V T Farewell,et al.  Use of risk-adjusted CUSUM and RSPRTcharts for monitoring in medical contexts , 2003, Statistical methods in medical research.

[2]  Rina Chen,et al.  A Survillance System for Congenital Malformations , 1978 .

[3]  Chris Sherlaw-Johnson,et al.  Monitoring the results of cardiac surgery by variable life-adjusted display , 1997, The Lancet.

[4]  G Barbujani,et al.  Comparison of two statistical techniques for the surveillance of birth defects through a Monte Carlo simulation. , 1984, Statistics in medicine.

[5]  P Littlejohns,et al.  Cumulative risk adjusted mortality chart for detecting changes in death rate: observational study of heart surgery , 1998, BMJ.

[6]  V T Farewell,et al.  A risk‐adjusted Sets method for monitoring adverse medical outcomes , 2004, Statistics in medicine.

[7]  G Gallus,et al.  On surveillance methods for congenital malformations. , 1986, Statistics in medicine.

[8]  A. Wald.  Sequential Tests of Statistical Hypotheses , 1945 .

[9]  R Chen,et al.  The relative efficiency of the sets and the cusum techniques in monitoring the occurrence of a rare event. , 1987, Statistics in medicine.

[10]  E. S. Page.  CONTINUOUS INSPECTION SCHEMES , 1954 .

[11]  J. Holden,et al.  The shipman inquiry. , 2004, The British journal of general practice : the journal of the Royal College of General Practitioners.

[12]  A. Bernstein,et al.  A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. , 1989, Circulation.

[13]  M R de Leval,et al.  Analysis of a cluster of surgical failures. Application to a series of neonatal arterial switch operations. , 1994, The Journal of thoracic and cardiovascular surgery.

[14]  D. Hawkins,et al.  Cumulative Sum Charts and Charting for Quality Improvement , 1998, Statistics for Engineering and Physical Science.

[15]  Richard J Cook,et al.  Monitoring the evolutionary process of quality: risk-adjusted charting to track outcomes in intensive care. , 2003, Critical care medicine.

[16]  D H Blankenhorn,et al.  Reversal of Atherosis and Sclerosis: The Two Components of Atherosclerosis , 1989, Circulation.

[17]  J. Whitehead,et al.  A FORTRAN program for the design and analysis of sequential clinical trials. , 1983, Computers and biomedical research, an international journal.

[18]  Rasul A. Khan.  On Cumulative Sum Procedures and the SPRT with Applications , 1984 .

[19]  Stephen Bolsin,et al.  Making the case for personal professional monitoring in health care. , 2003, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[20]  S. Steiner,et al.  Monitoring surgical performance using risk-adjusted cumulative sum charts. , 2000, Biostatistics.

[21]  J Lovegrove,et al.  Monitoring the performance of cardiac surgeons , 1999, J. Oper. Res. Soc..