The Use of Control Charts in Health-Care and Public-Health Surveillance

There are many applications of control charts in health-care monitoring and in public-health surveillance. We introduce these applications to industrial practitioners and discuss some of the ideas that arise that may be applicable in industrial monitoring. The advantages and disadvantages of the charting methods proposed in the health-care and public-health areas are considered. Some additional contributions in the industrial statistical process control literature relevant to this area are given. There are many application and research opportunities available in the use of control charts for health-related monitoring.

[1]  G. Rossi,et al.  An approximate CUSUM procedure for surveillance of health events. , 1999, Statistics in medicine.

[2]  Jimmy R Lea.  Error is human. , 2008, MLO: medical laboratory observer.

[3]  Tom Marshall,et al.  Performance league tables: the NHS deserves better , 2002, BMJ : British Medical Journal.

[4]  George C. Runger,et al.  Comparison of multivariate CUSUM charts , 1990 .

[5]  Min Xie,et al.  Statistical Models and Control Charts for High-Quality Processes , 2002 .

[6]  E. S. Page.  CONTINUOUS INSPECTION SCHEMES , 1954 .

[7]  William H. Woodall,et al.  The Use (and Misuse) of False Alarm Probabilities in Control Chart Design , 1992 .

[8]  G. Grunkemeier,et al.  Cumulative sum techniques for assessing surgical results. , 2003, The Annals of thoracic surgery.

[9]  Fah Fatt Gan,et al.  Designs of One- and Two-Sided Exponential EWMA Charts , 1998 .

[10]  S Bolsin,et al.  The use of the Cusum technique in the assessment of trainee competence in new procedures. , 2000, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[11]  Eugene H Blackstone,et al.  Monitoring surgical performance. , 2004, The Journal of thoracic and cardiovascular surgery.

[12]  S Gallivan,et al.  Detection of changes in mortality after heart surgery , 1998, BMJ.

[13]  Tom Marshall,et al.  Bristol, Shipman, and clinical governance: Shewhart's forgotten lessons , 2001, The Lancet.

[14]  Douglas C. Montgomery,et al.  Using Control Charts to Monitor Process and Product Quality Profiles , 2004 .

[15]  K. W. Kemp,et al.  Sampling inspection of continuous processes with no autocorrelation between successive results , 1960 .

[16]  David Bock,et al.  A review and discussion of prospective statistical surveillance in public health , 2003 .

[17]  Fah Fatt Gan.  Design of optimal exponential CUSUM control charts , 1994 .

[18]  C Wolter.  Monitoring intervals between rare events: a cumulative score procedure compared with Rina Chen's sets technique. , 1987, Methods of information in medicine.

[19]  R F Raubertas,et al.  An analysis of disease surveillance data that uses the geographic locations of the reporting units. , 1989, Statistics in medicine.

[20]  G Gallus.  The relative efficiency of the sets and the cusum techniques in monitoring the occurrence of a rare event. , 1988, Statistics in medicine.

[21]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[22]  Stephen B. Vardeman,et al.  Average Run Lengths for CUSUM Schemes When Observations Are Exponentially Distributed , 1985 .

[23]  Martin Bland,et al.  Properties of the Cumulative Risk-Adjusted Mortality (CRAM) Chart, Including the Number of Deaths Before a Doubling of the Death Rate is Detected , 2003, Medical decision making : an international journal of the Society for Medical Decision Making.

[24]  R Chen.  Comparison of two statistical techniques for the surveillance of birth defects through a Monte Carlo simulation. , 1985, Statistics in medicine.

[25]  G Gallus,et al.  On surveillance methods for congenital malformations. , 1986, Statistics in medicine.

[26]  Marion R. Reynolds,et al.  The SPRT chart for monitoring a proportion , 1998 .

[27]  James M. Lucas,et al.  Exponentially weighted moving average control schemes: Properties and enhancements , 1990 .

[28]  Martin Bland,et al.  Retrospective cohort study of false alarm rates associated with a series of heart operations: the case for hospital mortality monitoring groups , 2004, BMJ : British Medical Journal.

[29]  Chris Sherlaw-Johnson,et al.  Monitoring the results of cardiac surgery by variable life-adjusted display , 1997, The Lancet.

[30]  James M. Lucas,et al.  Fast Initial Response for CUSUM Quality-Control Schemes: Give Your CUSUM A Head Start , 2000, Technometrics.

[31]  A. Dobson,et al.  The application of statistical process control charts to the detection and monitoring of hospital-acquired infections. , 2001, Journal of quality in clinical practice.

[32]  Rina Chen,et al.  A Survillance System for Congenital Malformations , 1978 .

[33]  S E Vollset,et al.  Statistical methods for surveillance of congenital malformations: when do the data indicate a true shift in the risk that an infant is affected by some type of malformation? , 1991, The International journal of risk & safety in medicine.

[34]  Harrison M. Wadsworth,et al.  Journal of Quality Technology, The , 2005 .

[35]  Nick Andrews,et al.  A Statistical Algorithm for the Early Detection of Outbreaks of Infectious Disease , 1996 .

[36]  Connie M. Borror,et al.  Poisson EWMA Control Charts , 1998 .

[37]  Marion R. Reynolds,et al.  The SPRT control chart for the process mean with samples starting at fixed times , 2001 .

[38]  Richard J Cook,et al.  Monitoring the evolutionary process of quality: risk-adjusted charting to track outcomes in intensive care. , 2003, Critical care medicine.

[39]  I Heuch,et al.  A new sequential procedure for surveillance of Down's syndrome. , 1993, Statistics in medicine.

[40]  P A Rogerson,et al.  Surveillance systems for monitoring the development of spatial patterns. , 1997, Statistics in medicine.

[41]  Richard Lilford,et al.  Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma , 2004, The Lancet.

[42]  G. Barbujani,et al.  A review of statistical methods for continuous monitoring of malformation frequencies , 1987, European Journal of Epidemiology.

[43]  Christine McGreevey,et al.  Using comparison charts to assess performance measurement data. , 2002, The Joint Commission journal on quality improvement.

[44]  William H. Woodall,et al.  Improving Healthcare with Control Charts: Basic and Advanced SPC Methods and Case Studies , 2004 .

[45]  Farrokh Alemi,et al.  Time-between control charts for monitoring asthma attacks. , 2004, Joint Commission journal on quality and safety.

[46]  Poul Thyregod,et al.  Environmental Monitoring Based on a Hierarchical Poisson-Gamma Model , 2003 .

[47]  P Littlejohns,et al.  Cumulative risk adjusted mortality chart for detecting changes in death rate: observational study of heart surgery , 1998, BMJ.

[48]  D. J. Friedman.  Some Considerations in the Use of Quality Control Techniques in Integrated Circuit , 1993 .

[49]  T. L. Gustafson,et al.  Practical risk-adjusted quality control charts for infection control. , 2000, American journal of infection control.

[50]  Marion R. Reynolds,et al.  Some Recent Developments in Control Charts for Monitoring a Proportion , 1999 .

[51]  R Chen,et al.  Analysing post-alarm data in a monitoring system in order to accept or reject the alarm. , 1993, Statistics in medicine.

[52]  L I Iezzoni,et al.  The risks of risk adjustment. , 1997, JAMA.

[53]  E. Yashchin.  Statistical Control Schemes: Methods, Applications and Generalizations , 1993 .

[54]  Nicky Best,et al.  Statistical issues in the prospective monitoring of health outcomes across multiple units , 2004 .

[55]  R Chen.  Revised values for the parameters of the sets technique for monitoring the incidence rate of a rare disease. , 1986, Methods of information in medicine.

[56]  Charles W. Champ,et al.  Exact results for shewhart control charts with supplementary runs rules , 1987 .

[57]  C. P. Farrington,et al.  The Detection of Outbreaks of Infectious Disease , 1997, Geomed.

[58]  Ron S. Kenett,et al.  On Sequential Detection of a Shift in the Probability of a Rare Event , 1983 .

[59]  D. Hawkins.  Multivariate quality control based on regression-adjusted variables , 1991 .

[60]  M. Caputo,et al.  Control chart methods for monitoring cardiac surgical performance and their interpretation. , 2004, The Journal of thoracic and cardiovascular surgery.

[61]  Kwan Lee,et al.  Using control charts to assess performance measurement data. , 2002, The Joint Commission journal on quality improvement.

[62]  Raymond G. Carey,et al.  Improving Healthcare with Control Charts: Basic and Advanced SPC Methods and Case Studies , 2002 .

[63]  Yue Fang,et al.  c-charts, X-charts, and the Katz Family of Distributions , 2003 .

[64]  K. W. Kemp,et al.  The Average Run Length of the Cumulative Sum Chart When a V‐Mask is Used , 1961 .

[65]  Zachary G. Stoumbos,et al.  Monitoring a Proportion Using CUSUM and SPRT Control Charts , 2001 .

[66]  Andrew B. Lawson,et al.  Statistical Methods in Spatial Epidemiology , 2001 .

[67]  Martin Kulldorff,et al.  Prospective time periodic geographical disease surveillance using a scan statistic , 2001 .

[68]  William H. Woodall,et al.  A review and analysis of cause-selecting control charts , 1993 .

[69]  D. Spiegelhalter,et al.  Funnel plots for institutional comparison , 2002, Quality & safety in health care.

[70]  Fassó Alessandro.  One‐sided mewama control charts , 1999 .

[71]  Chris Sherlaw-Johnson,et al.  A Method for Detecting Runs of Good and Bad Clinical Outcomes on Variable Life-Adjusted Display (VLAD) Charts , 2005, Health care management science.

[72]  Peter McCulloch,et al.  Jan using hospital mortality data performance of surgical units : validation study Mortality control charts for comparing , 2003 .

[73]  B J Klauenberg.  Re: "Fetal loss associated with two seasonal sources of electromagnetic field exposure". , 1991, American journal of epidemiology.

[74]  Noor Azina Ismail,et al.  ‘Online’ monitoring and retrospective analysis of hospital outcomes based on a scan statistic , 2003, Statistics in medicine.

[75]  Peter A. Rogerson,et al.  Monitoring point patterns for the development of space–time clusters , 2001 .

[76]  Vern T. Farewell,et al.  An overview of risk‐adjusted charts , 2004 .

[77]  Fred Spiring,et al.  Introduction to Statistical Quality Control , 2007, Technometrics.

[78]  G Barbujani,et al.  Comparison of two statistical techniques for the surveillance of birth defects through a Monte Carlo simulation. , 1984, Statistics in medicine.

[79]  N E Morton,et al.  Surveillance of Down's syndrome as a paradigm of population monitoring. , 1976, Human heredity.

[80]  Lori Hutwagner,et al.  Comparing Aberration Detection Methods with Simulated Data , 2005, Emerging infectious diseases.

[81]  T Tango,et al.  A class of tests for detecting 'general' and 'focused' clustering of rare diseases. , 1995, Statistics in medicine.

[82]  Elisabeth J. Umble,et al.  Cumulative Sum Charts and Charting for Quality Improvement , 2001, Technometrics.

[83]  G. Moustakides.  Optimal stopping times for detecting changes in distributions , 1986 .

[84]  Lloyd S. Nelson,et al.  A Control Chart for Parts-Per-Million Nonconforming Items , 1994 .

[85]  G. D. Williamson,et al.  A monitoring system for detecting aberrations in public health surveillance reports. , 1999, Statistics in medicine.

[86]  L C Hutwagner,et al.  A simulation model for assessing aberration detection methods used in public health surveillance for systems with limited baselines , 2005, Statistics in medicine.

[87]  J C Benneyan,et al.  Statistical Quality Control Methods in Infection Control and Hospital Epidemiology, Part I Introduction and Basic Theory , 1998, Infection Control & Hospital Epidemiology.

[88]  V T Farewell,et al.  Use of risk-adjusted CUSUM and RSPRTcharts for monitoring in medical contexts , 2003, Statistical methods in medical research.

[89]  James M. Lucas,et al.  Counted Data CUSUM's , 1985 .

[90]  L. Hutwagner,et al.  Using laboratory-based surveillance data for prevention: an algorithm for detecting Salmonella outbreaks. , 1997, Emerging infectious diseases.

[91]  Alicia D. Borgman,et al.  Risk-adjusted sequential probability ratio tests and longitudinal surveillance methods. , 2003, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[92]  E. S. Page.  CONTROL CHARTS WITH WARNING LINES , 1955 .

[93]  E G Knox,et al.  The Detection of Space‐Time Interactions , 1964 .

[94]  Hrafnhildur Arnkelsdóttir.  SURVEILLANCE OF RARE EVENTS. ON EVALUATION OF THE SETS METHOD , 1995 .

[95]  V T Farewell,et al.  A risk‐adjusted Sets method for monitoring adverse medical outcomes , 2004, Statistics in medicine.

[96]  R J Cook,et al.  Monitoring paired binary surgical outcomes using cumulative sum charts. , 1999, Statistics in medicine.

[97]  William H. Woodall,et al.  Introduction to Statistical Quality Control, Fifth Edition , 2005 .

[98]  George C. Runger,et al.  Multivariate Extensions to Cumulative Sum Control Charts , 2004 .

[99]  D J Spiegelhalter,et al.  Monitoring clinical performance: a commentary. , 2004, The Journal of thoracic and cardiovascular surgery.

[100]  R R Sitter,et al.  A monitoring system to detect increased rates of cancer incidence. , 1990, American journal of epidemiology.

[101]  J C Benneyan,et al.  Performance of Number-Between g-Type Statistical Control Charts for Monitoring Adverse Events , 2001, Health care management science.

[102]  J Lovegrove,et al.  Monitoring the performance of cardiac surgeons , 1999, J. Oper. Res. Soc..

[103]  Douglas M. Hawkins,et al.  Regression Adjustment for Variables in Multivariate Quality Control , 1993 .

[104]  N. Best,et al.  Following Shipman: a pilot system for monitoring mortality rates in primary care , 2003, The Lancet.

[105]  R Chen.  Re: "A monitoring system to detect increased rates of cancer incidence". , 1991, American journal of epidemiology.

[106]  M. R. Reynolds,et al.  A general approach to modeling CUSUM charts for a proportion , 2000 .

[107]  William H. Woodall,et al.  Control Charts Based on Attribute Data: Bibliography and Review , 1997 .

[108]  L. Hutwagner,et al.  The bioterrorism preparedness and response Early Aberration Reporting System (EARS) , 2003, Journal of Urban Health.

[109]  Peter A Rogerson,et al.  Monitoring change in spatial patterns of disease: comparing univariate and multivariate cumulative sum approaches , 2004, Statistics in medicine.

[110]  J C Benneyan,et al.  Statistical Quality Control Methods in Infection Control and Hospital Epidemiology, Part II: Chart Use, Statistical Properties, and Research Issues , 1998, Infection Control & Hospital Epidemiology.

[111]  M. Praus,et al.  Alert systems for post-marketing surveillance of adverse drug reactions. , 1993, Statistics in medicine.

[112]  G D Williamson,et al.  A study of the average run length characteristics of the National Notifiable Diseases Surveillance System. , 1999, Statistics in medicine.

[113]  M Frisén,et al.  Evaluations of methods for statistical surveillance. , 1992, Statistics in medicine.

[114]  F. Gan,et al.  Computing Average Run Lengths for Exponential CUSUM Schemes , 1994 .

[115]  J. Andel.  Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[116]  Kwok-Leung Tsui,et al.  On the Performance of Geometric Charts with Estimated Control Limits , 2002 .

[117]  S. O'Brien,et al.  Do CuSums have a role in routine communicable disease surveillance? , 1997, Public health.

[118]  T. Lim,et al.  Assessing doctors' competence: application of CUSUM technique in monitoring doctors' performance. , 2002, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[119]  Tom Treasure,et al.  Risk-adjusted sequential probability ratio tests: applications to Bristol, Shipman and adult cardiac surgery. , 2003, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[120]  C. Rao,et al.  Analysis of Means—A Review , 2005 .

[121]  Michael L. Millenson.  Demanding medical excellence , 1997 .

[122]  M R de Leval,et al.  Analysis of a cluster of surgical failures. Application to a series of neonatal arterial switch operations. , 1994, The Journal of thoracic and cardiovascular surgery.

[123]  J. Benneyan,et al.  Statistical process control as a tool for research and healthcare improvement , 2003, Quality & safety in health care.

[124]  Mahmoud A. Mahmoud,et al.  The Inertial Properties of Quality Control Charts , 2005, Technometrics.

[125]  B Arnrich,et al.  On-line variable live-adjusted displays with internal and external risk-adjusted mortalities. A valuable method for benchmarking and early detection of unfavourable trends in cardiac surgery. , 2004, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[126]  W. Woodall,et al.  Multivariate CUSUM Quality- Control Procedures , 1985 .

[127]  Zachary G. Stoumbos,et al.  A CUSUM Chart for Monitoring a Proportion When Inspecting Continuously , 1999 .

[128]  C. C. Chen,et al.  The bootstrap and identification of prognostic factors via Cox's proportional hazards regression model. , 1985, Statistics in medicine.

[129]  William H. Woodall,et al.  Controversies and Contradictions in Statistical Process Control , 2000 .

[130]  Eric L. Eisenstein,et al.  Risk-adjusted control charts for health care assessment , 1996, Ann. Oper. Res..

[131]  E. Järpe.  Surveillance of the interaction parameter of the ising model , 1999 .

[132]  Marion R. Reynolds,et al.  Control charts applying a general sequential test at each sampling point , 1996 .

[133]  C. A. McGilchrist,et al.  A distribution-free regional cumulative sum for identifying hyperendemic periods of disease incidence , 1999 .

[134]  S B Thacker,et al.  Public health surveillance for chronic conditions: a scientific basis for decisions. , 1995, Statistics in medicine.

[135]  Lloyd S. Nelson,et al.  Statistical Process Control for Health Care , 2003 .

[136]  Patrick D. Bourke,et al.  Detecting a shift in fraction nonconforming using runlength control charts with 100% inspection , 1991 .

[137]  Giovanni Radaelli.  Using the Cuscore technique in the surveillance of rare health events , 1992 .

[138]  Rasul A. Khan.  On Cumulative Sum Procedures and the SPRT with Applications , 1984 .

[139]  S. Steiner,et al.  Monitoring surgical performance using risk-adjusted cumulative sum charts. , 2000, Biostatistics.

[140]  Zachary G. Stoumbos,et al.  Control charts applying a sequential test at fixed sampling intervals with optional sampling at fixed times , 1993 .

[141]  A. Morton,et al.  Cumulative sum control charts for assessing performance in arterial surgery , 2004, ANZ journal of surgery.