Background: The lack of robust systems for monitoring quality in healthcare has been highlighted. Statistical process control (SPC) methods, utilizing the increasingly available routinely collected electronic patient records, could be used in creating surveillance systems that could lead to rapid detection of periods of deteriorating standards. We aimed to develop and test a CUmulative SUM (CUSUM) based surveillance system that could be used in continuous monitoring of clinical outcomes, using routinely collected data. The low Apgar score (5 minute Apgar score < 7) was used as an example outcome. Method: A surveillance system based on the Observed minus Expected (O-E) as well as the 2sided Log-Likelihood CUSUM charts was developed. The Log-Likelihood chart was designed to detect a 50% rise (deterioration) and halving (improvement) in the odds of low Apgar scores. Baseline rates were calculated from data for 2001 to 2004, and were used to monitor deliveries for 2005. Deliveries for nulliparous and multiparous women were monitored separately. All analyses were retrospective. Results: The CUSUM system detected periods of increased rates of low Apgar scores for each of the nulliparous and multiparous cohorts. The overall rate for 2005 was eventually found to be 0.67%, which was higher than the baseline reference rate of 0.44% from 2001 to 2004. Conclusion: CUSUM methods can be used in continuous monitoring of clinical outcomes using routinely collected data. Used prospectively, they could lead to the prompt detection of periods of suboptimal standards. Background Calls for robust systems for monitoring healthcare outcomes have been made [1]. The increasing use of electronic patient records in healthcare presents an opportunity for the development and application of realtime monitoring systems that can lead to the rapid detection of adverse trends in healthcare. Statistical process control (SPC) methods, developed and long used in quality control systems in the manufacturing industry [2], could become central to such efforts. We describe the design and retrospective application of a surveillance system in the continuous monitoring of clinical outcomes using an SPC tool known as the CUmulative SUM (CUSUM) chart, using routinely collected data. We used a Published: 3 November 2007 BMC Medical Research Methodology 2007, 7:46 doi:10.1186/1471-2288-7-46 Received: 4 May 2007 Accepted: 3 November 2007 This article is available from: http://www.biomedcentral.com/1471-2288/7/46 © 2007 Sibanda and Sibanda; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
[1]
Trevor A Sheldon,et al.
Sensitivity of routine system for reporting patient safety incidents in an NHS hospital: retrospective patient case note review
,
2006,
BMJ : British Medical Journal.
[2]
Andrew Whitelaw,et al.
Does training in obstetric emergencies improve neonatal outcome?
,
2006,
BJOG : an international journal of obstetrics and gynaecology.
[3]
J. Carthey,et al.
Pitfalls of adverse event reporting in paediatric cardiac intensive care
,
2004,
Archives of Disease in Childhood.
[4]
N. Best,et al.
Following Shipman: a pilot system for monitoring mortality rates in primary care
,
2003,
The Lancet.
[5]
D. Cranston,et al.
Coding errors: a comparative analysis of hospital and prospectively collected departmental data
,
2002,
BJU international.
[6]
R J Cook,et al.
Risk-Adjusted Monitoring of Binary Surgical Outcomes
,
2001,
Medical decision making : an international journal of the Society for Medical Decision Making.
[7]
Elisabeth J. Umble,et al.
Cumulative Sum Charts and Charting for Quality Improvement
,
2001,
Technometrics.
[8]
S Bolsin,et al.
The use of the Cusum technique in the assessment of trainee competence in new procedures.
,
2000,
International journal for quality in health care : journal of the International Society for Quality in Health Care.
[9]
D. Hawkins,et al.
Cumulative Sum Charts and Charting for Quality Improvement
,
1998,
Statistics for Engineering and Physical Science.
[10]
H. Devlin,et al.
The quality of routinely collected maternity data
,
1994,
British journal of obstetrics and gynaecology.
[11]
S M Williams,et al.
Quality control: an application of the cusum.
,
1992,
BMJ.
[12]
A M Dawson,et al.
Assessment of an on‐line computerized perinatal data collection and information system
,
1986,
British journal of obstetrics and gynaecology.
[13]
H. Wohl.
The cusum plot: its utility in the analysis of clinical data.
,
1977,
The New England journal of medicine.
[14]
E. S. Page.
CONTINUOUS INSPECTION SCHEMES
,
1954
.
[15]
V. Apgar.
A proposal for a new method of evaluation of the newborn infant.
,
1953,
Current researches in anesthesia & analgesia.