Direct comparison of risk-adjusted and non-risk-adjusted CUSUM analyses of coronary artery bypass surgery outcomes.

OBJECTIVE We previously applied non-risk-adjusted cumulative sum methods to analyze coronary bypass outcomes. The objective of this study was to assess the incremental advantage of risk-adjusted cumulative sum methods in this setting. METHODS Prospective data were collected in 793 consecutive patients who underwent coronary bypass grafting performed by a single surgeon during a period of 5 years. The composite occurrence of an "adverse outcome" included mortality or any of 10 major complications. An institutional logistic regression model for adverse outcome was developed by using 2608 contemporaneous patients undergoing coronary bypass. The predicted risk of adverse outcome in each of the surgeon's 793 patients was then calculated. A risk-adjusted cumulative sum curve was then generated after specifying control limits and odds ratio. This risk-adjusted curve was compared with the non-risk-adjusted cumulative sum curve, and the clinical significance of this difference was assessed. RESULTS The surgeon's adverse outcome rate was 96 of 793 (12.1%) versus 270 of 1815 (14.9%) for all the other institution's surgeons combined (P = .06). The non-risk-adjusted curve reached below the lower control limit, signifying excellent outcomes between cases 164 and 313, 323 and 407, and 667 and 793, but transgressed the upper limit between cases 461 and 478. The risk-adjusted cumulative sum curve never transgressed the upper control limit, signifying that cases preceding and including 461 to 478 were at an increased predicted risk. Furthermore, if the risk-adjusted cumulative sum curve was reset to zero whenever a control limit was reached, it still signaled a decrease in adverse outcome at 166, 653, and 782 cases. CONCLUSIONS Risk-adjusted cumulative sum techniques provide incremental advantages over non-risk-adjusted methods by not signaling a decrement in performance when preoperative patient risk is high.

[1]  M. Caputo,et al.  Control chart methods for monitoring cardiac surgical performance and their interpretation. , 2004, The Journal of thoracic and cardiovascular surgery.

[2]  Richard J Cook,et al.  Monitoring the evolutionary process of quality: risk-adjusted charting to track outcomes in intensive care. , 2003, Critical care medicine.

[3]  Stefan H. Steiner,et al.  Risk-Adjusted Analysis of Outcomes Following Elective Open Abdominal Aortic Aneurysm Repair , 2005, Annals of vascular surgery.

[4]  T. Forbes A cumulative analysis of an individual surgeon's early experience with elective open abdominal aortic aneurysm repair. , 2005, American journal of surgery.

[5]  R J Cook,et al.  Risk-Adjusted Monitoring of Binary Surgical Outcomes , 2001, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  L. Stitt,et al.  The Learning Curve of an Academic Cardiac Surgeon: Use of the CUSUM Method , 1999 .

[7]  Stefan H Steiner,et al.  Risk-adjusted analysis of early mortality after ruptured abdominal aortic aneurysm repair. , 2005, Journal of vascular surgery.

[8]  Chris Sherlaw-Johnson,et al.  Monitoring the results of cardiac surgery by variable life-adjusted display , 1997, The Lancet.

[9]  Eugene H Blackstone,et al.  Monitoring surgical performance. , 2004, The Journal of thoracic and cardiovascular surgery.

[10]  M R de Leval,et al.  Analysis of a cluster of surgical failures. Application to a series of neonatal arterial switch operations. , 1994, The Journal of thoracic and cardiovascular surgery.

[11]  S. Steiner,et al.  Monitoring surgical performance using risk-adjusted cumulative sum charts. , 2000, Biostatistics.

[12]  N. Banner,et al.  Cumulative risk adjusted monitoring of 30-day mortality after cardiothoracic transplantation: UK experience. , 2005, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[13]  D J Spiegelhalter,et al.  Monitoring clinical performance: a commentary. , 2004, The Journal of thoracic and cardiovascular surgery.

[14]  T. Treasure,et al.  Monitoring cardiac surgical performance: a commentary. , 2004, The Journal of thoracic and cardiovascular surgery.

[15]  R Rayman,et al.  Cumulative sum failure analysis of a policy change from on-pump to off-pump coronary artery bypass grafting. , 2001, The Annals of thoracic surgery.

[16]  G. Grunkemeier,et al.  Cumulative sum techniques for assessing surgical results. , 2003, The Annals of thoracic surgery.

[17]  W. Boyd,et al.  Analysis of the learning curve in telerobotic, beating heart coronary artery bypass grafting: a 90 patient experience. , 2003, The Annals of thoracic surgery.