The National Surgical Quality Improvement Program in Non-Veterans Administration Hospitals: Initial Demonstration of Feasibility

ObjectiveTo assess the feasibility of implementing the National Surgical Quality Improvement Program (NSQIP) methodology in non-VA hospitals. Summary Background DataUsing data adjusted for patient preoperative risk, the NSQIP compares the performance of all VA hospitals performing major surgery and anonymously compares these hospitals using the ratio of observed to expected adverse events. These results are provided to each hospital and used to identify areas for improvement. Since the NSQIP’s inception in 1994, the VA has reported consistent improvements in all surgery performance measures. Given the success of the NSQIP within the VA, as well as the lack of a comparable system in non-VA hospitals, this pilot study was undertaken to test the applicability of the NSQIP models and methodology in the nonfederal sector. MethodsBeginning in 1999, three academic medical centers (Emory University, Atlanta, GA; University of Michigan, Ann Arbor, MI; University of Kentucky, Lexington, KY) volunteered the time of a dedicated surgical nurse reviewer who was trained in NSQIP methodology. At each academic center, these nurse reviewers used NSQIP protocols to abstract clinical data from general surgery and vascular surgery patients. Data were manually collected and then transmitted via the Internet to a secure web site developed by the NSQIP. These data were compared to the data for general and vascular surgery patients collected during a concurrent time period (10/99 to 9/00) within the VA by the NSQIP. Logistic regression models were developed for both non-VA and VA hospital data. To assess the models’ predictive values, C-indices (0.5 = no prediction; 1.0 = perfect prediction) were calculated after applying the models to the non-VA as well as the VA databases. ResultsData from 2,747 (general surgery 2,251; vascular surgery 496) non-VA hospital cases were compared to data from 41,360 (general surgery 31,393; vascular surgery 9,967) VA cases. The bivariate relationships between individual risk factors and 30-day mortality or morbidity were similar in the non-VA and VA patient populations for over 66% of the risk variables. C-indices of 0.942 (general surgery), 0.915 (vascular surgery), and 0.934 (general plus vascular surgery) were obtained following application of the VA NSQIP mortality model to the non-VA patient data. Lower C-indices (0.778, general surgery; 0.638, vascular surgery; 0.760, general plus vascular surgery) were obtained following application of the VA NSQIP morbidity model to the non-VA patient data. Although the non-VA sample size was smaller than the VA, preliminary analysis suggested no differences in risk-adjusted mortality between the non-VA and VA cohorts. ConclusionsWith some adjustments, the NSQIP methodology can be implemented and generates reasonable predictive models within non-VA hospitals.

[1]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[2]  J Gibbs,et al.  Validating risk-adjusted surgical outcomes: chart review of process of care. , 2001, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[3]  H. Rüden,et al.  Can quality circles improve hospital-acquired infection control? , 2000, The Journal of hospital infection.

[4]  R. S. Mitchell,et al.  Institutional peer review can reduce the risk and cost of carotid endarterectomy. , 2000, Archives of surgery.

[5]  P. Barach,et al.  Reporting and preventing medical mishaps: lessons from non-medical near miss reporting systems , 2000, BMJ : British Medical Journal.

[6]  T P Clemmer,et al.  Results of a collaborative quality improvement program on outcomes and costs in a tertiary critical care unit. , 1999, Critical care medicine.

[7]  A. Gawande,et al.  The incidence and nature of surgical adverse events in Colorado and Utah in 1992. , 1999, Surgery.

[8]  A L Shroyer,et al.  The 1996 coronary artery bypass risk model: the Society of Thoracic Surgeons Adult Cardiac National Database. , 1998, The Annals of thoracic surgery.

[9]  W. Henderson,et al.  Preoperative serum albumin level as a predictor of operative mortality and morbidity: results from the National VA Surgical Risk Study. , 1999, Archives of surgery.

[10]  F. Grover,et al.  The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. , 1998, Annals of surgery.

[11]  M. Chassin,et al.  The urgent need to improve health care quality. Institute of Medicine National Roundtable on Health Care Quality. , 1998, JAMA.

[12]  S B Soumerai,et al.  Effect of local medical opinion leaders on quality of care for acute myocardial infarction: a randomized controlled trial. , 1998, JAMA.

[13]  M P Charns,et al.  Patterns of coordination and clinical outcomes: a study of surgical services. , 1997, Health services research.

[14]  Total hip replacement: a case history. , 1998, Health care management review.

[15]  K. Hammermeister,et al.  Risk adjustment of the postoperative morbidity rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study. , 1998, Journal of the American College of Surgeons.

[16]  Gary J. Young,et al.  Validating risk-adjusted surgical outcomes: site visit assessment of process and structure1 , 1997 .

[17]  A. Barkun,et al.  Measuring postoperative complications in general surgery patients using an outcomes-based strategy: comparison with complications presented at morbidity and mortality rounds. , 1997, Surgery.

[18]  F. Grover,et al.  Risk adjustment of the postoperative mortality rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study. , 1997, Journal of the American College of Surgeons.

[19]  N. Simon,et al.  Improving the processes of care and outcomes in obstetrics/gynecology. , 1997, The Joint Commission journal on quality improvement.

[20]  G. Young,et al.  Best practices for managing surgical services: the role of coordination. , 1997, Health care management review.

[21]  G. Young,et al.  Validating risk-adjusted surgical outcomes: site visit assessment of process and structure. National VA Surgical Risk Study. , 1997, Journal of the American College of Surgeons.

[22]  Russell L. Stogsdill,et al.  A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The Northern New England Cardiovascular Disease Study Group. , 1996, JAMA.

[23]  B. Griffith,et al.  The Need for Accurate Risk‐Adjusted Measures of Outcome in Surgery: Lessons Learned Through Coronary Artery Bypass , 1995, Annals of Surgery.

[24]  R. McLeod,et al.  The National Veterans Administration Surgical Risk Study: risk adjustment for the comparative assessment of the quality of surgical care. , 1995, Journal of the American College of Surgeons.

[25]  G. Marshall,et al.  The Veterans Affairs Continuous Improvement in Cardiac Surgery Study. , 1994, The Annals of thoracic surgery.

[26]  E L Hannan,et al.  Improving the outcomes of coronary artery bypass surgery in New York State. , 1994, JAMA.

[27]  H S Luft,et al.  Chance, continuity, and change in hospital mortality rates. Coronary artery bypass graft patients in California hospitals, 1983 to 1989. , 1993, JAMA.

[28]  S. Khuri,et al.  Coronary bypass surgery improves survival in high-risk unstable angina. Results of a Veterans Administration Cooperative study with an 8-year follow-up. Veterans Administration Unstable Angina Cooperative Study Group. , 1991, Circulation.

[29]  F. Ingelfinger.  The Graying of Grand Rounds , 1978 .

[30]  F. Ingelfinger.  Sounding boards. The graying of grand rounds. , 1978, The New England journal of medicine.