Cardiac surgery risk modeling for mortality: a review of current practice and suggestions for improvement.

Risk models play a vital role in monitoring health care performances. Despite extensive research and widespread use of risk models in cardiac surgery, there are methodologic problems. We reviewed the methodology used for risk models for short-term mortality. The findings suggest that many risk models are developed in an ad hoc manner. Important aspects such as selection of risk factors, handling of missing values, and size of the data used for model development are not dealt with adequately. Methodologic details presented in publications are often sparse and unclear. Model development and validation processes are not always linked to the clinical aim of the model, which may affect their clinical validity. We make some suggestions in this review for improvement in methodology and reporting.

[1]  J. Wennberg,et al.  Multivariate Prediction of In‐Hospital Mortality Associated With Coronary Artery Bypass Graft Surgery , 1992 .

[2]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[3]  E L Hannan,et al.  Improving the outcomes of coronary artery bypass surgery in New York State. , 1994, JAMA.

[4]  S L Normand,et al.  Cardiac surgery report cards: comprehensive review and statistical critique. , 2001, The Annals of thoracic surgery.

[5]  N. Galai,et al.  A national study of postoperative mortality associated with coronary artery bypass grafting in Israel. ISCAB Consortium. Israel Coronary Artery Bypass Study. , 1998, The Annals of thoracic surgery.

[6]  J. Alpert,et al.  ACC/AHA guidelines for coronary artery bypass graft surgery , 1999 .

[7]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[8]  D G Altman,et al.  What do we mean by validating a prognostic model? , 2000, Statistics in medicine.

[9]  A. Shroyer,et al.  The Society of Thoracic Surgeons National Cardiac Surgery Database: current risk assessment. , 1997, The Annals of thoracic surgery.

[10]  R. Omar,et al.  Assessment of quality of care in cardiac surgery: An overview of risk models , 2003 .

[11]  C D Naylor,et al.  Assessing the outcomes of coronary artery bypass graft surgery: how many risk factors are enough? Steering Committee of the Cardiac Care Network of Ontario. , 1997, Journal of the American College of Cardiology.

[12]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[13]  A L Shroyer,et al.  Bayesian-logit model for risk assessment in coronary artery bypass grafting. , 1994, The Annals of thoracic surgery.

[14]  G. Beck,et al.  Stratification of morbidity and mortality outcome by preoperative risk factors in coronary artery bypass patients. A clinical severity score. , 1992, JAMA.

[15]  C D Naylor,et al.  Ready-made, recalibrated, or Remodeled? Issues in the use of risk indexes for assessing mortality after coronary artery bypass graft surgery. , 1999, Circulation.

[16]  F H Edwards,et al.  Use of a Bayesian statistical model for risk assessment in coronary artery surgery. , 1988, The Annals of thoracic surgery.

[17]  M Schumacher,et al.  A bootstrap resampling procedure for model building: application to the Cox regression model. , 1992, Statistics in medicine.

[18]  S. Lemeshow,et al.  European system for cardiac operative risk evaluation (EuroSCORE). , 1999, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[19]  H. Barron,et al.  A risk model derived from the National Registry of Myocardial Infarction 2 database for predicting mortality after coronary artery bypass grafting during acute myocardial infarction. , 2002, The American journal of cardiology.

[20]  F B Hu,et al.  Comparison of population-averaged and subject-specific approaches for analyzing repeated binary outcomes. , 1998, American journal of epidemiology.

[21]  J. Alpert,et al.  ACC/AHA guidelines for coronary artery bypass graft surgery: executive summary and recommendations : A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee to revise the 1991 guidelines for coronary artery bypass graft surgery). , 1999, Circulation.

[22]  A. Bernstein,et al.  A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. , 1989, Circulation.

[23]  M. Amrani,et al.  An evaluation of existing risk stratification models as a tool for comparison of surgical performances for coronary artery bypass grafting between institutions. , 2003, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[24]  M. Amrani,et al.  Validation of four different risk stratification systems in patients undergoing off-pump coronary artery bypass surgery: a UK multicentre analysis of 2223 patients , 2003, Heart.

[25]  A L Shroyer,et al.  The 1996 coronary artery bypass risk model: the Society of Thoracic Surgeons Adult Cardiac National Database. , 1998, The Annals of thoracic surgery.

[26]  J. Borrás,et al.  Assessing open heart surgery mortality in Catalonia (Spain) through a predictive risk model. , 1997, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[27]  R. Lippmann,et al.  Coronary artery bypass risk prediction using neural networks. , 1997, Annals of Thoracic Surgery.

[28]  J. Tu,et al.  Multicenter validation of a risk index for mortality, intensive care unit stay, and overall hospital length of stay after cardiac surgery. Steering Committee of the Provincial Adult Cardiac Care Network of Ontario. , 1995, Circulation.

[29]  A. Bernstein,et al.  Bedside estimation of risk as an aid for decision-making in cardiac surgery. , 2000, The Annals of thoracic surgery.

[30]  J. Concato,et al.  A simulation study of the number of events per variable in logistic regression analysis. , 1996, Journal of clinical epidemiology.

[31]  J. Concato,et al.  The Risk of Determining Risk with Multivariable Models , 1993, Annals of Internal Medicine.

[32]  R Z Omar,et al.  Analysis of a cluster randomized trial with binary outcome data using a multi-level model. , 2000, Statistics in medicine.

[33]  S. Nashef,et al.  Eurp-pean system for cardiac operative risk evaluation (Euro SCORE) , 1999 .