Retroperitoneal sarcoma perioperative risk stratification: A United States Sarcoma Collaborative evaluation of the ACS-NSQIP risk calculator.

BACKGROUND The ACS-NSQIP risk calculator predicts perioperative risk. This study tested the calculator's ability to predict risk for outcomes following retroperitoneal sarcoma (RPS) resection. METHODS The United States Sarcoma Collaborative database was queried for adults who underwent RPS resection. Estimated risk for outcomes was calculated twice in the risk calculator, once using sarcoma-specific CPT codes and once using codes indicative of most comorbid organ resection (eg nephrectomy). ROC curves were generated, with area under the curve (AUC) and Brier scores reported to assess discrimination and calibration. An AUC < 0.6 was considered ineffective discrimination. A negative ▲ Brier indicated improved performance relative to baseline outcome rates. RESULTS In total, 482 patients were identified with a 42.3% 90-day complication rate. Discrimination was poor for all outcomes except "all complications" and "renal failure." Baseline outcome rates were better predictors than calculator estimates except for "discharge to nursing or rehab facility" and "renal failure." Replacing sarcoma-specific CPT codes with resection-specific codes did not improve performance. CONCLUSION The ACS-NSQIP risk calculator poorly predicted outcomes following RPS resection. Changing sarcoma-specific CPT to resection-specific codes did not improve performance. Comorbidities in the calculator may not effectively capture perioperative risk. Future work should evaluate a sarcoma-specific calculator.

[1]  F. Sim,et al.  Can the ACS‐NSQIP surgical risk calculator predict postoperative complications in patients undergoing sacral tumor resection for chordoma? , 2020, Journal of surgical oncology.

[2]  T. Pawlik,et al.  Evaluating the ACS-NSQIP Risk Calculator in Primary GI Neuroendocrine Tumor: Results from the United States Neuroendocrine Tumor Study Group , 2019, The American surgeon.

[3]  T. Pawlik,et al.  Evaluating the ACS NSQIP Risk Calculator in Primary Pancreatic Neuroendocrine Tumor: Results from the US Neuroendocrine Tumor Study Group , 2019, Journal of Gastrointestinal Surgery.

[4]  I. Endo,et al.  Evaluation of the ACS NSQIP Surgical Risk Calculator in Elderly Patients Undergoing Hepatectomy for Hepatocellular Carcinoma , 2019, Journal of Gastrointestinal Surgery.

[5]  K. Delman,et al.  Studying a Rare Disease Using Multi-Institutional Research Collaborations vs Big Data: Where Lies the Truth? , 2018, Journal of the American College of Surgeons.

[6]  A. Ejaz,et al.  Accuracy of the ACS NSQIP Online Risk Calculator Depends on How You Look at It: Results from the United States Gastric Cancer Collaborative , 2018, The American surgeon.

[7]  T. Pawlik,et al.  Evaluating the American College of Surgeons National Surgical Quality Improvement project risk calculator: results from the U.S. Extrahepatic Biliary Malignancy Consortium. , 2017, HPB : the official journal of the International Hepato Pancreato Biliary Association.

[8]  S. Bonvalot,et al.  Postoperative Morbidity After Radical Resection of Primary Retroperitoneal Sarcoma: A Report From the Transatlantic RPS Working Group , 2017, Annals of surgery.

[9]  J. Wunder,et al.  Can the ACS‐NSQIP surgical risk calculator predict post‐operative complications in patients undergoing flap reconstruction following soft tissue sarcoma resection? , 2016, Journal of surgical oncology.

[10]  N. Wingert,et al.  The ACS NSQIP Risk Calculator Is a Fair Predictor of Acute Periprosthetic Joint Infection , 2016, Clinical orthopaedics and related research.

[11]  Jeffrey E. Lee,et al.  Ninety-day Postoperative Mortality Is a Legitimate Measure of Hepatopancreatobiliary Surgical Quality , 2015, Annals of surgery.

[12]  Michael J Pencina,et al.  Evaluating Discrimination of Risk Prediction Models: The C Statistic. , 2015, JAMA.

[13]  C. Antonescu,et al.  Lessons Learned From the Study of 10,000 Patients With Soft Tissue Sarcoma , 2014, Annals of surgery.

[14]  C. Ko,et al.  Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. , 2013, Journal of the American College of Surgeons.

[15]  J. V. van Lanschot,et al.  Comparison of 30‐day, 90‐day and in‐hospital postoperative mortality for eight different cancer types , 2012, The British journal of surgery.

[16]  Helen M Parsons,et al.  Missing data and interpretation of cancer surgery outcomes at the American College of Surgeons National Surgical Quality Improvement Program. , 2011, Journal of the American College of Surgeons.

[17]  D. McMillan,et al.  A Systematic Review of POSSUM and its Related Models as Predictors of Post-operative Mortality and Morbidity in Patients Undergoing Surgery for Colorectal Cancer , 2010, Journal of Gastrointestinal Surgery.

[18]  H. Pitt,et al.  Pancreatectomy risk calculator: an ACS-NSQIP resource. , 2010, HPB : the official journal of the International Hepato Pancreato Biliary Association.

[19]  N. Obuchowski,et al.  Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures , 2010, Epidemiology.

[20]  C. Ko,et al.  Development of an American College of Surgeons National Surgery Quality Improvement Program: morbidity and mortality risk calculator for colorectal surgery. , 2009, Journal of the American College of Surgeons.

[21]  N. Demartines,et al.  Classification of Surgical Complications: A New Proposal With Evaluation in a Cohort of 6336 Patients and Results of a Survey , 2004, Annals of Surgery.

[22]  R. Gonzalez,et al.  Current principles of surgery for retroperitoneal sarcomas , 2018, Journal of surgical oncology.

[23]  T. Group,et al.  Management of Primary Retroperitoneal Sarcoma (RPS) in the Adult: A Consensus Approach From the Trans-Atlantic RPS Working Group , 2014, Annals of Surgical Oncology.

[24]  C. Ko,et al.  An Opportunity to Improve Informed Consent and Shared Decision Making: The Role of the ACS NSQIP Surgical Risk Calculator in Oncology , 2013, Annals of Surgical Oncology.

[25]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.