N-terminal pro-B-type Natriuretic Peptides’ Prognostic Utility Is Overestimated in Meta-analyses Using Study-specific Optimal Diagnostic Thresholds

Background:N-terminal fragment B-type natriuretic peptide (NT-proBNP) prognostic utility is commonly determined post hoc by identifying a single optimal discrimination threshold tailored to the individual study population. The authors aimed to determine how using these study-specific post hoc thresholds impacts meta-analysis results. Methods:The authors conducted a systematic review of studies reporting the ability of preoperative NT-proBNP measurements to predict the composite outcome of all-cause mortality and nonfatal myocardial infarction at 30 days after noncardiac surgery. Individual patient-level data NT-proBNP thresholds were determined using two different methodologies. First, a single combined NT-proBNP threshold was determined for the entire cohort of patients, and a meta-analysis conducted using this single threshold. Second, study-specific thresholds were determined for each individual study, with meta-analysis being conducted using these study-specific thresholds. Results:The authors obtained individual patient data from 14 studies (n = 2,196). Using a single NT-proBNP cohort threshold, the odds ratio (OR) associated with an increased NT-proBNP measurement was 3.43 (95% CI, 2.08 to 5.64). Using individual study-specific thresholds, the OR associated with an increased NT-proBNP measurement was 6.45 (95% CI, 3.98 to 10.46). In smaller studies (<100 patients) a single cohort threshold was associated with an OR of 5.4 (95% CI, 2.27 to 12.84) as compared with an OR of 14.38 (95% CI, 6.08 to 34.01) for study-specific thresholds. Conclusions:Post hoc identification of study-specific prognostic biomarker thresholds artificially maximizes biomarker predictive power, resulting in an amplification or overestimation during meta-analysis of these results. This effect is accentuated in small studies.

[1]  Jim Lewsey,et al.  Medical Statistics: A Guide to Data Analysis and Critical Appraisal , 2015 .

[2]  Chien-Chang Lee,et al.  Predictive value of plasma brain natriuretic peptide for postoperative cardiac complications--a systemic review and meta-analysis. , 2014, Journal of critical care.

[3]  P. J. Devereaux,et al.  The prognostic value of pre-operative and post-operative B-type natriuretic peptides in patients undergoing noncardiac surgery: B-type natriuretic peptide and N-terminal fragment of pro-B-type natriuretic peptide: a systematic review and individual patient data meta-analysis. , 2014, Journal of the American College of Cardiology.

[4]  P. Rehak,et al.  Role of N-terminal pro B-type natriuretic peptide in identifying patients at high risk for adverse outcome after emergent non-cardiac surgery. , 2013, British journal of anaesthesia.

[5]  W. Studer,et al.  Randomized Comparison of Sevoflurane Versus Propofol to Reduce Perioperative Myocardial Ischemia in Patients Undergoing Noncardiac Surgery , 2012, Circulation.

[6]  R. Jankovic,et al.  N-terminal B-type natriuretic peptide versus revised Lee index for the assessment of the perioperative cardiac risk after major non cardiac surgery: 4AP5-5 , 2012 .

[7]  J. Savige,et al.  N-terminal pro-brain natriuretic peptide and angiotensin-converting enzyme-2 levels and their association with postoperative cardiac complications after emergency orthopedic surgery. , 2012, The American journal of cardiology.

[8]  M. Cannesson,et al.  Assessing the Diagnostic Accuracy of Pulse Pressure Variations for the Prediction of Fluid Responsiveness: A “Gray Zone” Approach , 2011, Anesthesiology.

[9]  M. Banach,et al.  Prognostic value of plasma N-terminal pro-B-type natriuretic peptide concentration in patients with normal and impaired left ventricular systolic function undergoing surgery for abdominal aortic aneurysm , 2011, Archives of medical science : AMS.

[10]  B. Cuthbertson,et al.  The predictive ability of pre-operative B-type natriuretic peptide in vascular patients for major adverse cardiac events: an individual patient data meta-analysis. , 2011, Journal of the American College of Cardiology.

[11]  J. Brittenden,et al.  N-terminal pro-B-type natriuretic peptide is an independent predictor of all-cause mortality and MACE after major vascular surgery in medium-term follow-up. , 2011, European journal of vascular and endovascular surgery : the official journal of the European Society for Vascular Surgery.

[12]  J. Savige,et al.  Usefulness of N-terminal pro-brain natriuretic peptide to predict postoperative cardiac complications and long-term mortality after emergency lower limb orthopedic surgery. , 2010, The American journal of cardiology.

[13]  J. Savige,et al.  Troponin I and NT-proBNP (N-terminal pro-brain natriuretic peptide) do not predict 6-month mortality in frail older patients undergoing orthopedic surgery. , 2010, Journal of the American Medical Directors Association.

[14]  T. Houle,et al.  Statistical Evaluation of a Biomarker , 2010, Anesthesiology.

[15]  S. Yusuf,et al.  Is a pre-operative brain natriuretic peptide or N-terminal pro-B-type natriuretic peptide measurement an independent predictor of adverse cardiovascular outcomes within 30 days of noncardiac surgery? A systematic review and meta-analysis of observational studies. , 2009, Journal of the American College of Cardiology.

[16]  M. Fredrikson,et al.  Predictors of cardiac events in high‐risk patients undergoing emergency surgery , 2009, Acta anaesthesiologica Scandinavica.

[17]  Saurabh Kumar,et al.  Prognostic Value of Brain Natriuretic Peptide in Noncardiac Surgery: A Meta-analysis , 2009, Anesthesiology.

[18]  C. Çevik,et al.  Plasma N-terminal prohormone brain natriuretic peptide as a marker for postoperative cardiac events in high-risk patients undergoing noncardiac surgery. , 2009, The American journal of cardiology.

[19]  B. Biccard,et al.  A meta‐analysis of the utility of pre‐operative brain natriuretic peptide in predicting early and intermediate‐term mortality and major adverse cardiac events in vascular surgical patients , 2008, Anaesthesia.

[20]  P. Royston,et al.  Selection of important variables and determination of functional form for continuous predictors in multivariable model building , 2007, Statistics in medicine.

[21]  P. Rehak,et al.  N-Terminal Pro-brain Natriuretic Peptide Identifies Patients at High Risk for Adverse Cardiac Outcome after Vascular Surgery , 2007, Anesthesiology.

[22]  G. Veronesi,et al.  Increased Perioperative N-Terminal Pro-B-Type Natriuretic Peptide Levels Predict Atrial Fibrillation After Thoracic Surgery for Lung Cancer , 2007, Circulation.

[23]  Patrick Royston,et al.  The cost of dichotomising continuous variables , 2006, BMJ : British Medical Journal.

[24]  A. Adeyoju,et al.  Troponin T and N-terminal pro-brain natriuretic peptide changes in patients undergoing transurethral resection of the prostate. , 2005, The Journal of urology.

[25]  Belinda Barton,et al.  Medical Statistics: A Guide to SPSS, Data Analysis and Critical Appraisal , 2005 .

[26]  M LeBlanc,et al.  Binary partitioning for continuous longitudinal data: categorizing a prognostic variable , 2002, Statistics in medicine.

[27]  M. Mazumdar,et al.  Categorizing a prognostic variable: review of methods, code for easy implementation and applications to decision-making about cancer treatments. , 2000, Statistics in medicine.

[28]  D. Altman.  Suboptimal analysis using 'optimal' cutpoints. , 1998, British Journal of Cancer.

[29]  M. Żukowski,et al.  The usefulness of N-terminal pro-brain natriuretic peptide and cardiac troponin measurement in the prediction of cardiac morbidity after carotid endarterectomy , 2011 .