Chapter 12: Systematic Review of Prognostic Tests

A number of new biological markers are being studied as predictors of disease or adverse medical events among those who already have a disease. Systematic reviews of this growing literature can help determine whether the available evidence supports use of a new biomarker as a prognostic test that can more accurately place patients into different prognostic groups to improve treatment decisions and the accuracy of outcome predictions. Exemplary reviews of prognostic tests are not widely available, and the methods used to review diagnostic tests do not necessarily address the most important questions about prognostic tests that are used to predict the time-dependent likelihood of future patient outcomes. We provide suggestions for those interested in conducting systematic reviews of a prognostic test. The proposed use of the prognostic test should serve as the framework for a systematic review and to help define the key questions. The outcome probabilities or level of risk and other characteristics of prognostic groups are the most salient statistics for review and perhaps meta-analysis. Reclassification tables can help determine how a prognostic test affects the classification of patients into different prognostic groups, hence their treatment. Review of studies of the association between a potential prognostic test and patient outcomes would have little impact other than to determine whether further development as a prognostic test might be warranted.

[1]  Ziding Feng,et al.  Evaluating the Predictiveness of a Continuous Marker , 2007, Biometrics.

[2]  M. Pencina,et al.  Clinical utility of different lipid measures for prediction of coronary heart disease in men and women. , 2007, JAMA.

[3]  Ying Huang,et al.  Evaluating the ROC performance of markers for future events , 2008, Lifetime data analysis.

[4]  Thomas J. Wang,et al.  Assessing the Role of Circulating, Genetic, and Imaging Biomarkers in Cardiovascular Risk Prediction , 2011, Circulation.

[5]  Patrick Royston,et al.  A new measure of prognostic separation in survival data , 2004, Statistics in medicine.

[6]  George A. Wells,et al.  An Assessment of Methods to Combine Published Survival Curves , 2000, Medical decision making : an international journal of the Society for Medical Decision Making.

[7]  E. Antman,et al.  Efficacy and safety of quinidine therapy for maintenance of sinus rhythm after cardioversion. A meta-analysis of randomized control trials. , 1990, Circulation.

[8]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[9]  P C Lambert,et al.  Reporting of prognostic markers: current problems and development of guidelines for evidence-based practice in the future , 2003, British Journal of Cancer.

[10]  Neil J Stone,et al.  Implications of Recent Clinical Trials for the National Cholesterol Education Program Adult Treatment Panel III Guidelines , 2004, Circulation.

[11]  Nancy R Cook,et al.  Advances in Measuring the Effect of Individual Predictors of Cardiovascular Risk: The Role of Reclassification Measures , 2009, Annals of Internal Medicine.

[12]  Richard D Riley,et al.  Primer: an evidence-based approach to prognostic markers , 2005, Nature Clinical Practice Oncology.

[13]  M. Pepe,et al.  Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. , 2004, American journal of epidemiology.

[14]  Nancy R. Cook,et al.  Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction , 2007, Circulation.

[15]  Joseph G. Pigeon,et al.  An Improved Goodness of Fit Statistic for Probability Prediction Models , 1999 .

[16]  F. Harrell,et al.  Criteria for Evaluation of Novel Markers of Cardiovascular Risk: A Scientific Statement From the American Heart Association , 2009, Circulation.

[17]  J. Going,et al.  Predicting the future: a critical appraisal of cancer prognosis studies , 1999, Histopathology.

[18]  Holger J Schünemann,et al.  Mortality predictions in the intensive care unit: Comparing physicians with scoring systems* , 2006, Critical care medicine.

[19]  Holly Janes,et al.  Assessing the Value of Risk Predictions by Using Risk Stratification Tables , 2008, Annals of Internal Medicine.

[20]  Oliver Riesterer,et al.  Use of molecular biomarkers for predicting the response to radiotherapy with or without chemotherapy. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[21]  Douglas G Altman,et al.  Systematic reviews of evaluations of prognostic variables , 2001, BMJ : British Medical Journal.

[22]  J. Ware.  The limitations of risk factors as prognostic tools. , 2006, The New England journal of medicine.

[23]  Yingye Zheng,et al.  Integrating the predictiveness of a marker with its performance as a classifier. , 2007, American journal of epidemiology.

[24]  W. Sauerbrei,et al.  Reporting recommendations for tumor marker prognostic studies (REMARK). , 2005, Journal of the National Cancer Institute.

[25]  A Hofman,et al.  Ankle brachial index combined with Framingham Risk Score to predict cardiovascular events and mortality: a meta-analysis. , 2008, JAMA.

[26]  K. Dear,et al.  Iterative generalized least squares for meta-analysis of survival data at multiple times. , 1994, Biometrics.

[27]  Holly Janes,et al.  Practice of Epidemiology Adjusting for Covariates in Studies of Diagnostic, Screening, or Prognostic Markers: an Old Concept in a New Setting , 2022 .

[28]  E. Elkin,et al.  Decision Curve Analysis: A Novel Method for Evaluating Prediction Models , 2006, Medical decision making : an international journal of the Society for Medical Decision Making.

[29]  M. Pencina,et al.  Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation , 2004, Statistics in medicine.

[30]  Alicja R. Rudnicka,et al.  Measures to assess the prognostic ability of the stratified Cox proportional hazards model , 2009, Statistics in medicine.

[31]  Margaret S Pepe,et al.  Gauging the performance of SNPs, biomarkers, and clinical factors for predicting risk of breast cancer. , 2008, Journal of the National Cancer Institute.

[32]  John P A Ioannidis,et al.  Selective reporting biases in cancer prognostic factor studies. , 2005, Journal of the National Cancer Institute.

[33]  E Graf,et al.  Assessment and comparison of prognostic classification schemes for survival data. , 1999, Statistics in medicine.

[34]  Ross Prentice,et al.  Research issues and strategies for genomic and proteomic biomarker discovery and validation: a statistical perspective. , 2004, Pharmacogenomics.

[35]  N. Cook.  Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction , 2007, Circulation.

[36]  Theo Stijnen,et al.  Meta‐analysis of summary survival curve data , 2008, Statistics in medicine.

[37]  Ewout W Steyerberg,et al.  Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers , 2011, Statistics in medicine.

[38]  W J Mackillop,et al.  Measuring the accuracy of prognostic judgments in oncology. , 1997, Journal of clinical epidemiology.

[39]  M. Pencina,et al.  Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond , 2008, Statistics in medicine.

[40]  B. J. Ingui,et al.  Searching for clinical prediction rules in MEDLINE. , 2001, Journal of the American Medical Informatics Association : JAMIA.

[41]  M. Pepe,et al.  Comparing the predictive values of diagnostic tests: sample size and analysis for paired study designs , 2006, Clinical trials.

[42]  R. D'Agostino,et al.  Genotype score in addition to common risk factors for prediction of type 2 diabetes. , 2008, The New England journal of medicine.

[43]  H. Hillege,et al.  Anemia and mortality in heart failure patients a systematic review and meta-analysis. , 2008, Journal of the American College of Cardiology.

[44]  M C Downer,et al.  The cost-effectiveness of screening for oral cancer in primary care. , 2006, Health technology assessment.

[45]  M. Pepe,et al.  Comparisons of Predictive Values of Binary Medical Diagnostic Tests for Paired Designs , 2000, Biometrics.

[46]  Holly Janes,et al.  Measuring the Performance of Markers for Guiding Treatment Decisions , 2011, Annals of Internal Medicine.

[47]  John P A Ioannidis,et al.  Almost all articles on cancer prognostic markers report statistically significant results. , 2007, European journal of cancer.

[48]  Jill Hayden,et al.  Evaluation of the Quality of Prognosis Studies in Systematic Reviews , 2006, Annals of Internal Medicine.

[49]  Holly Janes,et al.  Pivotal Evaluation of the Accuracy of a Biomarker Used for Classification or Prediction: Standards for Study Design , 2008, Journal of the National Cancer Institute.

[50]  M. Parmar,et al.  Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. , 1998, Statistics in medicine.

[51]  R D Cebul,et al.  The importance of disease prevalence in transporting clinical prediction rules. The case of streptococcal pharyngitis. , 1986, Annals of internal medicine.