Reporting recommendations for tumor marker prognostic studies (REMARK): explanation and elaboration

BackgroundThe Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK) checklist consists of 20 items to report for published tumor marker prognostic studies. It was developed to address widespread deficiencies in the reporting of such studies. In this paper we expand on the REMARK checklist to enhance its use and effectiveness through better understanding of the intent of each item and why the information is important to report.MethodsREMARK recommends including a transparent and full description of research goals and hypotheses, subject selection, specimen and assay considerations, marker measurement methods, statistical design and analysis, and study results. Each checklist item is explained and accompanied by published examples of good reporting, and relevant empirical evidence of the quality of reporting. We give prominence to discussion of the 'REMARK profile', a suggested tabular format for summarizing key study details.SummaryThe paper provides a comprehensive overview to educate on good reporting and provide a valuable reference for the many issues to consider when designing, conducting, and analyzing tumor marker studies and prognostic studies in medicine in general.To encourage dissemination of the Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK): Explanation and Elaboration, this article has also been published in PLoS Medicine.

[1]  M. Parmar,et al.  Association of molecular markers with toxicity outcomes in a randomized trial of chemotherapy for advanced colorectal cancer: the FOCUS trial. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[2]  M. Schmelz,et al.  Prognostic criteria for squamous cell cancer of the skin. , 2010, The Journal of surgical research.

[3]  W. Sauerbrei,et al.  Reporting of prognostic studies of tumour markers: a review of published articles in relation to REMARK guidelines , 2009, British Journal of Cancer.

[4]  D. Moher,et al.  The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration , 2001, Annals of Internal Medicine.

[5]  Richard D Riley,et al.  A Systematic Review of Molecular and Biological Tumor Markers in Neuroblastoma , 2004, Clinical Cancer Research.

[6]  H. Hollema,et al.  The ErbB signalling pathway: protein expression and prognostic value in epithelial ovarian cancer , 2008, British Journal of Cancer.

[7]  H. White,et al.  Logistic regression in the medical literature: standards for use and reporting, with particular attention to one medical domain. , 2001, Journal of clinical epidemiology.

[8]  Patrick Royston,et al.  Multivariable Model-Building: A Pragmatic Approach to Regression Analysis based on Fractional Polynomials for Modelling Continuous Variables , 2008 .

[9]  S. Love,et al.  Survival Analysis Part II: Multivariate data analysis – an introduction to concepts and methods , 2003, British Journal of Cancer.

[10]  E Marubini,et al.  Analysing Survival Data from Clinical Trials and Observational Studies; E. Marubini & M. G. Valsecchi Published by John Wiley & Sons 414 pages ISBN 0-971-93987-0. , 1995, British journal of clinical pharmacology.

[11]  T. Stijnen,et al.  Review: a gentle introduction to imputation of missing values. , 2006, Journal of clinical epidemiology.

[12]  M. Falagas,et al.  A systematic review of trends in the methodological quality of randomized controlled trials in various research fields. , 2009, Journal of clinical epidemiology.

[13]  W. Scheithauer,et al.  Limited Value of CA 19-9 in Predicting Early Treatment Failure in Patients with Advanced Pancreatic Cancer , 2008, Oncology.

[14]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[15]  Alvan R. Feinstein,et al.  Multivariable Analysis: An Introduction , 1996 .

[16]  M. Mazumdar,et al.  Increased shedding of HU177 correlates with worse prognosis in primary melanoma , 2010, Journal of Translational Medicine.

[17]  D G Altman,et al.  Prognostic markers in cancer: the evolution of evidence from single studies to meta-analysis, and beyond , 2009, British Journal of Cancer.

[18]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[19]  M. Caligiuri,et al.  Wilms' tumor 1 gene mutations independently predict poor outcome in adults with cytogenetically normal acute myeloid leukemia: a cancer and leukemia group B study. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[20]  S. Bentzen Prognostic factor studies in oncology: osteosarcoma as a clinical example. , 2001, International journal of radiation oncology, biology, physics.

[21]  Stephen R Cole,et al.  Use of multiple imputation in the epidemiologic literature. , 2008, American journal of epidemiology.

[22]  G. Giaccone,et al.  Is a patient's self-reported health-related quality of life a prognostic factor for survival in non-small-cell lung cancer patients? A multivariate analysis of prognostic factors of EORTC study 08975. , 2006, Annals of oncology : official journal of the European Society for Medical Oncology.

[23]  Martin Schumacher,et al.  Risk factors for the development of nosocomial pneumonia and mortality on intensive care units: application of competing risks models , 2008, Critical care.

[24]  W. Sauerbrei,et al.  Dangers of using "optimal" cutpoints in the evaluation of prognostic factors. , 1994, Journal of the National Cancer Institute.

[25]  D. G. Altman,et al.  Review of survival analyses published in cancer journals. , 1995, British Journal of Cancer.

[26]  Carl van Walraven,et al.  Time-dependent bias was common in survival analyses published in leading clinical journals. , 2004, Journal of clinical epidemiology.

[27]  D. Sargent,et al.  End points for adjuvant therapy trials: has the time come to accept disease-free survival as a surrogate end point for overall survival? , 2006, The oncologist.

[28]  P. Bossuyt,et al.  Reporting bias in diagnostic and prognostic studies: time for action. , 2008, Clinical chemistry.

[29]  R. Gray Weighted analyses for cohort sampling designs , 2009, Lifetime data analysis.

[30]  J. Verdebout,et al.  Role of Bcl-2 as a prognostic factor for survival in lung cancer: a systematic review of the literature with meta-analysis , 2003, British Journal of Cancer.

[31]  P. Quirke,et al.  DNA markers predicting benefit from adjuvant fluorouracil in patients with colon cancer: a molecular study , 2002, The Lancet.

[32]  L. Akslen,et al.  Prognostic impact of alterations in P-cadherin expression and related cell adhesion markers in endometrial cancer. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[33]  E. Shpall,et al.  Prognostic analysis of tumour angiogenesis, determined by microvessel density and expression of vascular endothelial growth factor, in high-risk primary breast cancer patients treated with high-dose chemotherapy , 2007, British Journal of Cancer.

[34]  J. Vandenbroucke Prospective or retrospective: what's in a name? , 1991, BMJ.

[35]  Martin Schumacher,et al.  The impact of time‐dependent bias in proportional hazards modelling , 2008, Statistics in medicine.

[36]  V. McCormack,et al.  Issues in the reporting of epidemiological studies: a survey of recent practice , 2004, BMJ : British Medical Journal.

[37]  P W Lavori,et al.  Sample-size calculations for the Cox proportional hazards regression model with nonbinary covariates. , 2000, Controlled clinical trials.

[38]  Per Kragh Andersen,et al.  Competing Risks and Time‐Dependent Covariates , 2009, Biometrical journal. Biometrische Zeitschrift.

[39]  John P A Ioannidis,et al.  Almost all articles on cancer prognostic markers report statistically significant results. , 2007, European journal of cancer.

[40]  J. Foekens,et al.  The prognostic value of polymorphonuclear leukocyte elastase in patients with primary breast cancer. , 2003, Cancer research.

[41]  J. Coindre,et al.  Obvious peritumoral emboli: an elusive prognostic factor reappraised. Multivariate analysis of 1320 node-negative breast cancers. , 1998, European journal of cancer.

[42]  F. Harrell,et al.  Regression models for prognostic prediction: advantages, problems, and suggested solutions. , 1985, Cancer treatment reports.

[43]  D. Seligson,et al.  Expression of epithelial membrane protein‐2 is associated with endometrial adenocarcinoma of unfavorable outcome , 2006, Cancer.

[44]  David W. Hosmer,et al.  Applied Survival Analysis: Regression Modeling of Time-to-Event Data , 2008 .

[45]  R. Ceriani,et al.  Levels of expression of breast epithelial mucin detected by monoclonal antibody BrE‐3 in breast‐cancer prognosis , 1992, International journal of cancer.

[46]  C. Sotiriou,et al.  Different prognostic value of cytokeratin-19 mRNA positive circulating tumor cells according to estrogen receptor and HER2 status in early-stage breast cancer. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[47]  D. Moher,et al.  CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials , 2010, Journal of clinical epidemiology.

[48]  D G Altman,et al.  Missing covariate data within cancer prognostic studies: a review of current reporting and proposed guidelines , 2004, British Journal of Cancer.

[49]  A. Sood,et al.  Glucose as a prognostic factor in ovarian carcinoma , 2009, Cancer.

[50]  P. Grambsch,et al.  Evaluation of sampling strategies for modeling survival of uveal malignant melanoma. , 2003, Investigative ophthalmology & visual science.

[51]  James F. Watkins,et al.  Analysing Survival Data from Clinical Trials and Observational Studies. , 1995 .

[52]  Charles E McCulloch,et al.  Relaxing the rule of ten events per variable in logistic and Cox regression. , 2007, American journal of epidemiology.

[53]  Per Kragh Andersen,et al.  Regression with Linear Predictors , 2010 .

[54]  Douglas G Altman,et al.  Survival plots of time-to-event outcomes in clinical trials: good practice and pitfalls , 2002, The Lancet.

[55]  W. Sauerbrei,et al.  Steroid receptors in carcinoma of the breast. Results of immunocytochemical and biochemical determination and their effects on short-term prognosis. , 1994, Analytical and quantitative cytology and histology.

[56]  M Schemper,et al.  A note on quantifying follow-up in studies of failure time. , 1996, Controlled clinical trials.

[57]  S. Assmann,et al.  Subgroup analysis and other (mis)uses of baseline data in clinical trials , 2000, The Lancet.

[58]  D. Ransohoff Bias as a threat to the validity of cancer molecular-marker research , 2005, Nature reviews. Cancer.

[59]  P. Royston,et al.  Selection of important variables and determination of functional form for continuous predictors in multivariable model building , 2007, Statistics in medicine.

[60]  Nilanjan Chatterjee,et al.  Design and analysis of two‐phase studies with binary outcome applied to Wilms tumour prognosis , 1999 .

[61]  Daniel B. Mark,et al.  TUTORIAL IN BIOSTATISTICS MULTIVARIABLE PROGNOSTIC MODELS: ISSUES IN DEVELOPING MODELS, EVALUATING ASSUMPTIONS AND ADEQUACY, AND MEASURING AND REDUCING ERRORS , 1996 .

[62]  J. Concato,et al.  Importance of events per independent variable in proportional hazards regression analysis. II. Accuracy and precision of regression estimates. , 1995, Journal of clinical epidemiology.

[63]  James Rochon,et al.  Issues in Adjusting for Covariates Arising Postrandomization in Clinical Trials , 1999 .

[64]  M Schumacher,et al.  Sample size considerations for the evaluation of prognostic factors in survival analysis. , 2000, Statistics in medicine.

[65]  F. Montorsi,et al.  Nephroureterectomy and segmental ureterectomy in the treatment of invasive upper tract urothelial carcinoma: a population-based study of 2299 patients. , 2009, European journal of cancer.

[66]  J. Concato,et al.  The Risk of Determining Risk with Multivariable Models , 1993, Annals of Internal Medicine.

[67]  M Richard Simon,et al.  Design and Analysis of DNA Microarray Investigations , 2004 .

[68]  Keith R. Abrams,et al.  Evaluating the Quality of Research into a Single Prognostic Biomarker: A Systematic Review and Meta-analysis of 83 Studies of C-Reactive Protein in Stable Coronary Artery Disease , 2010, PLoS medicine.

[69]  Douglas G Altman,et al.  Dichotomizing continuous predictors in multiple regression: a bad idea , 2006, Statistics in medicine.

[70]  W. Sauerbrei,et al.  Reporting recommendations for tumor marker prognostic studies (REMARK). , 2005, Journal of the National Cancer Institute.

[71]  N. Malats,et al.  P53 as a prognostic marker for bladder cancer: a meta-analysis and review. , 2005, The Lancet. Oncology.

[72]  William D. Dupont,et al.  Statistical Modeling for Biomedical Researchers: A Simple Introduction to the Analysis of Complex Data , 2009 .

[73]  D. Ransohoff,et al.  Biomarker studies: a call for a comprehensive biomarker study registry , 2011, Nature Reviews Clinical Oncology.

[74]  N. Pavlidis,et al.  Gene expression of estrogen receptor, progesterone receptor and microtubule-associated protein Tau in high-risk early breast cancer: a quest for molecular predictors of treatment benefit in the context of a Hellenic Cooperative Oncology Group trial , 2009, Breast Cancer Research and Treatment.

[75]  Validation of UBE2C protein as a prognostic marker in node-positive breast cancer , 2009, British Journal of Cancer.

[76]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[77]  Leigh Tooth,et al.  A review of two journals found that articles using multivariable logistic regression frequently did not report commonly recommended assumptions. , 2004, Journal of clinical epidemiology.

[78]  M Egger,et al.  Value of flow diagrams in reports of randomized controlled trials. , 2001, JAMA.

[79]  D Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Annals of internal medicine.

[80]  M. Bonetti,et al.  A graphical method to assess treatment-covariate interactions using the Cox model on subsets of the data. , 2000, Statistics in medicine.

[81]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies , 2007, The Lancet.

[82]  P. Friedman,et al.  Circulating tumor cells in HER-2 positive metastatic breast cancer patients treated with trastuzumab and chemotherapy. , 2009, The International journal of biological markers.

[83]  M Bracko,et al.  S‐phase fraction determined on fine needle aspirates is an independent prognostic factor in breast cancer – a multivariate study of 770 patients , 2008, Cytopathology.

[84]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[85]  M. Bracken,et al.  Tissue biomarkers for prognosis in cutaneous melanoma: a systematic review and meta-analysis. , 2009, Journal of the National Cancer Institute.

[86]  S. Leung,et al.  Stromal mast cells in invasive breast cancer are a marker of favourable prognosis: a study of 4,444 cases , 2007, Breast Cancer Research and Treatment.

[87]  P. Royston,et al.  Regression using fractional polynomials of continuous covariates: parsimonious parametric modelling. , 1994 .

[88]  E. Steyerberg Clinical Prediction Models , 2008, Statistics for Biology and Health.

[89]  Sally Hunsberger,et al.  Proposal for standardized definitions for efficacy end points in adjuvant breast cancer trials: the STEEP system. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[90]  S. Pocock,et al.  Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration , 2007, Annals of Internal Medicine [serial online].

[91]  D. Cook,et al.  The Completeness of Reporting (CORE) index identifies important deficiencies in observational study conference abstracts. , 2008, Journal of clinical epidemiology.

[92]  Nathan L Pace,et al.  Independent predictors from stepwise logistic regression may be nothing more than publishable P values. , 2008, Anesthesia and analgesia.

[93]  J. Ioannidis Why Most Discovered True Associations Are Inflated , 2008, Epidemiology.

[94]  M. Brundage,et al.  Prognostic factors in non-small cell lung cancer: a decade of progress. , 2002, Chest.

[95]  John P A Ioannidis,et al.  Selective reporting biases in cancer prognostic factor studies. , 2005, Journal of the National Cancer Institute.

[96]  Michael A Babyak,et al.  What You See May Not Be What You Get: A Brief, Nontechnical Introduction to Overfitting in Regression-Type Models , 2004, Psychosomatic medicine.

[97]  J. Lafitte,et al.  Role of p53 as a prognostic factor for survival in lung cancer: a systematic review of the literature with a meta-analysis. , 2001, The European respiratory journal.

[98]  S. Taube,et al.  Standard Reference Material for Her2 Testing: Report of a National Institute of Standards and Technology-sponsored Consensus Workshop , 2003, Applied immunohistochemistry & molecular morphology : AIMM.

[99]  W. W. Muir,et al.  Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1980 .

[100]  Michael R Chernick,et al.  Bootstrap Methods: A Guide for Practitioners and Researchers , 2007 .

[101]  K. Mengersen,et al.  Selective Reporting of Adjusted Estimates in Observational Epidemiology Studies: Reasons and Implications for Meta-analyses , 2008, Evaluation & the health professions.

[102]  P. Royston,et al.  Interactions between treatment and continuous covariates: a step toward individualizing therapy. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[103]  Walter C Willett,et al.  The search for truth must go beyond statistics. , 2008, Epidemiology.

[104]  Z. Trajanoski,et al.  Type, Density, and Location of Immune Cells Within Human Colorectal Tumors Predict Clinical Outcome , 2006, Science.

[105]  Douglas G. Altman,et al.  Methodological challenges in the evaluation of prognostic factors in breast cancer. , 1998 .

[106]  Michael G Kenward,et al.  Multiple imputation: current perspectives , 2007, Statistical methods in medical research.

[107]  M. Kenward,et al.  Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls , 2009, BMJ : British Medical Journal.

[108]  W. Sauerbrei,et al.  Assessment of breast cancer vascularisation by Doppler ultrasound as a prognostic factor of survival. , 2004, Oncology reports.

[109]  D. G. Altman,et al.  Statistical aspects of prognostic factor studies in oncology. , 1994, British Journal of Cancer.

[110]  M. Abrahamowicz,et al.  Joint estimation of time‐dependent and non‐linear effects of continuous covariates on survival , 2007, Statistics in medicine.

[111]  F. Waldman,et al.  Reproducibility of p53 Immunohistochemistry in Bladder Tumors , 2000 .

[112]  Richard D Riley,et al.  Evidence-Based Assessment and Application of Prognostic Markers: The Long Way from Single Studies to Meta-Analysis , 2006 .

[113]  P. Goodwin,et al.  Prognostic effects of 25-hydroxyvitamin D levels in early breast cancer. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[114]  A. Harris,et al.  Cytoplasmic p21WAF1/CIP1 expression is correlated with HER-2/ neu in breast cancer and is an independent predictor of prognosis , 2003, Breast Cancer Research.

[115]  J. Ioannidis,et al.  Assessment of claims of improved prediction beyond the Framingham risk score. , 2009, JAMA.

[116]  Helen M. Moore,et al.  Biospecimen Reporting for Improved Study Quality. , 2011, Biopreservation and biobanking.

[117]  J. Schneider,et al.  Different detection rates of HER-2/NEU overexpression in ovarian carcinoma using two different commercially available detection kits. , 1995, European journal of cancer.

[118]  L. Seymour,et al.  Clinical Utility of Epidermal Growth Factor Receptor Expression for Selecting Patients with Advanced Non-small Cell Lung Cancer for Treatment with Erlotinib , 2006, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[119]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[120]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[121]  M Schumacher,et al.  Modelling the effects of standard prognostic factors in node-positive breast cancer , 1999, British Journal of Cancer.

[122]  Jeremy MG Taylor,et al.  Validation of Biomarker-Based Risk Prediction Models , 2008, Clinical Cancer Research.

[123]  D G Altman,et al.  REporting recommendations for tumour MARKer prognostic studies (REMARK) , 2005, British journal of cancer.

[124]  W. Sauerbrei,et al.  Confidence intervals for the effect of a prognostic factor after selection of an ‘optimal’ cutpoint , 2004, Statistics in medicine.

[125]  M. Ellis,et al.  Recommendations for collection and handling of specimens from group breast cancer clinical trials. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[126]  M. Hauptmann,et al.  Estrogen receptor-alpha phosphorylation at serine-118 and tamoxifen response in breast cancer. , 2009, Journal of the National Cancer Institute.

[127]  A Rogier T Donders,et al.  Imputation of missing values is superior to complete case analysis and the missing-indicator method in multivariable diagnostic research: a clinical example. , 2006, Journal of clinical epidemiology.

[128]  T G Clark,et al.  Survival Analysis Part I: Basic concepts and first analyses , 2003, British Journal of Cancer.

[129]  D. Altman,et al.  Outcome selection bias in meta-analysis , 2005, Statistical methods in medical research.

[130]  M. Reiss,et al.  Estrogen-dependent prognostic significance of cyclooxygenase-2 expression in early-stage invasive breast cancers treated with breast-conserving surgery and radiation. , 2008, International journal of radiation oncology, biology, physics.

[131]  C. Osborne,et al.  Randomized, controlled trial of cyclophosphamide, methotrexate, and fluorouracil versus cyclophosphamide, doxorubicin, and fluorouracil with and without tamoxifen for high-risk, node-negative breast cancer: treatment results of Intergroup Protocol INT-0102. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[132]  E Biganzoli,et al.  Time-dependent relevance of steroid receptors in breast cancer. , 2000, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[133]  J H Lubin,et al.  On power and sample size for studying features of the relative odds of disease. , 1990, American journal of epidemiology.

[134]  Charles E. McCulloch,et al.  Regression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures Models , 2005 .

[135]  S. Lagakos The challenge of subgroup analyses--reporting without distorting. , 2006, The New England journal of medicine.

[136]  S. Pocock,et al.  Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration , 2007, PLoS medicine.

[137]  H. Boshuizen,et al.  Multiple imputation of missing blood pressure covariates in survival analysis. , 1999, Statistics in medicine.

[138]  M. Dowsett,et al.  Current Perspectives on HER2 Testing: A Review of National Testing Guidelines , 2003, Modern Pathology.

[139]  Helen M Moore,et al.  Biospecimen reporting for improved study quality (BRISQ). , 2011, Journal of proteome research.

[140]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[141]  Cathepsin-D in primary breast cancer: prognostic evaluation involving 2810 patients , 1999, British Journal of Cancer.

[142]  P C Lambert,et al.  Reporting of prognostic markers: current problems and development of guidelines for evidence-based practice in the future , 2003, British Journal of Cancer.

[143]  Giovanni Parmigiani,et al.  SMAD4 Gene Mutations Are Associated with Poor Prognosis in Pancreatic Cancer , 2009, Clinical Cancer Research.

[144]  Douglas G Altman,et al.  Interaction revisited: the difference between two estimates , 2003, BMJ : British Medical Journal.

[145]  Carl van Walraven,et al.  Leave ‘em Alone – Why Continuous Variables Should Be Analyzed as Such , 2008, Neuroepidemiology.

[146]  P. Royston,et al.  A new approach to modelling interactions between treatment and continuous covariates in clinical trials by using fractional polynomials , 2004, Statistics in medicine.

[147]  D G Altman,et al.  Survival probabilities (the Kaplan-Meier method) , 1998, BMJ.

[148]  Douglas G Altman,et al.  Reporting recommendations for tumor marker prognostic studies. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[149]  J. Going,et al.  Predicting the future: a critical appraisal of cancer prognosis studies , 1999, Histopathology.

[150]  John P A Ioannidis,et al.  New Prognostic Markers for Outcome of Acute Pancreatitis: Overview of Reporting in 184 Studies , 2011, Pancreas.

[151]  P. Sandercock,et al.  Progress Review Blood Markers for the Prognosis of Ischemic Stroke A Systematic Review , 2009 .

[152]  Wei-Chih Liao,et al.  Serum Interleukin-6 Level but not Genotype Predicts Survival after Resection in Stages II and III Gastric Carcinoma , 2008, Clinical Cancer Research.

[153]  M Mupparapu,et al.  Calcified carotid artery atheroma and stroke: a systematic review. , 2007, Journal of the American Dental Association.

[154]  C. Mallows The Zeroth Problem , 1998 .

[155]  Jolanta Lissowska,et al.  Loss of antigenicity in stored sections of breast cancer tissue microarrays. , 2004, Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology.

[156]  M. Clench,et al.  MALDI-ion mobility separation-mass spectrometry imaging of glucose-regulated protein 78 kDa (Grp78) in human formalin-fixed, paraffin-embedded pancreatic adenocarcinoma tissue sections. , 2009, Journal of proteome research.

[157]  M. Pepe,et al.  Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. , 2004, American journal of epidemiology.

[158]  Michael W Kattan,et al.  Evaluating a New Marker’s Predictive Contribution , 2004, Clinical Cancer Research.

[159]  Jacobus Pfisterer,et al.  Role of surgical outcome as prognostic factor in advanced epithelial ovarian cancer: A combined exploratory analysis of 3 prospectively randomized phase 3 multicenter trials , 2009, Cancer.

[160]  D. Christiani,et al.  Vascular Endothelial Growth Factor Polymorphisms and Esophageal Cancer Prognosis , 2009, Clinical Cancer Research.

[161]  M. Vijver,et al.  Assessment of problems in diagnostic and research immunohistochemistry associated with epitope instability in stored paraffin sections. , 2000 .

[162]  J. Ioannidis,et al.  Quality of reporting of cancer prognostic marker studies: association with reported prognostic effect. , 2007, Journal of the National Cancer Institute.

[163]  S Greenland,et al.  Tests for interaction in epidemiologic studies: a review and a study of power. , 1983, Statistics in medicine.

[164]  W. Sauerbrei,et al.  Identification of clinically useful cancer prognostic factors: what are we missing? , 2005, Journal of the National Cancer Institute.

[165]  I. Floriani,et al.  Prognostic value of circulating chromogranin A and soluble tumor necrosis factor receptors in advanced nonsmall cell lung cancer , 2007, Cancer.

[166]  M. Loda,et al.  p27Kip1 in Stage III Colon Cancer: Implications for Outcome following Adjuvant Chemotherapy in Cancer and Leukemia Group B Protocol 89803 , 2009, Clinical Cancer Research.

[167]  J. Ioannidis,et al.  The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration , 2009, Annals of Internal Medicine [serial online].

[168]  Soonmyung Paik,et al.  Use of archived specimens in evaluation of prognostic and predictive biomarkers. , 2009, Journal of the National Cancer Institute.

[169]  W. Sauerbrei,et al.  Multivariate Analysis of Prognostic Factors in Patients with Glioblastoma , 2003, Strahlentherapie und Onkologie.

[170]  L. Murphy,et al.  Steroid Receptor RNA Activator Protein (SRAP): a potential new prognostic marker for estrogen receptor-positive/node-negative/younger breast cancer patients , 2009, Breast Cancer Research.

[171]  W. Sauerbrei,et al.  Cellular DNA content and survival in advanced ovarian carcinoma , 1994, Cancer.

[172]  S. Martino,et al.  Nitric Oxide Synthase Variants and Disease-Free Survival among Treated and Untreated Breast Cancer Patients in a Southwest Oncology Group Clinical Trial , 2009, Clinical Cancer Research.

[173]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[174]  Yvonne Vergouwe,et al.  Prognosis and prognostic research: validating a prognostic model , 2009, BMJ : British Medical Journal.

[175]  S. Taneja,et al.  Neutral Endopeptidase Protein Expression and Prognosis in Localized Prostate Cancer , 2004, Clinical Cancer Research.

[176]  R. Simon,et al.  Statistical Methods for the Analysis of Prognostic Factor Studies , 2003 .

[177]  J. Ioannidis,et al.  Predictive ability of DNA microarrays for cancer outcomes and correlates: an empirical assessment , 2003, The Lancet.

[178]  Andrew J Vickers,et al.  Cutpoints in clinical chemistry: time for fundamental reassessment. , 2009, Clinical chemistry.

[179]  Young Tae Kim,et al.  Diagnostic and Prognostic Impact of Osteopontin Expression in Endometrial Cancer , 2009, Cancer investigation.

[180]  S. Groshen,et al.  Hypermethylated APC DNA in plasma and prognosis of patients with esophageal adenocarcinoma. , 2000, Journal of the National Cancer Institute.

[181]  Robert Gray,et al.  Flexible Methods for Analyzing Survival Data Using Splines, with Applications to Breast Cancer Prognosis , 1992 .

[182]  Robin L. Jones,et al.  The prognostic significance of Ki67 before and after neoadjuvant chemotherapy in breast cancer , 2009, Breast Cancer Research and Treatment.

[183]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[184]  P. Grambsch,et al.  Modeling Survival Data: Extending the Cox Model , 2000 .

[185]  D G Altman,et al.  What do we mean by validating a prognostic model? , 2000, Statistics in medicine.

[186]  J Carpenter,et al.  Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. , 2000, Statistics in medicine.

[187]  A. Matakidou,et al.  Thymidylate synthase expression and prognosis in colorectal cancer: a systematic review and meta-analysis. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[188]  Douglas G Altman,et al.  Quantification of the completeness of follow-up , 2002, The Lancet.

[189]  P. Royston,et al.  Is treatment with interferon-α effective in all patients with metastatic renal carcinoma? A new approach to the investigation of interactions , 2004, British Journal of Cancer.

[190]  D. Slamon,et al.  Sensitivity of HER-2/neu antibodies in archival tissue samples: potential source of error in immunohistochemical studies of oncogene expression. , 1994, Cancer research.

[191]  Chris Chatfield,et al.  Confessions of a pragmatic statistician , 2002 .

[192]  D G Altman,et al.  Survival Analysis Part IV: Further concepts and methods in survival analysis , 2003, British Journal of Cancer.

[193]  L. Fisher,et al.  Time-dependent covariates in the Cox proportional-hazards regression model. , 1999, Annual review of public health.

[194]  G. Grunkemeier,et al.  Measuring follow-up completeness. , 2008, The Annals of thoracic surgery.

[195]  W. Sauerbrei Prognostic factors. Confusion caused by bad quality design, analysis and reporting of many studies. , 2005, Advances in oto-rhino-laryngology.

[196]  P. Royston,et al.  A New Proposal for Multivariable Modelling of Time‐Varying Effects in Survival Data Based on Fractional Polynomial Time‐Transformation , 2007, Biometrical journal. Biometrische Zeitschrift.

[197]  S. Love,et al.  Survival Analysis Part III: Multivariate data analysis – choosing a model and assessing its adequacy and fit , 2003, British Journal of Cancer.

[198]  C. Ulrich,et al.  Elevated biomarkers of inflammation are associated with reduced survival among breast cancer patients. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[199]  P. Royston,et al.  Flexible parametric proportional‐hazards and proportional‐odds models for censored survival data, with application to prognostic modelling and estimation of treatment effects , 2002, Statistics in medicine.

[200]  H. Moch,et al.  Down regulation of E-Cadherin (ECAD) - a predictor for occult metastatic disease in sentinel node biopsy of early squamous cell carcinomas of the oral cavity and oropharynx , 2011, BMC Cancer.

[201]  H. Höfler,et al.  CyclinD1 and interleukin-1 receptor antagonist polymorphisms are associated with prognosis in neoadjuvant-treated gastric carcinoma. , 2009, European journal of cancer.

[202]  W Sauerbrei,et al.  Influence of model-building strategies on the results of a case-control study. , 1993, Statistics in medicine.

[203]  R. Houlston,et al.  A prospective, blinded analysis of thymidylate synthase and p53 expression as prognostic markers in the adjuvant treatment of colorectal cancer. , 2006, Annals of oncology : official journal of the European Society for Medical Oncology.

[204]  A. Rosenwald,et al.  Five-gene model to predict survival in mantle-cell lymphoma using frozen or formalin-fixed, paraffin-embedded tissue. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[205]  S. Mathoulin-Pélissier,et al.  Survival end point reporting in randomized cancer clinical trials: a review of major journals. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[206]  Willi Sauerbrei,et al.  The Use of Resampling Methods to Simplify Regression Models in Medical Statistics , 1999 .

[207]  S. Manikandan Preparing to analyse data , 2010, Journal of pharmacology & pharmacotherapeutics.

[208]  Boris Freidlin,et al.  Randomized clinical trials with biomarkers: design issues. , 2010, Journal of the National Cancer Institute.

[209]  Guido Schwarzer,et al.  Prognostic Factor Studies , 2012 .