Pivotal Evaluation of the Accuracy of a Biomarker Used for Classification or Prediction: Standards for Study Design

Research methods for biomarker evaluation lag behind those for evaluating therapeutic treatments. Although a phased approach to development of biomarkers exists and guidelines are available for reporting study results, a coherent and comprehensive set of guidelines for study design has not been delineated. We describe a nested case–control study design that involves prospective collection of specimens before outcome ascertainment from a study cohort that is relevant to the clinical application. The biomarker is assayed in a blinded fashion on specimens from randomly selected case patients and control subjects in the study cohort. We separately describe aspects of the design that relate to the clinical context, biomarker performance criteria, the biomarker test, and study size. The design can be applied to studies of biomarkers intended for use in disease diagnosis, screening, or prognosis. Common biases that pervade the biomarker research literature would be eliminated if these rigorous standards were followed.

[1]  M S Pepe,et al.  Using a combination of reference tests to assess the accuracy of a new diagnostic test. , 1999, Statistics in medicine.

[2]  Pamela A Shaw,et al.  Methods for Assessing Improvement in Specificity When a Biomarker is Combined With a Standard Screening Test , 2009, Statistics in biopharmaceutical research.

[3]  M. Weinstein,et al.  Decision Making in Health and Medicine , 2001 .

[4]  L. V. van't Veer,et al.  Validation and clinical utility of a 70-gene prognostic signature for women with node-negative breast cancer. , 2006, Journal of the National Cancer Institute.

[5]  Holly Janes,et al.  Matching in Studies of Classification Accuracy: Implications for Analysis, Efficiency, and Assessment of Incremental Value , 2008, Biometrics.

[6]  Sudhir Srivastava,et al.  Markers for early detection of cancer: Statistical guidelines for nested case-control studies , 2002, BMC medical research methodology.

[7]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[8]  R. Kay.  Statistical Principles for Clinical Trials , 1998, The Journal of international medical research.

[9]  Anika Ashok,et al.  ICH Harmonised Tripartite Guideline , 2009 .

[10]  Karla Kerlikowske,et al.  Characteristics associated with recurrence among women with ductal carcinoma in situ treated by lumpectomy. , 2003, Journal of the National Cancer Institute.

[11]  Pepe,et al.  Estimating Sensitivity and Specificity from a Phase 2 Biomarker Study that Allows for Early Termination , 2007 .

[12]  Daniel J Sargent,et al.  Clinical trial designs for predictive marker validation in cancer treatment trials. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[13]  J André Knottnerus,et al.  Evaluation of diagnostic procedures , 2002, BMJ : British Medical Journal.

[14]  Ross Prentice,et al.  Research issues and strategies for genomic and proteomic biomarker discovery and validation: a statistical perspective. , 2004, Pharmacogenomics.

[15]  D. Normolle,et al.  Biomarkers for Cancer Risk, Early Detection, and Prognosis: The Validation Conundrum , 2007, Cancer Epidemiology Biomarkers & Prevention.

[16]  Ashutosh Kumar Singh,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2010 .

[17]  Holly Janes,et al.  Practice of Epidemiology Adjusting for Covariates in Studies of Diagnostic, Screening, or Prognostic Markers: an Old Concept in a New Setting , 2022 .

[18]  David F Ransohoff,et al.  How to improve reliability and efficiency of research about molecular markers: roles of phases, guidelines, and study design. , 2007, Journal of clinical epidemiology.

[19]  M S Pepe,et al.  Phases of biomarker development for early detection of cancer. , 2001, Journal of the National Cancer Institute.

[20]  Richard Simon,et al.  Roadmap for developing and validating therapeutically relevant genomic classifiers. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[21]  Peter Sleight,et al.  Data-monitoring committees in clinical trials , 1993, The Lancet.

[22]  T J Ulahannan,et al.  Decision Making in Health and Medicine: Integrating Evidence and Values , 2002 .

[23]  I. Hernández-Aguado,et al.  The winding road towards evidence based diagnoses , 2002, Journal of epidemiology and community health.

[24]  B. H. Patterson,et al.  Evaluating markers for the early detection of cancer: overview of study designs and methods , 2006, Clinical trials.

[25]  ICH Harmonised Tripartite Guideline. Statistical principles for clinical trials. International Conference on Harmonisation E9 Expert Working Group. , 1999, Statistics in medicine.