Sources of bias in specimens for research about molecular markers for cancer.

Claims about the diagnostic or prognostic accuracy of markers often prove disappointing when "discrimination" found between cancers versus normals is due to bias, a systematic difference between compared groups. This article describes a framework to help simplify and organize current problems in marker research by focusing on the role of specimens as a source of bias in observational research and using that focus to address problems and improve reliability. The central idea is that the "fundamental comparison" in research about markers (ie, the comparison done to assess whether a marker discriminates) involves two distinct processes that are "connected" by specimens. If subject selection (first process) creates baseline inequality between groups being compared, then laboratory analysis of specimens (second process) may erroneously find positive results. Although both processes are important, subject selection more fundamentally influences the quality of marker research, because it can hardwire bias into all comparisons in a way that cannot be corrected by any refinement in laboratory analysis. An appreciation of the separateness of these two processes-and placing investigators with appropriate expertise in charge of each-may increase the reliability of research about cancer biomarkers.

[1]  Sudhir Srivastava,et al.  Toward a Robust System for Biomarker Triage and Validation – EDRN Experience , 2009 .

[2]  William E Grizzle,et al.  Standard operating procedures for serum and plasma collection: early detection research network consensus statement standard operating procedure integration working group. , 2009, Journal of proteome research.

[3]  P. Laird,et al.  Ovarian Cancer Early Detection Claims Are Biased , 2008, Clinical Cancer Research.

[4]  D. Ward,et al.  Diagnostic markers for early detection of ovarian cancer (Clinical Cancer Research (2008) 14, (1065-1072)) , 2008 .

[5]  David F Ransohoff,et al.  The process to discover and develop biomarkers for cancer: a work in progress. , 2008, Journal of the National Cancer Institute.

[6]  Holly Janes,et al.  Pivotal Evaluation of the Accuracy of a Biomarker Used for Classification or Prediction: Standards for Study Design , 2008, Journal of the National Cancer Institute.

[7]  Jim Schnabel,et al.  Neuroscience: Standard model , 2008, Nature.

[8]  Christopher F. Martin,et al.  Assessment of Serum Proteomics to Detect Large Colon Adenomas , 2008, Cancer Epidemiology, Biomarkers and Prevention.

[9]  L. Liotta,et al.  National Academy of Clinical Biochemistry Laboratory Medicine Practice Guidelines for use of tumor markers in clinical practice: quality requirements. , 2008, Clinical chemistry.

[10]  D. Ward,et al.  Diagnostic Markers for Early Detection of Ovarian Cancer , 2008, Clinical Cancer Research.

[11]  G. Guyatt Users' guides to the medical literature : essentials of evidence-based clinical practice , 2008 .

[12]  D. Chan,et al.  SELDI-TOF MS whole serum proteomic profiling with IMAC surface does not reliably detect prostate cancer. , 2008, Clinical chemistry.

[13]  D. Chan,et al.  Analytical validation of serum proteomic profiling for diagnosis of prostate cancer: sources of sample bias. , 2008, Clinical chemistry.

[14]  David F Ransohoff,et al.  How to improve reliability and efficiency of research about molecular markers: roles of phases, guidelines, and study design. , 2007, Journal of clinical epidemiology.

[15]  R. Tibshirani,et al.  Classification and prediction of clinical Alzheimer's diagnosis based on plasma signaling proteins , 2007, Nature Medicine.

[16]  Allen F. Shaughnessy,et al.  Clinical Epidemiology: A Basic Science for Clinical Medicine , 2007, BMJ : British Medical Journal.

[17]  Lennart Martens,et al.  The minimum information about a proteomics experiment (MIAPE) , 2007, Nature Biotechnology.

[18]  A. Dupuy,et al.  Critical review of published microarray studies for cancer outcome and guidelines on statistical analysis and reporting. , 2007, Journal of the National Cancer Institute.

[19]  S. Markowitz,et al.  Improved fecal DNA test for colorectal cancer screening. , 2007, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[20]  B. H. Patterson,et al.  Evaluating markers for the early detection of cancer: overview of study designs and methods , 2006, Clinical trials.

[21]  A. Olshen,et al.  Differential exoprotease activities confer tumor-specific serum peptidome patterns. , 2005, The Journal of clinical investigation.

[22]  J. Potter Epidemiology informing clinical practice: from bills of mortality to population laboratories , 2005, Nature Clinical Practice Oncology.

[23]  K. Hede $104 million proteomics initiative gets green light. , 2005, Journal of the National Cancer Institute.

[24]  W. Sauerbrei,et al.  Reporting recommendations for tumor marker prognostic studies (REMARK). , 2005, Journal of the National Cancer Institute.

[25]  P. Qiu The Statistical Evaluation of Medical Tests for Classification and Prediction , 2005 .

[26]  V. Berger Selection Bias and Covariate Imbalances in Randomized Clinical Trials: Berger/Selection Bias and Covariate Imbalances in Randomized Clinical Trials , 2005 .

[27]  J. Ioannidis Microarrays and molecular research: noise discovery? , 2005, The Lancet.

[28]  D. Ransohoff Bias as a threat to the validity of cancer molecular-marker research , 2005, Nature reviews. Cancer.

[29]  M. Cronin,et al.  A multigene assay to predict recurrence of tamoxifen-treated, node-negative breast cancer. , 2004, The New England journal of medicine.

[30]  D. Ransohoff,et al.  Fecal DNA versus fecal occult blood for colorectal-cancer screening in an average-risk population. , 2004, The New England journal of medicine.

[31]  S. Woolf A smarter strategy? Reflections on fecal DNA screening for colorectal cancer. , 2004, The New England journal of medicine.

[32]  E. Diamandis Proteomic patterns to identify ovarian cancer: 3 years on , 2004, Expert review of molecular diagnostics.

[33]  D. Ransohoff Rules of evidence for cancer molecular-marker discovery and validation , 2004, Nature Reviews Cancer.

[34]  Jeffrey S. Morris,et al.  Reproducibility of SELDI-TOF protein patterns in serum: comparing datasets from different experiments , 2004, Bioinform..

[35]  J. Ioannidis,et al.  Predictive ability of DNA microarrays for cancer outcomes and correlates: an empirical assessment , 2003, The Lancet.

[36]  J. Knottnerus,et al.  Assessment of the accuracy of diagnostic tests: the cross-sectional study. , 2003, Journal of clinical epidemiology.

[37]  D. Ahlquist,et al.  DNA integrity as a potential marker for stool-based detection of colorectal cancer. , 2003, Clinical chemistry.

[38]  John P A Ioannidis,et al.  Translation of highly promising basic science research into clinical applications. , 2003, The American journal of medicine.

[39]  D. Ransohoff Developing Molecular Biomarkers for Cancer , 2003, Science.

[40]  David Moher,et al.  The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration , 2003, Annals of Internal Medicine [serial online].

[41]  M. Radmacher,et al.  Pitfalls in the use of DNA microarray data for diagnostic and prognostic classification. , 2003, Journal of the National Cancer Institute.

[42]  Sudhir Srivastava,et al.  Markers for early detection of cancer: Statistical guidelines for nested case-control studies , 2002, BMC medical research methodology.

[43]  E. Petricoin,et al.  Use of proteomic patterns in serum to identify ovarian cancer , 2002, The Lancet.

[44]  Jason E. Stewart,et al.  Minimum information about a microarray experiment (MIAME)—toward standards for microarray data , 2001, Nature Genetics.

[45]  M S Pepe,et al.  Phases of biomarker development for early detection of cancer. , 2001, Journal of the National Cancer Institute.

[46]  S. Thibodeau,et al.  Colorectal cancer screening by detection of altered human DNA in stool: feasibility of a multitarget assay panel. , 2000, Gastroenterology.

[47]  G. Taubes Epidemiology faces its limits. , 1995, Science.

[48]  S. Cummings,et al.  Designing Clinical Research: An Epidemiologic Approach , 1988 .

[49]  J. Buring,et al.  Epidemiology in Medicine , 1987 .

[50]  B. Casto,et al.  Conditions for transformation of human fibroblast cells: an overview. , 1986, Cancer letters.

[51]  Stephen B. Gruber,et al.  Clinical Epidemiology: The Architecture of Clinical Research , 1986, The Yale Journal of Biology and Medicine.

[52]  D. Sackett,et al.  The Ends of Human Life: Medical Ethics in a Liberal Polity , 1992, Annals of Internal Medicine.

[53]  R. Fletcher,et al.  Clinical Epidemiology: The Essentials , 1982 .