Overinterpretation of clinical applicability in molecular diagnostic research.

BACKGROUND We evaluated whether articles on molecular diagnostic tests interpret appropriately the clinical applicability of their results. METHODS We selected original-research articles published in 2006 that addressed the diagnostic value of a molecular test. We defined overinterpretation of clinical applicability by means of prespecified rules that evaluated study design, conclusions regarding applicability, presence of statements suggesting the need for further clinical evaluation of the test, and diagnostic accuracy. Two reviewers independently evaluated the articles; consensus was reached after discussion and arbitration by a third reviewer. RESULTS Of 108 articles included in the study, 82 (76%) used a design that used healthy controls or alternative-diagnosis controls, only 15 (11%) addressed a clinically relevant population similar to that in which the test might be applied in practice, 104 articles (96%) made definitely favorable or promising statements regarding clinical applicability, and 61 (56%) of the articles apparently overinterpreted the clinical applicability of their findings. Articles published in journals with higher impact factors were more likely to overinterpret their results than those with lower impact factors (adjusted odds ratio, 1.71 per impact factor quartile; 95% CI, 1.09-2.69; P = 0.020). Overinterpretation was more common when authors were based in laboratories than in clinical settings (adjusted odds ratio, 18.7; 95% CI, 1.41-249; P = 0.036). CONCLUSIONS Although expectations are high for new diagnostic tests based on molecular techniques, the majority of published research has involved preclinical phases of research. Overinterpretation of the clinical applicability of findings for new molecular diagnostic tests is common.

[1]  M S Pepe,et al.  Phases of biomarker development for early detection of cancer. , 2001, Journal of the National Cancer Institute.

[2]  Werner Zolg,et al.  The Proteomic Search for Diagnostic Biomarkers , 2006, Molecular & Cellular Proteomics.

[3]  John P A Ioannidis,et al.  Is molecular profiling ready for use in clinical decision making? , 2007, The oncologist.

[4]  D. Sackett,et al.  The architecture of diagnostic research , 2002, BMJ : British Medical Journal.

[5]  Erika Check,et al.  Proteomics and cancer: Running before we can walk? , 2004, Nature.

[6]  R. Bernards,et al.  Enabling personalized cancer medicine through analysis of gene-expression patterns , 2008, Nature.

[7]  A R Feinstein,et al.  Use of methodological standards in diagnostic test research. Getting better but still not good. , 1995, JAMA.

[8]  P. Bossuyt,et al.  BMC Medical Research Methodology , 2002 .

[9]  John P A Ioannidis,et al.  Almost all articles on cancer prognostic markers report statistically significant results. , 2007, European journal of cancer.

[10]  M. Vaneechoutte,et al.  Study of the intra- and interlaboratory reproducibility of partial single base C-sequencing of the 16S rRNA gene and its applicability for the identification of members of the genus Streptococcus. , 2002, Systematic and applied microbiology.

[11]  I. Hernández-Aguado,et al.  The winding road towards evidence based diagnoses , 2002, Journal of epidemiology and community health.

[12]  M. Porta,et al.  Assessing the social meaning, value and implications of research in genomics , 2007, Journal of Epidemiology and Community Health.

[13]  Miquel Porta,et al.  "Omics" research, monetization of intellectual property and fragmentation of knowledge: can clinical epidemiology strengthen integrative research? , 2007, Journal of clinical epidemiology.

[14]  D. Rennie,et al.  The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. , 2003, Annals of internal medicine.

[15]  Johannes B Reitsma,et al.  Case-control and two-gate designs in diagnostic accuracy studies. , 2005, Clinical chemistry.

[16]  J. Ioannidis Molecular Bias , 2005, European Journal of Epidemiology.

[17]  Gruber Sb,et al.  Clinical Epidemiology: The Architecture of Clinical Research. , 1986 .

[18]  Kenneth H Buetow,et al.  Interlaboratory comparability study of cancer gene expression analysis using oligonucleotide microarrays. , 2005, Clinical cancer research : an official journal of the American Association for Cancer Research.

[19]  T. Veenstra Global and targeted quantitative proteomics for biomarker discovery. , 2007, Journal of chromatography. B, Analytical technologies in the biomedical and life sciences.

[20]  D. Ransohoff Rules of evidence for cancer molecular-marker discovery and validation , 2004, Nature Reviews Cancer.

[21]  E. Faerstein,et al.  A DICTIONARY OF EPIDEMIOLOGY , 2016 .

[22]  A. Van den Bruel,et al.  Results of diagnostic accuracy studies are not always validated. , 2006, Journal of clinical epidemiology.

[23]  T. Kaptchuk,et al.  Effect of interpretive bias on research evidence. , 2003, BMJ.

[24]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[25]  Nikolaos A Patsopoulos,et al.  Bmc Medical Research Methodology Open Access Reporting of Human Genome Epidemiology (huge) Association Studies: an Empirical Assessment , 2022 .

[26]  Ildefonso Hernández-Aguado,et al.  Methodology in diagnostic laboratory test research in clinical chemistry and clinical chemistry and laboratory medicine. , 2004, Clinical chemistry.

[27]  Alvan R. Feinstein,et al.  Clinical Epidemiology: The Architecture of Clinical Research , 1988 .