Sources of error in the retracted scientific literature

Retraction of flawed articles is an important mechanism for correction of the scientific literature. We recently reported that the majority of retractions are associated with scientific misconduct. In the current study, we focused on the subset of retractions for which no misconduct was identified, in order to identify the major causes of error. Analysis of the retraction notices for 423 articles indexed in PubMed revealed that the most common causes of error‐related retraction are laboratory errors, analytical errors, and irreproducible results. The most common laboratory errors are contamination and problems relating to molecular biology procedures (e.g., sequencing, cloning). Retractions due to contamination were more common in the past, whereas analytical errors are now increasing in frequency. A number of publications that have not been retracted despite being shown to contain significant errors suggest that barriers to retraction may impede correction of the literature. In particular, few cases of retraction due to cell line contamination were found despite recognition that this problem has affected numerous publications. An understanding of the errors leading to retraction can guide practices to improve laboratory research and the integrity of the scientific literature. Perhaps most important, our analysis has identified major problems in the mechanisms used to rectify the scientific literature and suggests a need for action by the scientific community to adopt protocols that ensure the integrity of the publication process.—Casadevall, A., Steen, R. G., Fang, F. C. Sources of error in the retracted scientific literature. FASEB J. 28, 3847‐3855 (2014). www.fasebj.org

[1]  Arturo Casadevall,et al.  Why Has the Number of Scientific Retractions Increased? , 2013, PloS one.

[2]  V. Johnson Revised standards for statistical evidence , 2013, Proceedings of the National Academy of Sciences.

[3]  J. R. Traver Unusual Scalp Dermatitis In Humans Caused By The Mite, Dermatophagoides , 1951 .

[4]  C. Begley,et al.  Drug development: Raise standards for preclinical cancer research , 2012, Nature.

[5]  B. Pomeranz,et al.  Human basophil degranulation triggered by very dilute antiserum against IgE , 1988, Nature.

[6]  E. Delong,et al.  Staphylococcus aureus Panton-Valentine Leukocidin Causes Necrotizing Pneumonia , 2007, Science.

[7]  D. Leonard,et al.  The role of selection pressure in RNA-mediated evolutionary materials synthesis. , 2007, Journal of the American Chemical Society.

[8]  M. Hirsch,et al.  Use of evolutionary limitations of HIV-1 multidrug resistance to optimize therapy , 1993, Nature.

[9]  T. Derting,et al.  Education research: set a high bar. , 2011, Science.

[10]  Amanda Capes-Davis,et al.  Recommendation of short tandem repeat profiling for authenticating human cell lines, stem cells, and tissues , 2010, In Vitro Cellular & Developmental Biology - Animal.

[11]  H. Kölsch,et al.  Reporting bias in medical research - a narrative review , 2010, Trials.

[12]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[13]  D. Hanahan,et al.  Fas ligand expression in islets of Langerhans does not confer immune privilege and instead targets them for rapid destruction , 1997, Nature Medicine.

[14]  D. Bellgrau,et al.  A role for CD95 ligand in preventing graft rejection , 1995, Nature.

[15]  Daniel MacArthur,et al.  Methods: Face up to false positives , 2012, Nature.

[16]  P. Neven,et al.  CYP2D6 genotype and tamoxifen response in postmenopausal women with endocrine-responsive breast cancer: the breast international group 1-98 trial. , 2012, Journal of the National Cancer Institute.

[17]  Morgan A. Wyatt,et al.  Staphylococcus aureus Nonribosomal Peptide Secondary Metabolites Regulate Virulence , 2010, Science.

[18]  T. Paine Letter to George Washington , 1908 .

[19]  N. Lewis,et al.  Analysis of the Published Calorimetric Evidence for Electrochemical Fusion of Deuterium in Palladium , 1989, Science.

[20]  John Maddox,et al.  "High-dilution" experiments a delusion , 1988, Nature.

[21]  M. Hirsch,et al.  HIV-1 error revealed , 1993, Nature.

[22]  Nicole A. Vasilevsky,et al.  On the reproducibility of science: unique identification of research resources in the biomedical literature , 2013, PeerJ.

[23]  G. Pinholster SIDS paper triggers a murder charge. , 1994, Science.

[24]  D. Vaux Retraction: Immunology: Ways around rejection , 1998, Nature.

[25]  O. Tetsu,et al.  Genetic Profiling Reveals Cross-Contamination and Misidentification of 6 Adenoid Cystic Carcinoma Cell Lines: ACC2, ACC3, ACCM, ACCNS, ACCS and CAC2 , 2009, PloS one.

[26]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[27]  J. Vorholt,et al.  GFAJ-1 Is an Arsenate-Resistant, Phosphate-Dependent Organism , 2012, Science.

[28]  V. Stanton Re: CYP2D6 genotype and tamoxifen response in postmenopausal women with endocrine-responsive breast cancer: the Breast International Group 1-98 trial. , 2012, Journal of the National Cancer Institute.

[29]  H. Drexler,et al.  Widespread intraspecies cross‐contamination of human tumor cell lines arising at source , 1999, International journal of cancer.

[30]  Y. Matsuo,et al.  False leukemia–lymphoma cell lines: an update on over 500 cell lines , 2003, Leukemia.

[31]  Ian Atkinson,et al.  Accuracy of data transfer: double data entry and estimating levels of error. , 2012, Journal of clinical nursing.

[32]  Marlies Leenaars,et al.  Publication Bias in Laboratory Animal Research: A Survey on Magnitude, Drivers, Consequences and Potential Solutions , 2012, PloS one.

[33]  J. Rosmalen,et al.  The Role of Group Dynamics in Scientific Inconsistencies: A Case Study of a Research Consortium , 2011, PLoS medicine.

[34]  J. L. Tomkins,et al.  Additive Genetic Breeding Values Correlate with the Load of Partially Deleterious Mutations , 2010, Science.

[35]  S. Seltzer,et al.  Limits on the emission of neutrons, γ-rays, electrons and protons from Pons/Fleischmann electrolytic cells , 1990, Nature.

[36]  B. Eaton,et al.  RNA-Mediated Metal-Metal Bond Formation in the Synthesis of Hexagonal Palladium Nanoparticles , 2004, Science.

[37]  Matan Shelomi,et al.  Mad Scientist: The Unique Case of a Published Delusion , 2013, Sci. Eng. Ethics.

[38]  D. Vaux,et al.  Transgenic expression of CD95 ligand on islet beta cells induces a granulocytic infiltration but does not confer immune privilege upon islet allografts. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Chuan He,et al.  Aureusimines in Staphylococcus aureus Are Not Involved in Virulence , 2010, PloS one.

[40]  F. Prinz,et al.  Believe it or not: how much can we rely on published data on potential drug targets? , 2011, Nature Reviews Drug Discovery.

[41]  Roland M. Nardone,et al.  Eradication of cross-contaminated cell lines: A call for action , 2007, Cell Biology and Toxicology.

[42]  M. Fleischmann,et al.  Electrochemically Induced Nuclear Fusion of Deuterium , 1989 .

[43]  Paul Kellam,et al.  Convergent combination therapy can select viable multidrug-resistant HIV-1 in vitro , 1993, Nature.

[44]  A. Anbar,et al.  A Bacterium That Can Grow by Using Arsenic Instead of Phosphorus , 2011, Science.

[45]  W. Nelson-Rees,et al.  Cross-contamination of cells in culture. , 1981, Science.

[46]  A. Rojas,et al.  Cell line cross-contamination in biomedical research: a call to prevent unawareness , 2008, Acta Pharmacologica Sinica.

[47]  D. Gorman Editor's note , 2016, Internal medicine journal.

[48]  A. Casadevall,et al.  Reforming Science: Methodological and Cultural Reforms , 2011, Infection and Immunity.

[49]  Leonid Kruglyak,et al.  Absence of Detectable Arsenate in DNA from Arsenate-Grown GFAJ-1 Cells , 2012, Science.

[50]  D G Altman,et al.  The scandal of poor medical research , 1994, BMJ.

[51]  D. Vaux Ways around rejection , 1995, Nature.

[52]  Amanda Capes-Davis,et al.  Check your cultures! A list of cross‐contaminated or misidentified cell lines , 2010, International journal of cancer.

[53]  D. Fanelli Why Growing Retractions Are (Mostly) a Good Sign , 2013, PLoS medicine.

[54]  D. Easton,et al.  Survival of patients with breast cancer attending Bristol Cancer Help Centre , 1990, The Lancet.

[55]  E. Wager,et al.  Why and how do journals retract articles? An analysis of Medline retractions 1988–2008 , 2011, Journal of Medical Ethics.

[56]  Karthik Ram,et al.  Git can facilitate greater reproducibility and increased transparency in science , 2013, Source Code for Biology and Medicine.

[57]  Kenton O'Hara,et al.  Troubling Trends in Scientific Software Use , 2013, Science.

[58]  R. Nichols Moving USAID forward. , 2011, Science.

[59]  Dean A Fergusson,et al.  Association of hydroxyethyl starch administration with mortality and acute kidney injury in critically ill patients requiring volume resuscitation: a systematic review and meta-analysis. , 2013, JAMA.

[60]  Eric N Brown,et al.  Quality of protein crystal structures. , 2007, Acta crystallographica. Section D, Biological crystallography.

[61]  J. Loscalzo Irreproducible experimental results: causes, (mis)interpretations, and consequences. , 2012, Circulation.

[62]  Louise A Knight,et al.  Quality assurance and good laboratory practice. , 2011, Methods in molecular biology.

[63]  Yusuke Nakamura,et al.  Re: CYP2D6 genotype and tamoxifen response in postmenopausal women with endocrine-responsive breast cancer: the Breast International Group 1-98 trial. , 2012, Journal of the National Cancer Institute.

[64]  Adeline R. Whitney,et al.  A point mutation in the agr locus rather than expression of the Panton-Valentine leukocidin caused previously reported phenotypes in Staphylococcus aureus pneumonia and gene regulation. , 2009, The Journal of infectious diseases.

[65]  A. Casadevall,et al.  Retracted Science and the Retraction Index , 2011, Infection and Immunity.

[66]  J. Condra,et al.  HIV and multidrug resistance , 1993, Nature.

[67]  A. Casadevall,et al.  Misconduct accounts for the majority of retracted scientific publications , 2012, Proceedings of the National Academy of Sciences.

[68]  J. Foreman,et al.  Human basophil degranulation is not triggered by very dilute antiserum against human IgE , 1993, Nature.

[69]  Greg Miller,et al.  A Scientist's Nightmare: Software Problem Leads to Five Retractions , 2006, Science.

[70]  A. Steinschneider,et al.  Prolonged apnea and the sudden infant death syndrome: clinical and laboratory observations. , 1972, Pediatrics.

[71]  K. Okumura,et al.  CD95 ligand in graft rejection , 1996, Nature.

[72]  J. Fechner,et al.  Erroneously published fospropofol pharmacokinetic-pharmacodynamic data and retraction of the affected publications. , 2010, Anesthesiology.