A Survey on Data Reproducibility and the Effect of Publication Process on the Ethical Reporting of Laboratory Research

Purpose: The successful translation of laboratory research into effective therapies is dependent upon the validity of peer-reviewed publications. However, several publications in recent years suggested that published scientific findings could be reproduced only 11% to 45% of the time. Multiple surveys attempted to elucidate the fundamental causes of data irreproducibility and underscored potential solutions, more robust experimental designs, better statistics, and better mentorship. However, no prior survey has addressed the role of the review and publication process on honest reporting. Experimental Design: We developed an anonymous online survey intended for trainees involved in bench research. The survey included questions related to mentoring/career development, research practice, integrity, and transparency, and how the pressure to publish and the publication process itself influence their reporting practices. Results: Responses to questions related to mentoring and training practices were largely positive, although an average of approximately 25% did not seem to receive optimal mentoring. A total of 39.2% revealed having been pressured by a principle investigator or collaborator to produce “positive” data. About 62.8% admitted that the pressure to publish influences the way they report data. The majority of respondents did not believe that extensive revisions significantly improved the manuscript while adding to the cost and time invested. Conclusions: This survey indicates that trainees believe that the pressure to publish affects honest reporting, mostly emanating from our system of rewards and advancement. The publication process itself affects faculty and trainees and appears to influence a shift in their ethics from honest reporting (“negative data”) to selective reporting, data falsification, or even fabrication. Clin Cancer Res; 24(14); 3447–55. ©2018 AACR.

[1]  Richard Smith,et al.  Peer Review: A Flawed Process at the Heart of Science and Journals , 2006, Journal of the Royal Society of Medicine.

[2]  Rhitu Chatterjee,et al.  Cases of Mistaken Identity , 2007, Science.

[3]  Suzanne K. Linder,et al.  A Survey on Data Reproducibility in Cancer Research Provides Insights into Our Limited Ability to Translate Findings from the Laboratory to the Clinic , 2013, PloS one.

[4]  F. Collins,et al.  Policy: NIH plans to enhance reproducibility , 2014, Nature.

[5]  The erosion of research integrity: the need for culture change. , 2015, The Lancet. Oncology.

[6]  M. Roach,et al.  The declining interest in an academic career , 2017, PloS one.

[7]  Natalie Matosin,et al.  Negativity towards negative results: a discussion of the disconnect between scientific worth and scientific culture , 2014, Disease Models & Mechanisms.

[8]  Bob O'Hara,et al.  Negative results are published , 2011, Nature.

[9]  Marcus R. Munafò,et al.  Modelling the effects of subjective and objective decision making in scientific peer review , 2013, Nature.

[10]  Monya Baker,et al.  Cancer reproducibility project releases first results , 2017, Nature.

[11]  A. Casadevall,et al.  Causes for the Persistence of Impact Factor Mania , 2014, mBio.

[12]  J. Neimark Line of attack. , 2015, Science.

[13]  S. Peddada,et al.  Visualizing detailed postdoctoral employment trends using a new career outcome taxonomy , 2018, Nature Biotechnology.

[14]  R. Neve,et al.  The culture of cell culture practices and authentication--Results from a 2015 Survey. , 2015, BioTechniques.

[15]  S. Gandevia Publication pressure and scientific misconduct: why we need more open governance , 2018, Spinal Cord.

[16]  S. Horbach,et al.  The ghosts of HeLa: How cell line misidentification contaminates the scientific literature , 2017, PloS one.

[17]  K. Hangos THE LIMITS OF PEER REVIEW: , 1997, Evaluating Science and Scientists.

[18]  H. Parkes,et al.  The costs of using unauthenticated, over-passaged cell lines: how much more data do we need? , 2007, BioTechniques.

[19]  C. Begley,et al.  Drug development: Raise standards for preclinical cancer research , 2012, Nature.

[20]  Rajat Bhattacharya,et al.  It Is Time to Re‐Evaluate the Peer Review Process for Preclinical Research , 2018, BioEssays : news and reviews in molecular, cellular and developmental biology.

[21]  H. Drexler,et al.  Mix-ups and mycoplasma: the enemies within. , 2002, Leukemia research.

[22]  F. Prinz,et al.  Believe it or not: how much can we rely on published data on potential drug targets? , 2011, Nature Reviews Drug Discovery.

[23]  Chris Woolston Graduate survey: Uncertain futures , 2015, Nature.

[24]  Fernando T Maestre,et al.  Ten simple rules towards healthier research labs , 2019, PLoS Comput. Biol..

[25]  M. Baker 1,500 scientists lift the lid on reproducibility , 2016, Nature.