Research practices and assessment of research misconduct

This article discusses the responsible conduct of research, questionable research practices, and research misconduct. Responsible conduct of research is often defined in terms of a set of abstract, normative principles, professional standards, and ethics in doing research. In order to accommodate the normative principles of scientific research, the professional standards, and a researcher’s moral principles, transparent research practices can serve as a framework for responsible conduct of research. We suggest a “prune-and-add” project structure to enhance transparency and, by extension, responsible conduct of research. Questionable research practices are defined as practices that are detrimental to the research process. The prevalence of questionable research practices remains largely unknown, and reproducibility of findings has been shown to be problematic. Questionable practices are discouraged by transparent practices because practices that arise from them will become more apparent to scientific peers. Most effective might be preregistrations of research design, hypotheses, and analyses, which reduce particularism of results by providing an a priori research scheme. Research misconduct has been defined as fabrication, falsification, and plagiarism (FFP), which is clearly the worst type of research practice. Despite it being clearly wrong, it can be approached from a scientific and legal perspective. The legal perspective sees research misconduct as a form of white-collar crime. The scientific perspective seeks to answer the following question: “Were results invalidated because of the misconduct?” We review how misconduct is typically detected, how its detection can be improved, and how prevalent it might be. Institutions could facilitate detection of data fabrication and falsification by implementing data auditing. Nonetheless, the effect of misconduct is pervasive: many retracted articles are still cited after the retraction has been issued. Main points Researchers systematically evaluate their own conduct as more responsible than colleagues, but not as responsible as they would like. Transparent practices, facilitated by the Open Science Framework, help embody scientific norms that promote responsible conduct. Questionable research practices harm the research process and work counter to the generally accepted scientific norms, but are hard to detect. Research misconduct requires active scrutiny of the research community because editors and peer-reviewers do not pay adequate attention to detecting this. Tips are given on how to improve your detection of potential problems.

[1]  M. Kalichman,et al.  Student perceptions of the effectiveness of education in the responsible conduct of research , 2006, Science and engineering ethics.

[2]  Elysa Koppelman-White,et al.  Research Misconduct and The Scientific process: Continuing Quality Improvement , 2006, Accountability in research.

[3]  F. Dexter,et al.  Calculating the probability of random sampling for continuous variables in submitted or published randomised controlled trials , 2015, Anaesthesia.

[4]  Neil Malhotra,et al.  Publication bias in the social sciences: Unlocking the file drawer , 2014, Science.

[5]  Brian A. Nosek,et al.  Scientific Utopia , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[6]  D. Fanelli How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data , 2009, PloS one.

[7]  L. HARKing: Hypothesizing After the Results are Known , 2002 .

[8]  J. Wicherts,et al.  The (mis)reporting of statistical results in psychology journals , 2011, Behavior research methods.

[9]  M. Pfeifer,et al.  The continued use of retracted, invalid scientific literature. , 1990, JAMA.

[10]  Michèle B. Nuijten,et al.  Why Publishing Everything Is More Effective than Selective Publishing of Statistically Significant Results , 2014, PloS one.

[11]  Richard Van Noorden Science publishing: The trouble with retractions , 2011, Nature.

[12]  Melissa S. Anderson,et al.  Normative Dissonance in Science: Results from a National Survey of U.S. Scientists , 2007, Journal of empirical research on human research ethics : JERHRE.

[13]  Brian A. Nosek,et al.  Scientific Utopia: I. Opening Scientific Communication , 2012, ArXiv.

[14]  Donald S Kornfeld,et al.  Perspective: Research Misconduct The Search for a Remedy , 2012, Academic medicine : journal of the Association of American Medical Colleges.

[15]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[16]  Charles Seife,et al.  Research misconduct identified by the US Food and Drug Administration: out of sight, out of mind, out of the peer-reviewed literature. , 2015, JAMA internal medicine.

[17]  W. Stroebe,et al.  Scientific Misconduct and the Myth of Self-Correction in Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[18]  Ernesto Reuben,et al.  (Un)Available upon Request: Field Experiment on Researchers' Willingness to Share Supplementary Materials , 2012, Accountability in research.

[19]  G. Loewenstein,et al.  Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling , 2012, Psychological science.

[20]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[21]  Matthew C. Makel,et al.  Replications in Psychology Research , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[22]  James E. Mosimann,et al.  Data fabrication: Can people generate random digits? , 1995 .

[23]  Lutz Bornmann,et al.  Do editors and referees look for signs of scientific misconduct when reviewing manuscripts? A quantitative content analysis of studies that examined review criteria and reasons for accepting and rejecting manuscripts for publication , 2008, Scientometrics.

[24]  C. Menke A Note on Science and Democracy? Robert K. Mertons Ethos of Science , 2015 .

[25]  Melissa S. Anderson,et al.  Extending the Mertonian Norms: Scientists' Subscription to Norms of Research , 2010, The Journal of higher education.

[26]  Jelte M. Wicherts,et al.  Psychology must learn a lesson from fraud case , 2011, Nature.

[27]  J. Lubalin,et al.  The fallout: What happens to whistleblowers and those accused but exonerated of scientific misconduct? , 1999, Science and Engineering Ethics.

[28]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[29]  D. Borsboom,et al.  The poor availability of psychological research data for reanalysis. , 2006, The American psychologist.

[30]  Kenneth M. Yamada,et al.  What's in a picture? The temptation of image manipulation , 2004, The Journal of cell biology.

[31]  Encourage Playing with Data and Discourage Questionable Reporting Practices , 2015, Psychometrika.

[32]  W. Levelt,et al.  Flawed science: The fraudulent research practices of social psychologist Diederik Stapel , 2012 .

[33]  Michèle B. Nuijten,et al.  The prevalence of statistical reporting errors in psychology (1985–2013) , 2015, Behavior Research Methods.

[34]  Mary Allen,et al.  Retrospective Reflections of a Whistleblower: Opinions on Misconduct Responses , 2013, Accountability in research.

[35]  James E. Mosimann,et al.  Terminal Digits and the Examination of Questioned Data , 2002 .

[36]  P. Lachenbruch,et al.  The role of biostatistics in the prevention, detection and treatment of fraud in clinical trials. , 1999, Statistics in medicine.

[37]  Paul J. Laurienti,et al.  Ethics in 15 min per Week , 2011, Sci. Eng. Ethics.

[38]  Michèle B. Nuijten,et al.  Statistical Reporting Errors and Collaboration on Statistical Analyses in Psychological Science , 2014, PloS one.

[39]  A. Vickers,et al.  Empirical Study of Data Sharing by Authors Publishing in PLoS Journals , 2009, PloS one.

[40]  F. Quimby What's in a picture? , 1993, Laboratory animal science.

[41]  Adam Marcus,et al.  What Studies of Retractions Tell Us , 2014 .

[42]  Lucy Carter,et al.  A case for a duty to feed the hungry: GM plants and the third world , 2007, Sci. Eng. Ethics.

[43]  C. N. Stewart,et al.  Misconduct versus Honest Error and Scientific Disagreement , 2012, Accountability in research.

[44]  Kelly R Risbey,et al.  What Do Mentoring and Training in the Responsible Conduct of Research Have To Do with Scientists’ Misbehavior? Findings from a National Survey of NIH-Funded Scientists , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[45]  Susan Feng Lu,et al.  The Retraction Penalty: Evidence from the Web of Science , 2013, Scientific Reports.

[46]  D. Stapel,et al.  Emotion Elicitor or Emotion Messenger? , 2008, Psychological science.

[47]  A. Casadevall,et al.  Misconduct accounts for the majority of retracted scientific publications , 2012, Proceedings of the National Academy of Sciences.

[48]  Neil Malhotra,et al.  Underreporting in Psychology Experiments , 2016 .

[49]  P. Armitage,et al.  Repeated Significance Tests on Accumulating Data , 1969 .

[50]  Nicholas H. Steneck,et al.  Fostering integrity in research: Definitions, current knowledge, and future directions , 2006, Science and Engineering Ethics.

[51]  Brian A. Nosek,et al.  Promoting an open research culture , 2015, Science.

[52]  Han L. J. van der Maas,et al.  Science Perspectives on Psychological an Agenda for Purely Confirmatory Research on Behalf Of: Association for Psychological Science , 2022 .

[53]  W. W. Stewart,et al.  The integrity of the scientific literature , 1987, Nature.

[54]  J. Carlisle,et al.  The analysis of 168 randomised controlled trials to test data integrity , 2012, Anaesthesia.

[55]  C. Chambers Ten reasons why journals must review manuscripts before results are known. , 2015, Addiction.

[56]  Helmar Bornemann-Cimenti,et al.  Perpetuation of Retracted Publications Using the Example of the Scott S. Reuben Case: Incidences, Reasons and Possible Improvements , 2016, Sci. Eng. Ethics.

[57]  Elisabeth M. Bik,et al.  The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications , 2016, mBio.

[58]  Reginald B. Adams,et al.  Investigating Variation in Replicability: A “Many Labs” Replication Project , 2014 .

[59]  F. Weinert Zur Lage der Psychologie , 1987 .

[60]  C Whitbeck,et al.  Group mentoring to foster the responsible conduct of research. , 2001, Science and engineering ethics.

[61]  Uri Simonsohn,et al.  Just Post It , 2013, Psychological science.

[62]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[63]  I. Mitroff Norms and Counter-Norms in a Select Group of the Apollo Moon Scientists: A Case Study of the Ambivalence of Scientists , 1974 .

[64]  Elizabeth Wager,et al.  Fate of Articles That Warranted Retraction Due to Ethical Concerns: A Descriptive Cross-Sectional Study , 2014, PloS one.

[65]  L W Bivens,et al.  Responsible conduct of research. , 1991, ASHA.

[66]  M. Hagen,et al.  Ethical principles of psychologists and code of conduct. , 2002, The American psychologist.

[67]  Jacob Cohen The earth is round (p < .05) , 1994 .

[68]  K. Sijtsma,et al.  Improving the Conduct and Reporting of Statistical Analysis in Psychology , 2016, Psychometrika.