Fostering Integrity in Research

Of the many interventions that might be used to improve the responsible conduct of research, educational interventions are among the most frequently employed. However, educational interventions come in many forms and have proven of varying effectiveness. Recognition of this point has led to calls for the systematic evaluation of responsible conduct of research educational programs. In the present effort, the basic principles underlying evaluation of educational programs are discussed. Subsequently, the application of these principles in the evaluation of responsible conduct of research educational programs is described. It is concluded that systematic evaluation of educational programs not only allow for the appraisal of instructional effectiveness but also allows for progressive refinement of educational initiatives. Ethics in the sciences and engineering is of concern not only because of its impact on progress in the research enterprise but also because the work of scientists and engineers impacts the lives of many people. Recognition of this point has led to a number of initiatives intended to improve the ethical conduct of investigators (National Academy of Engineering, 2009; National Institute of Medicine, 2002; National Academy of Sciences, 1992). Although a number of interventions have been proposed as a basis for improving ethical conduct, for example development of ethical guidelines, open data access, and better mentoring, perhaps the most widely applied approach has been ethics education (Council of Graduate Schools, 2012)—an intervention often referred to as training in the responsible conduct of research (RCR). When one examines the available literature on RCR training, it is apparent that a wide variety of approaches have been employed. Some RCR courses are based on a self-paced, online, instructional framework (e.g. Braunschweiger and Goodman, 2007). Other RCR courses involve face-to-face instruction over longer periods of time using realistic exercises and cases (e.g. Kligyte, Marcy, Waples, Sevier, Godfrey, Mumford, and Hougen, 2008). Some RCR courses 1 As the committee launched this study, members realized that questions related to the effectiveness of Responsible Conduct of Research education programs and how they might be improved were an essential part of the study task. A significant amount of work has been done to explore these topics. This work has yielded important insights, but additional research is needed to strengthen the evidence base relevant to several key policy questions. The committee asked one of the leading researchers in this field, Michael D. Mumford, to prepare a review characterizing the current state of knowledge and describing future priorities and pathways for assessing and improving RCR education programs. The resulting review constitutes important source material for Chapter 10 of the report. The committee also believes that the review adds value to this report a as a standalone document, and is including it as an appendix.

[1]  John T. Willse,et al.  Responsible Conduct of Research Measure: Initial Development and Pilot Study , 2008, Accountability in research.

[2]  A. Flanagin,et al.  Honorary and ghost authorship in high impact biomedical journals: a cross sectional survey , 2011, BMJ : British Medical Journal.

[3]  Arturo Casadevall,et al.  Why Has the Number of Scientific Retractions Increased? , 2013, PloS one.

[4]  Roberta M. Berry,et al.  Cheating lessons : learning from academic dishonesty , 2013 .

[5]  K. Jayaraman Fossil inquiry finds Indian geologist guilty of plagiarism , 1994, Nature.

[6]  Division on Earth Sharing Publication-Related Data and Materials:: Responsibilities of Authorship in the Life Sciences , 2003 .

[7]  Stephen Lock,et al.  The Baltimore case: a trial of politics, science, and character , 1999, BMJ.

[8]  F. Destefano,et al.  Autism and measles, mumps, and rubella vaccine: No epidemiological evidence for a causal association. , 2000, The Journal of pediatrics.

[9]  D E Buzzelli,et al.  The definition of misconduct in science: a view from NSF , 1993, Science.

[10]  Anne Victoria Neale,et al.  Correction and use of biomedical literature affected by scientific misconduct , 2007, Sci. Eng. Ethics.

[11]  K. Murugiah,et al.  Publication and reporting of clinical trial results: cross sectional analysis across academic medical centers , 2016, British Medical Journal.

[12]  Sandra L. Titus,et al.  Repairing research integrity , 2008, Nature.

[13]  E. Fong,et al.  Coercive Citation in Academic Publishing , 2012, Science.

[14]  Sebastian Frische It is time for full disclosure of author contributions , 2012, Nature.

[15]  N. Lazar,et al.  The ASA Statement on p-Values: Context, Process, and Purpose , 2016 .

[16]  Merrill Goozner,et al.  Relationship between Funding Source and Conclusion among Nutrition-Related Scientific Articles , 2007, PLoS medicine.

[17]  Melissa S. Anderson,et al.  Academic Misconduct and Values: The Department’s Influence , 2017 .

[18]  Careers and Rewards in Bio Sciences: The Disconnect Between Scientific Progress and Career Progression , 2001 .

[19]  Johannes Siegrist,et al.  A theory of occupational stress. , 2001 .

[20]  I. Chalmers Preventing scientific misconduct , 2006, The Lancet.

[21]  J. Merz,et al.  Scientific Misconduct: Do the Punishments Fit the Crime? , 2008, Science.

[22]  A. Goffeau,et al.  The complete genome sequence of the Gram-positive bacterium Bacillus subtilis , 1997, Nature.

[23]  Dan Ariely,et al.  The Effect of One Bad Apple on the Barrel , 2009 .

[24]  W. Broad,et al.  Global trend: more science, more fraud. , 2005, The New York times on the Web.

[25]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[26]  Joan E Sieber Misconceptions and realities about teaching online , 2005, Science and engineering ethics.

[27]  Bruce Alberts,et al.  Making Data Maximally Available , 2011, Science.

[28]  Elizabeth Wager,et al.  How Should Journal Editors Respond to Cases of Suspected Misconduct? , 2014, Journal of microbiology & biology education.

[29]  D. Vaughan THE DARK SIDE OF ORGANIZATIONS: Mistake, Misconduct, and Disaster , 1999 .

[30]  Charles Seife,et al.  Research misconduct identified by the US Food and Drug Administration: out of sight, out of mind, out of the peer-reviewed literature. , 2015, JAMA internal medicine.

[31]  M. Bebeau,et al.  The Defining Issues Test and the Four Component Model: Contributions to professional education , 2002, Journal of moral education.

[32]  Dan Ariely,et al.  The Dark Side of Creativity : Original Thinkers Can Be More Dishonest , 2013 .

[33]  Philip Greenland,et al.  Ending Honorary Authorship , 2012, Science.

[34]  G. Loewenstein,et al.  Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling , 2012, Psychological science.

[35]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[36]  D. Allison,et al.  White hat bias: a threat to the integrity of scientific reporting , 2010, Acta paediatrica.

[37]  John D. Sterman,et al.  Learning in and about complex systems , 1994 .

[38]  Brian C. Martinson,et al.  The Perverse Effects of Competition on Scientists’ Work and Relationships , 2007, Sci. Eng. Ethics.

[39]  Torsten Bumgarner A Can Of Worms , 2016 .

[40]  E. Hackett A social control perspective on scientific misconduct. , 1994, The Journal of higher education.

[41]  J. Reason Human error: models and management , 2000, BMJ : British Medical Journal.

[42]  The Interrelationship between Research Integrity, Conflict of Interest, and the Research Environment , 2014, Journal of microbiology & biology education.

[43]  D. Fanelli Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data , 2010, PloS one.

[44]  E. Wager,et al.  COOPERATION BETWEEN RESEARCH INSTITUTIONS AND JOURNALS ON RESEARCH INTEGRITY CASES: GUIDANCE FROM THE COMMITTEE ON PUBLICATION ETHICS (COPE) , 2012, Acta informatica medica : AIM : journal of the Society for Medical Informatics of Bosnia & Herzegovina : casopis Drustva za medicinsku informatiku BiH.

[45]  P. Friedman,et al.  A pilot study of biomedical trainees' perceptions concerning research ethics , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[46]  R VanNoorden THE TROUBLE WITH RETRACTIONS , 2011 .

[47]  Elise Smith,et al.  Authorship and Responsibility in Health Sciences Research: A Review of Procedures for Fairly Allocating Authorship in Multi-Author Studies , 2011, Science and Engineering Ethics.

[48]  C. Gunsalus,et al.  Institutional structure to ensure research integrity , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[49]  Kelly C. Smith,et al.  Using “ethics labs” to set a framework for ethical discussion in an undergraduate science course , 2007, Biochemistry and molecular biology education : a bimonthly publication of the International Union of Biochemistry and Molecular Biology.

[50]  Michael J. Zigmond,et al.  Promoting responsible conduct in research through “survival skills” workshops: Some mentoring is best done in a crowd , 2001, Science and engineering ethics.

[51]  Albert Bandura,et al.  The social learning perspective: Mechanisms of aggression. , 1979 .

[52]  R. Baumeister,et al.  Willpower: Rediscovering the Greatest Human Strength , 2011 .

[53]  M. Barnett-Cowan,et al.  Reproducibility Project: Psychology , 2012 .

[54]  Michael C. Loui,et al.  Development of Role-Play Scenarios for Teaching Responsible Conduct of Research , 2010, Sci. Eng. Ethics.

[55]  F. Collins Opportunities for Research and NIH , 2010, Science.

[56]  E. Berger,et al.  Ensuring the integrity, accessibility, and stewardship of research data in the digital age , 2009 .

[57]  D. Resnik,et al.  Research Misconduct Definitions Adopted by U.S. Research Institutions , 2015, Accountability in research.

[58]  Caroline White,et al.  Suspected research fraud: difficulties of getting at the truth , 2005, BMJ : British Medical Journal.

[59]  Katherine Kenny Golden holocaust: Origins of the cigarette catastrophe and the case for abolition , 2012 .

[60]  Dan Ariely,et al.  The (honest) truth about dishonesty : how we lie to everyone--especially ourselves , 2012 .

[61]  B. Obama Executive Order 13642: Making Open and Machine Readable the New Default for Government Information , 2013 .

[62]  J. Goldenring Perspective: Innocence and Due Diligence: Managing Unfounded Allegations of Scientific Misconduct , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[63]  T. Hirschi Causes of Delinquency. , 1970, British medical journal.

[64]  Sonia Vasconcelos 4th World Conference on Research Integrity , 2014 .

[65]  Melissa S. Anderson,et al.  Scientists' Perceptions of Organizational Justice and Self-Reported Misbehaviors , 2006, Journal of empirical research on human research ethics : JERHRE.

[66]  I. Cockburn,et al.  The Economics of Reproducibility in Preclinical Research , 2015, PLoS biology.

[67]  Nina Mazar,et al.  Dishonesty in scientific research. , 2015, The Journal of clinical investigation.

[68]  D. Resnik,et al.  Policies and Initiatives Aimed at Addressing Research Misconduct in High-Income Countries , 2013, PLoS medicine.

[69]  Sendhil Mullainathan,et al.  Poverty Impedes Cognitive Function , 2013, Science.

[70]  Kenneth W Goodman,et al.  The CITI Program: An International Online Resource for Education in Human Subjects Protection and the Responsible Conduct of Research , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[71]  D. Cyranoski Stem-cell method faces fresh questions , 2014, Nature.

[72]  A. Anbar,et al.  A Bacterium That Can Grow by Using Arsenic Instead of Phosphorus , 2011, Science.

[73]  David Cyranoski,et al.  Stem-cell pioneer blamed media 'bashing' in suicide note , 2014, Nature.

[74]  D. Benos,et al.  The ups and downs of peer review. , 2007, Advances in physiology education.

[75]  D. Andersen Guidelines for good scientific practice. , 1999, Danish medical bulletin.

[76]  E. Heitman,et al.  International perspectives on plagiarism and considerations for teaching international trainees. , 2011, Urologic oncology.

[77]  Steven L. Blader,et al.  The Group Engagement Model: Procedural Justice, Social Identity, and Cooperative Behavior , 2003, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[78]  J. Couzin,et al.  Cleaning Up the Paper Trail , 2006, Science.

[79]  John Hoey,et al.  Uniform Requirements for Manuscripts Submitted to Biomedical Journals , 1997, Annals of Internal Medicine.

[80]  Alan Feinerman,et al.  Assessing Graduate Student Progress in Engineering Ethics , 2012, Sci. Eng. Ethics.

[81]  Brian A. Nosek,et al.  Promoting an open research culture , 2015, Science.

[82]  F. Macrina Scientific Societies and Promotion of the Responsible Conduct of Research: Codes, Policies, and Education , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[83]  N. Steneck ORI Introduction to Responsible Conduct of Research , 2007 .

[84]  J. Ross,et al.  Ghostwriting: research misconduct, plagiarism, or fool's gold? , 2012, The American journal of medicine.

[85]  Daniele Fanelli,et al.  Negative results are disappearing from most disciplines and countries , 2011, Scientometrics.

[86]  Jiin-Yu Chen Research Misconduct Policy in Biomedicine: Beyond the Bad Apple Approach , 2014, The Yale Journal of Biology and Medicine.

[87]  Frans Van de Werf,et al.  An international randomized trial comparing four thrombolytic strategies for acute myocardial infarction. , 1993, The New England journal of medicine.

[88]  Melissa S. Anderson,et al.  The Importance of Organizational Justice in Ensuring Research Integrity , 2010, Journal of empirical research on human research ethics : JERHRE.

[89]  B. Wansink,et al.  The Visual Illusions of Food: Why Plates, Bowls, and Spoons Can Bias Consumption Volume , 2006 .

[90]  SCIENTIA MAGNA,et al.  Information for Authors , 2007, IEEE Journal on Selected Areas in Communications.

[91]  Donald S Kornfeld,et al.  Perspective: Research Misconduct The Search for a Remedy , 2012, Academic medicine : journal of the Association of American Medical Colleges.

[92]  S. Kim Authorship , 2016, Korean journal of family medicine.

[93]  J. Laub,et al.  Crime in the Making , 1993 .

[94]  Robert Folger,et al.  Organizational Justice and Human Resource Management , 1998 .

[95]  Richard B. Freeman,et al.  Competition and Careers in Biosciences , 2001, Science.

[96]  Ashutosh S. Jogalekar Social Media, Peer Review, and Responsible Conduct of Research (RCR) in Chemistry: Trends, Pitfalls, and Promises , 2015, Accountability in research.

[97]  Bradley J. Brummel,et al.  Outcomes Assessment of Role-Play Scenarios for Teaching Responsible Conduct of Research , 2011, Accountability in research.

[98]  Michael Davis,et al.  Ethics Across the Graduate Engineering Curriculum: An Experiment in Teaching and Assessment , 2008 .

[99]  Mounir Errami,et al.  Responding to Possible Plagiarism , 2009, Science.

[100]  J. Chibnall,et al.  Misconduct: Lessons from researcher rehab , 2016, Nature.

[101]  Law.,et al.  Optimizing the Nation's Investment in Academic Research: A New Regulatory Framework for the 21st Century , 2016 .

[102]  M S Pritchard,et al.  Service-learning and engineering ethics , 2000, Science and engineering ethics.

[103]  D. Cyranoski Stem-cell scientist found guilty of misconduct , 2014, Nature.

[104]  Carsten Schmidt,et al.  Disclosing conflicts of interest – Do experience and reputation matter? , 2006 .

[105]  H. Sox,et al.  Research Misconduct, Retraction, and Cleansing the Medical Literature: Lessons from the Poehlman Case , 2006, Annals of Internal Medicine.

[106]  Michael Roach,et al.  Science PhD Career Preferences: Levels, Changes, and Advisor Encouragement , 2012, PloS one.

[107]  A. Casadevall,et al.  Misconduct accounts for the majority of retracted scientific publications , 2012, Proceedings of the National Academy of Sciences.

[108]  Pierre Azoulay,et al.  Incentives and Creativity: Evidence from the Academic Life Sciences , 2009 .

[109]  Victoria Stodden,et al.  Enabling reproducible research: Licensing for scientific innovation , 2009 .

[110]  G Rose,et al.  Sick individuals and sick populations. , 1985, International journal of epidemiology.

[111]  Benjamin K. Sovacool,et al.  Exploring Scientific Misconduct: Isolated Individuals, Impure Institutions, or an Inevitable Idiom of Modern Science? , 2008 .

[112]  Norman Kaplan,et al.  The Sociology of Science: Theoretical and Empirical Investigations , 1974 .

[113]  Michèle B. Nuijten,et al.  statcheck: Extract statistics from articles and recompute p values (R package version 1.0.0.) , 2014 .

[114]  J. Chibnall,et al.  Assessing the Need for a Research Ethics Remediation Program , 2013, Clinical and translational science.

[115]  Josh Fischman,et al.  Fake Peer Reviews, the Latest Form of Scientific Fraud, Fool Journals. , 2012 .

[116]  D Greenberg The fraud squad. , 1990, Lancet.

[117]  Nicholas H. Steneck,et al.  Fostering integrity in research: Definitions, current knowledge, and future directions , 2006, Science and Engineering Ethics.

[118]  Mark S. Davis,et al.  Causal Factors Implicated in Research Misconduct: Evidence from ORI Case Files , 2007, Sci. Eng. Ethics.

[119]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[120]  H. Bauchner,et al.  Sharing Clinical Trial Data: A Proposal from the International Committee of Medical Journal Editors , 2016, PLoS medicine.

[121]  B. Lo Sharing clinical trial data: maximizing benefits, minimizing risk. , 2015, JAMA.

[122]  P. Loveridge,et al.  Scientific integrity. , 1993, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[123]  Mark S Frankel,et al.  Scientific societies and research integrity: What are they doing and how well are they doing it? , 2003, Science and engineering ethics.

[124]  Shane Connelly,et al.  Evaluating the Effects That Existing Instruction on Responsible Conduct of Research Has on Ethical Decision Making , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[125]  Shane Connelly,et al.  A Sensemaking Approach to Ethics Training for Scientists: Preliminary Evidence of Training Effectiveness , 2008, Ethics & behavior.

[126]  Brendan B. Godfrey Investigation of Alleged Research Misconduct by Lincoln Laboratory Members of the 1998-5 POET Study Team , 2007 .

[127]  V. Chopra,et al.  Perioperative mischief: the price of academic misconduct. , 2012, The American journal of medicine.

[128]  I. Mitroff Norms and Counter-Norms in a Select Group of the Apollo Moon Scientists: A Case Study of the Ambivalence of Scientists , 1974 .

[129]  D. Goodstein On Fact and Fraud , 2017 .

[130]  Benjamin F. Jones,et al.  Supporting Online Material Materials and Methods Figs. S1 to S3 References the Increasing Dominance of Teams in Production of Knowledge , 2022 .

[131]  J. Ioannidis,et al.  Reproducibility in Science: Improving the Standard for Basic and Preclinical Research , 2015, Circulation research.

[132]  N. McGlynn Thinking fast and slow. , 2014, Australian veterinary journal.

[133]  Paula E. Stephan,et al.  Research efficiency: Perverse incentives , 2012, Nature.

[134]  M. Kalichman,et al.  Student perceptions of the effectiveness of education in the responsible conduct of research , 2006, Science and engineering ethics.

[135]  R. Agnew Foundation for a General Strain Theory of Crime and Delinquency , 1992, Crime, Inequality and the State.

[136]  J. Ioannidis Why Science Is Not Necessarily Self-Correcting , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[137]  Brian C. Martinson,et al.  Development and Validation of the Survey of Organizational Research Climate (SORC) , 2012, Science and Engineering Ethics.

[138]  T. Lemmens,et al.  Legal Remedies for Medical Ghostwriting: Imposing Fraud Liability on Guest Authors of Ghostwritten Articles , 2011, PLoS medicine.

[139]  M. Nylenna,et al.  Scientific misconduct: a new approach to prevention , 2006, The Lancet.

[140]  C. Norman Scientific freedom and responsibility , 1975, Nature.

[141]  Don A. Moore,et al.  The Dirt on Coming Clean: Perverse Effects of Disclosing Conflicts of Interest , 2003, The Journal of Legal Studies.

[142]  S. Lazic,et al.  A call for transparent reporting to optimize the predictive value of preclinical research , 2012, Nature.

[143]  Dan Ariely,et al.  Unable to Resist Temptation: How Self-control Depletion Promotes Unethical Behavior , 2011 .

[144]  W. Levelt,et al.  Flawed science: The fraudulent research practices of social psychologist Diederik Stapel , 2012 .

[145]  Elizabeth Wager Defining and responding to plagiarism , 2014, Learn. Publ..

[146]  Policy.,et al.  The Postdoctoral Experience Revisited , 2014 .

[147]  Anja Walter,et al.  Deviant Behavior A Social Learning Approach , 2016 .

[148]  Marjorie M. K. Hlava,et al.  Beyond authorship: attribution, contribution, collaboration, and credit , 2015, Learn. Publ..

[149]  Kelly Servick Michigan judge asks PubPeer to turn over anonymous user information , 2015 .

[150]  M. Kalichman,et al.  Reported Goals for Responsible Conduct of Research Courses , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[151]  J. Ioannidis,et al.  Persistence of contradicted claims in the literature. , 2007, JAMA.

[152]  E. Cartlidge Science and the law. Prison terms for L'Aquila experts shock scientists. , 2012, Science.

[153]  D. Resnik Plagiarism among Collaborators , 2013, Accountability in research.

[154]  D. B. Strohmetz,et al.  The Use of Role-Play in Teaching Research Ethics: A Validation Study , 1992, Teaching of psychology.

[155]  Julia Evetts,et al.  Professionalism: Value and ideology , 2013 .

[156]  Kelly R Risbey,et al.  What Do Mentoring and Training in the Responsible Conduct of Research Have To Do with Scientists’ Misbehavior? Findings from a National Survey of NIH-Funded Scientists , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[157]  Terri Gullickson,et al.  On Being a Scientist: Responsible Conduct in Research (2nd ed). , 1996 .

[158]  Melissa S. Anderson,et al.  Institutions' Expectations for Researchers' Self-Funding, Federal Grant Holding, and Private Industry Involvement: Manifold Drivers of Self-Interest and Researcher Behavior , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[159]  David Matza Delinquency and Drift , 1966 .

[160]  Nachman Ben-Yehuda Deviance in Science: Towards the Criminology of Science , 1986 .

[161]  J. Chibnall,et al.  Understanding Research Misconduct: A Comparative Analysis of 120 Cases of Professional Wrongdoing , 2013, Accountability in research.

[162]  Robert Agnew,et al.  General Strain Theory: Current Status and Directions for Further Research. , 2006 .

[163]  anonymous Newsmakers , 1983, Groundwater Monitoring & Remediation.

[164]  Dietrich Dörner,et al.  The Logic Of Failure: Recognizing And Avoiding Error In Complex Situations , 1997 .

[165]  Lloyd E. Ohlin,et al.  Delinquency And Opportunity , 1960 .

[166]  Arian Maleki,et al.  15 Years of Reproducible Research in Computational Harmonic Analysis , 2008 .

[167]  Davide Castelvecchi,et al.  Physics paper sets record with more than 5,000 authors , 2015, Nature.

[168]  Paula E. Stephan,et al.  The Impact of Information Technology on Academic Scientists' Productivity and Collaboration Patterns , 2010, Manag. Sci..

[169]  Ann C. Weller,et al.  Betrayers of the Truth , 1984 .

[170]  Edward Brent,et al.  Accounting for Cheating: An Evolving Theory and Emergent Themes , 2011 .

[171]  Kenton O'Hara,et al.  Troubling Trends in Scientific Software Use , 2013, Science.

[172]  Ismael Rafols,et al.  Is science becoming more interdisciplinary? Measuring and mapping six research fields over time , 2009, Scientometrics.

[173]  David L. Donoho,et al.  WaveLab and Reproducible Research , 1995 .

[174]  Steven Woloshin,et al.  Influence of medical journal press releases on the quality of associated newspaper coverage: retrospective cohort study , 2012, BMJ : British Medical Journal.

[175]  Brian C. Martinson,et al.  Relationships Between the Survey of Organizational Research Climate (SORC) and Self-Reported Research Practices , 2013, Sci. Eng. Ethics.

[176]  Thomas E. Nisonger Research Misconduct: Issues, Implications, and Strategies , 1999, Inf. Soc..

[177]  B. Alberts Impact Factor Distortions , 2013, Science.

[178]  A. Fugh-Berman,et al.  The Haunting of Medical Journals: How Ghostwriting Sold “HRT” , 2010, PLoS medicine.

[179]  W. James Fraud and hoaxes in science , 1995, Nature.

[180]  James M. DuBois,et al.  The Development and Assessment of an NIH-Funded Research Ethics Training Program , 2008, Academic medicine : journal of the Association of American Medical Colleges.

[181]  M. Bebeau Moral Reasoning in Scientific Research: Cases for Teaching and Assessment. , 1995 .

[182]  K. Pimple Assessing Student Learning in the Responsible Conduct of Research , 2001 .

[183]  U. Simonsohn Just Post It: The Lesson from Two Cases of Fabricated Data Detected by Statistics Alone , 2013 .

[184]  K. Pimple,et al.  Research Misconduct and Crime Lessons from Criminal Science on Preventing Misconduct and Promoting Integrity , 2005, Accountability in research.

[185]  Melissa S. Anderson Collective Openness and Other Recommendations for the Promotion of Research Integrity , 2007, Sci. Eng. Ethics.

[186]  F. Godlee,et al.  Wakefield’s article linking MMR vaccine and autism was fraudulent , 2011, BMJ : British Medical Journal.

[187]  Nina Mazar,et al.  The Dishonesty of Honest People: A Theory of Self-Concept Maintenance , 2008 .

[188]  Bruce Alberts,et al.  The End of “Small Science”? , 2012, Science.

[189]  Mary L. Devereaux,et al.  Rethinking the Meaning of Ethics in RCR Education , 2014, Journal of microbiology & biology education.

[190]  Chris Arney Nudge: Improving Decisions about Health, Wealth, and Happiness , 2015 .

[191]  Don A. Moore,et al.  When Sunlight Fails to Disinfect: Understanding the Perverse Effects of Disclosing Conflicts of Interest , 2011 .

[192]  Declan Butler,et al.  Journals step up plagiarism policing , 2010, Nature.

[193]  Shane Connelly,et al.  A Meta-Analysis of Ethics Instruction Effectiveness in the Sciences , 2009, Ethics & behavior.

[194]  Jeffrey D. Scargle,et al.  Publication Bias: The “File-Drawer” Problem in Scientific Inference , 2000 .

[195]  Karen B Schmaling,et al.  Ethics Instruction Increases Graduate Students' Responsible Conduct of Research Knowledge but not Moral Reasoning , 2009, Accountability in research.

[196]  Geoffrey W. McCarthy,et al.  On Being a Scientist: A Guide to Responsible Conduct in Research, 3rd ed. , 2012 .

[197]  Melissa S. Anderson,et al.  Scientists behaving badly , 2005, Nature.

[198]  Morten Wahrendorf,et al.  A short generic measure of work stress in the era of globalization: effort–reward imbalance , 2009, International archives of occupational and environmental health.

[199]  C. Glenn Begley,et al.  Raise standards for preclinical cancer research , 2012 .

[200]  Udo Schüklenk,et al.  Retraction watch. , 2012, Bioethics.

[201]  A. Iwama,et al.  Report on STAP Cell Research Paper Investigation , 2014 .

[202]  P. E. Kalb,et al.  Legal issues in scientific research. , 2002, JAMA.

[203]  Sandra L. Titus,et al.  Ensuring PhD Development of Responsible Conduct of Research Behaviors: Who’s Responsible? , 2014, Sci. Eng. Ethics.

[204]  Rachelle Hollander,et al.  Ethics education and scientific and engineering research : what's been learned? what should be done? : summary of a workshop , 2009 .

[205]  Michael W. Kalichman,et al.  Effectiveness of a responsible conduct of research course: a preliminary study , 2007, Sci. Eng. Ethics.

[206]  D. Moher,et al.  Systematic review of the effectiveness of training programs in writing for scholarly publication, journal editing, and manuscript peer review (protocol) , 2013, Systematic Reviews.

[207]  Carsten Schmidt,et al.  Disclosing Conflicts of interest - Do Experience and Reputation Matter? , 2010 .

[208]  Erin A. Cech,et al.  How Economics Shapes Science , 2013 .

[209]  Kei Koizumi,et al.  Increasing Access to the Results of Federally Funded Scientific Research , 2016 .

[210]  H. K. Schachman What is misconduct in science? , 1993, Science.

[211]  Wayne T. McCormack,et al.  Team-Based Learning Instruction for Responsible Conduct of Research Positively Impacts Ethical Decision-Making , 2014, Accountability in research.

[212]  W. J. Hutchins The evolution of machine translation systems , 1981, TC.

[213]  N. Steneck,et al.  Research universities and scientific misconduct -- history, policies, and the future. , 1994, The Journal of higher education.

[214]  Kelsey E. Medeiros,et al.  Biases in Ethical Decision Making among University Faculty , 2014, Accountability in research.

[215]  J. Ioannidis,et al.  Research grants: Conform and be funded , 2012, Nature.

[216]  Harold Varmus,et al.  Rescuing US biomedical research from its systemic flaws , 2014, Proceedings of the National Academy of Sciences.

[217]  J. Mayet,et al.  Meta-analysis of secure randomised controlled trials of β-blockade to prevent perioperative death in non-cardiac surgery , 2013, Heart.

[218]  R. Peng Reproducible Research in Computational Science , 2011, Science.

[219]  Miron L. Straf,et al.  Using Science as Evidence in Public Policy , 2013 .

[220]  W. Stroebe,et al.  Scientific Misconduct and the Myth of Self-Correction in Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[221]  Jeremy M. Berg,et al.  Research in academic medical centers: Two threats to sustainable support , 2015, Science Translational Medicine.

[222]  Responsibility of applicants for promoting objectivity in research for which public health service funding is sought and responsible prospective contractors. Final rule. , 2011, Federal register.

[223]  Elizabeth Heitman,et al.  New Graduate Students’ Baseline Knowledge of the Responsible Conduct of Research , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[224]  Jeffrey Pfeffer,et al.  The effect of wage dispersion on satisfaction, productivity, and working collaboratively: Evidence from college and university faculty. , 1993 .

[225]  I. Ial,et al.  Combating scientific misconduct , 2010, Nature Cell Biology.

[226]  B. Petersson,et al.  Good research practice , 2003 .

[227]  Thomas Vogt,et al.  Reinventing Discovery: The New Era of Networked Science , 2012 .

[228]  Ole Bjørn Rekdal,et al.  Academic urban legends , 2014, Social studies of science.

[229]  W. Mallon,et al.  The continued evolution of faculty appointment and tenure policies at U.S. medical schools. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[230]  Trish Groves,et al.  Enhancing the quality and transparency of health research , 2008, BMJ : British Medical Journal.

[231]  C. Gunsalus How to blow the Whistle and still have a career afterwards , 1998 .

[232]  Findings of Research Misconduct , 2017, Federal register.

[233]  P. Lachenbruch,et al.  The role of biostatistics in the prevention, detection and treatment of fraud in clinical trials. , 1999, Statistics in medicine.

[234]  A. R. Price Research Misconduct and Its Federal Regulation: The Origin and History of the Office of Research Integrity—With Personal Views by ORI's Former Associate Director for Investigative Oversight , 2013, Accountability in research.

[235]  P. Medawar,et al.  The strange case of the spotted mice and other classic essays on science , 1996 .

[236]  Matthew S. Thiese,et al.  The misuse and abuse of statistics in biomedical research , 2015, Biochemia medica.

[237]  J. Ioannidis Why Most Published Research Findings Are False , 2005, PLoS medicine.

[238]  Celia Moore,et al.  The cheater's high: the unexpected affective benefits of unethical behavior. , 2013, Journal of personality and social psychology.

[239]  Alan D. Hutson,et al.  The Costs and Underappreciated Consequences of Research Misconduct: A Case Study , 2010, PLoS medicine.

[240]  H. Kehlet,et al.  Perioperative analgesia: what do we still know? , 2009, Anesthesia and analgesia.

[241]  R. Dresser Sanctions for research misconduct: a legal perspective , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[242]  Minghua Zhang,et al.  A Comprehensive Survey of Retracted Articles from the Scholarly Literature , 2012, PloS one.

[243]  M. Teitelbaum,et al.  Structural Disequilibria in Biomedical Research , 2008, Science.

[244]  Thomas H. Jordan,et al.  Lessons of L’Aquila for Operational Earthquake Forecasting , 2012 .

[245]  D. Fanelli How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data , 2009, PloS one.

[246]  Ronald L. Akers,et al.  Adolescent marijuana use: A test of three theories of deviant behavior , 1985 .

[247]  V. Weil,et al.  Research Ethics: Cases and Materials , 1995 .

[248]  M. Munafo Announcement: Time to tackle cells’ mistaken identity , 2015, Nature.

[249]  M. Enserink Scientific misconduct. Sabotaged scientist sues Yale and her lab chief. , 2014, Science.

[250]  The Ligo Scientific Collaboration,et al.  Observation of Gravitational Waves from a Binary Black Hole Merger , 2016, 1602.03837.

[251]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[252]  D. Butler Hyped GM maize study faces growing scrutiny , 2012, Nature.

[253]  Ana Marušić,et al.  A Systematic Review of Research on the Meaning, Ethics and Practices of Authorship across Scholarly Disciplines , 2011, PloS one.

[254]  Waheed Akbar Bhatti,et al.  Corporate ethical values, group creativity, job commitment and performance: The effect of work response on work context , 2013 .

[255]  Evaluating the Effectiveness of Institutional Efforts to Educate Staff on their Policies for Dealing with Research Misconduct and Research Integrity , 2010 .

[256]  Sandra L. Titus,et al.  Mentoring and Research Misconduct: An Analysis of Research Mentoring in Closed ORI Cases , 2008, Sci. Eng. Ethics.

[257]  A. Casadevall,et al.  Reforming Science: Methodological and Cultural Reforms , 2011, Infection and Immunity.

[258]  J. Money,et al.  The Construction of Homosexuality , 1990 .

[259]  M. Cho,et al.  Barriers to Considering Ethical and Societal Implications of Research: Perceptions of Life Scientists , 2012, AJOB primary research.

[260]  D. Rennie,et al.  Scientific misconduct. New definition, procedures, and office--perhaps a new leaf. , 1993, JAMA.

[261]  Victoria Stodden,et al.  Open science: Policy implications for the evolving phenomenon of user-led scientific innovation , 2010 .

[262]  B. Martinson,et al.  Survey of Organizational Research Climates in Three Research Intensive, Doctoral Granting Universities , 2014, Journal of empirical research on human research ethics : JERHRE.

[263]  D. Green,et al.  When contact changes minds: An experiment on transmission of support for gay equality , 2014, Science.

[264]  Deni Elliott,et al.  Evaluating teaching and students’ learning of academic research ethics , 1996 .

[265]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[266]  C. Gross,et al.  Effect of blinded peer review on abstract acceptance. , 2006, JAMA.

[267]  Shane Connelly,et al.  Environmental Influences on Ethical Decision Making: Climate and Environmental Predictors of Research Integrity , 2007 .

[268]  G. Loewenstein,et al.  The Limits of Transparency: Pitfalls and Potential of Disclosing Conflicts of Interest , 2011 .

[269]  Helmar Bornemann-Cimenti,et al.  Perpetuation of Retracted Publications Using the Example of the Scott S. Reuben Case: Incidences, Reasons and Possible Improvements , 2016, Sci. Eng. Ethics.

[270]  Maximiliaan Schillebeeckx,et al.  The missing piece to changing the university culture , 2013, Nature Biotechnology.

[271]  R. Merton Social Structure and Anomie , 1938 .

[272]  Caspar W. Weinberger,et al.  Title 45-Public Welfare , 1975 .

[273]  S. Reardon US vaccine researcher sentenced to prison for fraud , 2015, Nature.

[274]  R. Steen Retractions in the scientific literature: is the incidence of research fraud increasing? , 2010, Journal of Medical Ethics.

[275]  Peter Gluckman,et al.  Policy: The art of science advice to government , 2014, Nature.

[276]  P. Jewesson,et al.  Industry Sponsorship and Authorship of Clinical Trials Over 20 Years , 2004, The Annals of pharmacotherapy.

[277]  H Edward Davidson,et al.  Publication ethics. , 2008, The Consultant pharmacist : the journal of the American Society of Consultant Pharmacists.

[278]  K. Popper All life is problem solving , 1997 .

[279]  Charles E. Harris,et al.  The Good Engineer: Giving Virtue its Due in Engineering Ethics , 2008, Sci. Eng. Ethics.

[280]  Shane Connelly,et al.  Personality and Ethical Decision-Making in Research: The Role of Perceptions of Self and others , 2007, Journal of empirical research on human research ethics : JERHRE.

[281]  C. Gunsalus Preventing the need for whistleblowing: Practical advice for university administrators , 1998 .

[282]  Melissa S. Anderson,et al.  Extending the Mertonian Norms: Scientists' Subscription to Norms of Research , 2010, The Journal of higher education.

[283]  C. Pascal,et al.  The history and future of the office of research integrity: Scientific misconduct and beyond , 1999, Science and engineering ethics.

[284]  Richard Smith,et al.  Research Misconduct: The Poisoning of the Well , 2006, Journal of the Royal Society of Medicine.