Questionable, Objectionable or Criminal? Public Opinion on Data Fraud and Selective Reporting in Science

Data fraud and selective reporting both present serious threats to the credibility of science. However, there remains considerable disagreement among scientists about how best to sanction data fraud, and about the ethicality of selective reporting. The public is arguably the largest stakeholder in the reproducibility of science; research is primarily paid for with public funds, and flawed science threatens the public’s welfare. Members of the public are able to make meaningful judgments about the morality of different behaviors using moral intuitions. Legal scholars emphasize that to maintain legitimacy, social control policies must be developed with some consideration given to the public’s moral intuitions. Although there is a large literature on popular attitudes toward science, there is no existing evidence about public opinion on data fraud or selective reporting. We conducted two studies—a survey experiment with a nationwide convenience sample (N = 821), and a follow-up survey with a representative sample of US adults (N = 964)—to explore community members’ judgments about the morality of data fraud and selective reporting in science. The findings show that community members make a moral distinction between data fraud and selective reporting, but overwhelmingly judge both behaviors to be immoral and deserving of punishment. Community members believe that scientists who commit data fraud or selective reporting should be fired and banned from receiving funding. For data fraud, most Americans support criminal penalties. Results from an ordered logistic regression analysis reveal few demographic and no significant partisan differences in punitiveness toward data fraud.

[1]  D. Fanelli How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data , 2009, PloS one.

[2]  Adam J. Berinsky,et al.  Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self‐Administered Surveys , 2014 .

[3]  J. Mayet,et al.  Meta-analysis of secure randomised controlled trials of β-blockade to prevent perioperative death in non-cardiac surgery , 2013, Heart.

[4]  R. Groves Nonresponse Rates and Nonresponse Bias in Household Surveys , 2006 .

[5]  Robert Cameron Mitchell,et al.  The Impact of "No Opinion" Response Options on Data Quality: Non-Attitude Reduction or an Invitation to Satisfice? , 2001 .

[6]  Michael Gibbons,et al.  Science's new social contract with society , 1999, Nature.

[7]  Z. Bhutta,et al.  Should research fraud be a crime? , 2014, BMJ : British Medical Journal.

[8]  Neil Malhotra,et al.  Underreporting in Political Science Survey Experiments: Comparing Questionnaires to Published Results , 2015, Political Analysis.

[9]  Janice Nadler Flouting the Law , 2005 .

[10]  J. Druckman,et al.  The Politics of Science , 2015 .

[11]  G. Banks,et al.  The Chrysalis Effect , 2017 .

[12]  Hunt Allcott,et al.  Consumers' Perceptions and Misperceptions of Energy Costs , 2011 .

[13]  Cheryl L. Adkins,et al.  Questions About Questionable Research Practices in the Field of Management , 2016 .

[14]  W. Stroebe,et al.  Scientific Misconduct and the Myth of Self-Correction in Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[15]  Eric W. Groenendyk The Anxious and Ambivalent Partisan: The Effect of Incidental Anxiety on Partisan Motivated Recall and Ambivalence. , 2016, Public opinion quarterly.

[16]  J. Krosnick,et al.  National Surveys Via Rdd Telephone Interviewing Versus the Internet Comparing Sample Representativeness and Response Quality , 2009 .

[17]  H. Judson The Great Betrayal: Fraud in Science , 2004 .

[18]  M. Baker 1,500 scientists lift the lid on reproducibility , 2016, Nature.

[19]  S. Reardon US vaccine researcher sentenced to prison for fraud , 2015, Nature.

[20]  E. Silver,et al.  Why Are Conservatives More Punitive Than Liberals? A Moral Foundations Approach , 2017, Law and human behavior.

[21]  Michael D. Reisig,et al.  The Disutility of Injustice , 2010 .

[22]  P. Robinson Intuitions of Justice and the Utility of Desert , 2013 .

[23]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[24]  J. Freese,et al.  Comparing data characteristics and results of an online factorial survey between a population-based and a crowdsource-recruited sample , 2014 .

[25]  Arturo Casadevall,et al.  Financial costs and personal consequences of research misconduct resulting in retracted publications , 2014, eLife.

[26]  G. Gauchat Politicization of Science in the Public Sphere , 2012 .

[27]  Jelte M. Wicherts,et al.  Outlier Removal and the Relation with Reporting Errors and Quality of Psychological Research , 2014, PloS one.

[28]  P. Robinson Distributive Principles of Criminal Law: Who Should be Punished How Much , 2008 .

[29]  D. Green,et al.  Encouraging Small Donor Contributions: A Field Experiment Testing the Effects of Nonpartisan Messages , 2015, Journal of Experimental Political Science.

[30]  G. Loewenstein,et al.  Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling , 2012, Psychological science.

[31]  C. Begley,et al.  Drug development: Raise standards for preclinical cancer research , 2012, Nature.

[32]  J. Haidt The emotional dog and its rational tail: a social intuitionist approach to moral judgment. , 2001, Psychological review.

[33]  C. Engel Scientific Disintegrity as a Public Bad , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[34]  J. Darley Morality in the Law: The Psychological Foundations of Citizens' Desires to Punish Transgressions , 2009 .

[35]  F. Godlee,et al.  Wakefield’s article linking MMR vaccine and autism was fraudulent , 2011, BMJ : British Medical Journal.

[36]  A. Acquisti,et al.  Reputation as a sufficient condition for data quality on Amazon Mechanical Turk , 2013, Behavior Research Methods.

[37]  Justin T. Pickett,et al.  Dispositional sources of sanction perceptions: Emotionality, cognitive style, intolerance of ambiguity, and self-efficacy. , 2015, Law and human behavior.

[38]  J. Haidt,et al.  Intuitive ethics: how innately prepared intuitions generate culturally variable virtues , 2004, Daedalus.

[39]  S. Igo The Averaged American: Surveys, Citizens, and the Making of a Mass Public , 2007 .

[40]  Neil Malhotra,et al.  Publication bias in the social sciences: Unlocking the file drawer , 2014, Science.

[41]  L. Franzini,et al.  Research misconduct oversight: defining case costs. , 2013, Journal of health care finance.

[42]  Barbara K. Redman,et al.  No One Likes a Snitch , 2015, Sci. Eng. Ethics.

[43]  Jesse Chandler,et al.  Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers , 2013, Behavior Research Methods.

[44]  Robert M. Groves,et al.  The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis , 2008 .

[45]  Thomas J. Leeper,et al.  The Generalizability of Survey Experiments* , 2015, Journal of Experimental Political Science.

[46]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[47]  John M. Darley,et al.  The Utility of Desert , 2003 .

[48]  Adam J. Berinsky,et al.  Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk , 2012, Political Analysis.

[49]  Gideon Nave,et al.  Evaluating replicability of laboratory experiments in economics , 2016, Science.

[50]  M. Hadjiargyrou Scientific Misconduct: How Best to Punish Those Who Consciously Violate Our Profession's Integrity? , 2015 .

[51]  Benjamin Sovacool Using Criminalization and Due Process to Reduce Scientific Misconduct , 2005, The American journal of bioethics : AJOB.

[52]  D. Shaw,et al.  Does Partisanship Shape Attitudes toward Science and Public Policy? The Case for Ideology and Religion , 2015 .

[53]  J. Wicherts,et al.  The Rules of the Game Called Psychological Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[54]  B. Redman,et al.  Off with Their Heads: The Need to Criminalize Some Forms of Scientific Misconduct , 2005, Journal of Law, Medicine & Ethics.

[55]  J. Haidt,et al.  The Righteous Mind: Why Good People Are Divided by Politics and Religion , 2014, Utilitas.