Just Post It

I argue that requiring authors to post the raw data supporting their published results has the benefit, among many others, of making fraud much less likely to go undetected. I illustrate this point by describing two cases of suspected fraud I identified exclusively through statistical analysis of reported means and standard deviations. Analyses of the raw data behind these published results provided invaluable confirmation of the initial suspicions, ruling out benign explanations (e.g., reporting errors, unusual distributions), identifying additional signs of fabrication, and also ruling out one of the suspected fraud’s explanations for his anomalous results. If journals, granting agencies, universities, or other entities overseeing research promoted or required data posting, it seems inevitable that fraud would be reduced.

[1]  K. Yuen,et al.  The two-sample trimmed t for unequal population variances , 1974 .

[2]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[3]  Anett Gyurak,et al.  Individual differences in the rejection-aggression link in the hot sauce paradigm: The case of Rejection Sensitivity. , 2008, Journal of experimental social psychology.

[4]  P. Sheeran,et al.  Can implementation intentions help to overcome ego-depletion? , 2003 .

[5]  Kathleen D. Vohs,et al.  PSYCHOLOGICAL SCIENCE Research Article SELF-REGULATORY FAILURE: A Resource-Depletion Approach , 2022 .

[6]  Teddy Seidenfeld P's in a Pod: some recipes for cooking Mendel's data , 1998 .

[7]  Joel D. Lieberman,et al.  Terror management and aggression: evidence that mortality salience motivates aggression against worldview-threatening others. , 1998, Journal of personality and social psychology.

[8]  T. Kasser,et al.  Guns, Testosterone, and Aggression , 2006, Psychological science.

[9]  Dirk P. Janssen,et al.  Gender Differences in Cooperation and Competition , 2007, Psychological science.

[10]  G. Keren,et al.  Decision anomalies, experimenter assumptions, and participants' comprehension : revaluating the uncertainty effect , 2009 .

[11]  C. Parks,et al.  Construing Collective Concerns , 2009, Psychological science.

[12]  David De Cremer,et al.  Social dilemmas as strong versus weak situations: Social value orientations and tacit coordination under resource size uncertainty , 2006 .

[13]  D. Cremer,et al.  Reactions to group success and failure as a function of identification level: a test of the goal-transformation hypothesis in social dilemmas , 2002 .

[14]  A. R. Othman,et al.  The New and Improved Two-Sample t Test , 2004, Psychological science.

[15]  L. Sanna,et al.  RETRACTED: Rising up to higher virtues: Experiencing elevated physical height uplifts prosocial actions , 2011 .

[16]  J. Wolfowitz,et al.  An Introduction to the Theory of Statistics , 1951, Nature.

[17]  R. Plackett An introduction to the theory of statistics , 1972 .

[18]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[19]  Jelte M. Wicherts,et al.  Psychology must learn a lesson from fraud case , 2011, Nature.

[20]  D. Gaffan,et al.  Less-than-expected variability in evidence for primacy and von Restorff effects in rats' nonspatial memory. , 1992 .

[21]  R. Baumeister,et al.  Ego depletion: is the active self a limited resource? , 1998, Journal of personality and social psychology.

[22]  D. Rucker,et al.  Power and Choice: Their Dynamic Interplay in Quenching the Thirst for Personal Control , 2011 .

[23]  M. Nigrini,et al.  The Use of Benford's Law as an Aid in Analytical Procedures , 1997 .

[24]  J. Nasar,et al.  The Restorative Effects of Roadside Vegetation , 2003 .

[25]  D D Dorfman,et al.  The Cyril Burt Question: New Findings , 1978, Science.

[26]  Daniel M. Oppenheimer,et al.  Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power , 2009 .

[27]  Rory A. Fisher,et al.  Has Mendel's work been rediscovered? , 1936 .

[28]  Marcello Gallucci,et al.  “How many bad apples does it take to spoil the whole barrel?”: Social exclusion and toleration for bad apples , 2009 .

[29]  Brian J. Gaines,et al.  Breaking the (Benford) Law , 2007 .

[30]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[31]  C. Parks,et al.  Mixed-motive conflict in social dilemmas: Mood as input to competitive and cooperative goals , 2003 .

[32]  K. Williams,et al.  When ostracism leads to aggression: The moderating effects of control deprivation , 2006 .

[33]  J. Carlisle,et al.  The analysis of 168 randomised controlled trials to test data integrity , 2012, Anaesthesia.

[34]  On the Robustness of Anchoring Effects in WTP and WTA Experiments , 2012 .

[35]  Aaron C. Kay,et al.  The role of interpersonal perceptions in the prime-to-behavior pathway. , 2009, Journal of personality and social psychology.

[36]  George E. Newman,et al.  Why are lotteries valued less? Multiple tests of a direct risk-aversion mechanism , 2012 .

[37]  J. Bargh,et al.  The automated will: nonconscious activation and pursuit of behavioral goals. , 2001, Journal of personality and social psychology.

[38]  Itamar Simonson,et al.  Anchoring Effects on Consumers' Willingness-to-Pay and Willingness-to-Accept , 2004 .

[39]  R. Baumeister,et al.  Emotional distress regulation takes precedence over impulse control: if you feel bad, do it! , 2001, Journal of personality and social psychology.

[40]  J. A. Branco,et al.  A Statistical Model to Explain the Mendel–Fisher Controversy , 2010, 1104.2975.

[41]  D. Smeesters,et al.  The effect of color (red versus blue) on assimilation versus contrast in prime-to-behavior effects , 2011 .

[42]  S. Roberts Less-than-expected variability in evidence for three stages in memory formation. , 1987, Behavioral neuroscience.

[43]  D. Trampe,et al.  Effects of Messiness on Preferences for Simplicity , 2012 .

[44]  Dennis D. Boos,et al.  Bootstrap Methods for Testing Homogeneity of Variances , 1989 .

[45]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[46]  D. Boos Introduction to the Bootstrap World , 2003 .

[47]  Saul Sternberg,et al.  Nutritional supplements and infection in the elderly: why do the findings conflict? , 2006, Nutrition journal.

[48]  U. Simonsohn PSYCHOLOGICAL SCIENCE Research Article Direct Risk Aversion Evidence From Risky Prospects Valued Below Their Worst Outcome , 2022 .

[49]  Jelte M. Wicherts,et al.  Publish (your data) or (let the data) perish! Why not publish your data too? , 2012 .

[50]  Shane Frederick,et al.  Overestimating Others’ Willingness to Pay , 2012 .

[51]  D. Borsboom,et al.  The poor availability of psychological research data for reanalysis. , 2006, The American psychologist.