The Costs of Deception: Evidence from Psychology

Recently, it has been argued that the evidence in social science research suggests that deceiving subjects in an experiment does not lead to a significant loss of experimental control. Based on this assessment, experimental economists were counseled to lift their de facto prohibition against deception to capture its potential benefits. To the extent that this recommendation is derived from empirical studies, we argue that it draws on a selective sample of the available evidence. Building on a systematic review of relevant research in psychology, we present two major results: First, the evidence suggests that the experience of having been deceived generates suspicion which in turn is likely to affect judgment and decision making of a non-negligible number of participants. Second, we find little evidence for reputational spillover effects that have been hypothesized by a number of authors in psychology and economics (e.g., Kelman, 1967; Davis and Holt, 1993). Based on a discussion of the methodological costs and benefits of deception, we conclude that experimental economists' prohibition of deception is a sensible convention that economists should not abandon.

[1]  N. Bardsley Control Without Deception: Individual Behaviour in Free-Riding Experiments Revisited , 2000 .

[2]  Kjell Hausken,et al.  Intra-Level and Inter-Level Interaction , 1995 .

[3]  L. Levy Awareness, learning, and the beneficent subject as expert witness. , 1967, Journal of personality and social psychology.

[4]  L. J. Stricker,et al.  The true deceiver. , 1967, Psychological bulletin.

[5]  Joyce E. Berg,et al.  Trust, Reciprocity, and Social History , 1995 .

[6]  Robert Rosenthal,et al.  People Studying People: Artifacts and Ethics in Behavioral Research , 1997 .

[7]  Kjell Hausken The dynamics of within-group and between-group interaction , 1995 .

[8]  Deborah Ruth Richardson,et al.  Amelioration of deception and harm in psychological research: The important role of debriefing , 1983 .

[9]  N. Endler,et al.  The generalization of the effects of agreement and correctness on relative competence mediating conformity. , 1972 .

[10]  David J. Stang,et al.  Ineffective deception in conformity research: Some causes and consequences , 1976 .

[11]  S. Asch Opinions and Social Pressure , 1955, Nature.

[12]  R. Hertwig,et al.  The question remains: Is deception acceptable? , 1998 .

[13]  A. Gross,et al.  Twenty Years of Deception in Social Psychology , 1982 .

[14]  N. Kerr,et al.  Suspicion in the psychological laboratory: Kelman's prophecy revisited. , 1987 .

[15]  Stuart Landon,et al.  Quality Expectations, Reputation, and Price , 1998 .

[16]  E. Aronson Avoidance of Inter-Subject Communication , 1966, Psychological reports.

[17]  Z. Rubin,et al.  Assessment of subjects' suspicions. , 1971 .

[18]  S. Asch Studies of independence and conformity: I. A minority of one against a unanimous majority. , 1956 .

[19]  Brad J. Sagarin,et al.  Deceiver's Distrust: Denigration as a Consequence of Undiscovered Deception , 1998 .

[20]  N. Endler,et al.  Conformity as a function of task generalization and relative competence , 1973 .

[21]  Joachim Weimann,et al.  Individual behaviour in a free riding experiment , 1994 .

[22]  V. Smith,et al.  Social distance and other-regarding behavior in dictator games , 2000 .

[23]  Joan E Sieber,et al.  A census of subject pool characteristics and policies. , 1989, The American psychologist.

[24]  Stanley Milgram,et al.  Issues in the study of obedience: A reply to Baumrind. , 1964 .

[25]  N. Roese,et al.  Twenty Years of Deception Research: A Decline in Subjects' Trust? , 1992 .

[26]  Robert L. Frey,et al.  More on the “faithful” behavior of suspicious subjects , 1970 .

[27]  Control without deception , 2000 .

[28]  R. Menges,et al.  Openness and honesty versus coercion and deception in psychological research. , 1973, The American psychologist.

[29]  J. Koehler The base rate fallacy reconsidered: Descriptive, normative, and methodological challenges , 1996, Behavioral and Brain Sciences.

[30]  Ralph Hertwig,et al.  Money, lies, and replicability: On the need for empirically grounded experimental practices and interdisciplinary discourse , 2001, Behavioral and Brain Sciences.

[31]  L. Berkowitz,et al.  Some determinants of impulsive aggression: role of mediated associations with reinforcements for aggression. , 1974, Psychological review.

[32]  L. Christensen,et al.  Deception in Psychological Research , 1988 .

[33]  C. Starmer,et al.  Experimental economics and deception: A comment , 1998 .

[34]  E. Lichtenstein “Please Don't Talk to Anyone about This Experiment:” Disclosure of Deception by Debriefed Subjects , 1970 .

[35]  Leonard Berkowitz,et al.  WEAPONS AS AGGRESSION-ELICITING STIMULI. , 1967 .

[36]  V. Smith Microeconomic Systems as an Experimental Science , 1982 .

[37]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[38]  E. Oetting,et al.  The informed consent dilemma: an empirical approach. , 1979, The Journal of social psychology.

[39]  Arndt Bröder Deception can be acceptable. , 1998 .

[40]  M. Hagen,et al.  Ethical principles of psychologists and code of conduct. , 2002, The American psychologist.

[41]  Jean Tirole,et al.  A Theory of Collective Reputations (with applications to the persistence of corruption and to firm quality) , 1996 .

[42]  B. Straits,et al.  Influences on Subjects' Perceptions of Experimental Research Situations , 1972 .

[43]  R. Hertwig,et al.  Is deception acceptable , 1997 .

[44]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[45]  The Effects of Prebriefing Misinformed Research Participants on Their Attributions of Responsibility , 1986 .

[46]  L. Christensen The negative subject: Myth, reality, or a prior experimental experience effect? , 1977 .

[47]  C. Argyris,et al.  Some unintended consequences of rigorous research. , 1968, Psychological bulletin.

[48]  R. Vitelli,et al.  The Crisis issue Assessed: An Empirical Analysis , 1988 .

[49]  P. Wuebben Honesty of subjects and birth order. , 1967, Journal of personality and social psychology.

[50]  R. Hertwig,et al.  Economists' and psychologists' experimental practices : How they differ, why they differ, and how they could converge , 2003 .

[51]  Tina Mainieri,et al.  The rise and fall of deception in social psychology and personality research, 1921 to 1994. , 1997, Ethics & behavior.

[52]  Reply to Hey and Starmer & McDaniel , 1998 .

[53]  David L. Wiesenthal,et al.  Effects of deceiving and debriefing psychological subjects on performance in later experiments. , 1970 .

[54]  Z. Rubin Deceiving ourselves about deception: Comment on Smith and Richardson's "Amelioration of deception and harm in psychological research." , 1985 .

[55]  John M. Fitzgerald,et al.  Trust, Reciprocity, and Social History: A Re-examination , 2000 .

[56]  P. Suedfeld,et al.  The experimental contract: Subjects' expectations of and reactions to some behaviors of experimenters. , 1973 .

[57]  D. Baumrind Principles of ethical conduct in the treatment of subjects: Reaction to the draft report of the Committee on Ethical Standards in Psychological Research. , 1971 .

[58]  P. Gallo,et al.  Effects of Deceiving Subjects upon Experimental Results , 1973 .

[59]  Charles W. Turner,et al.  Evaluation apprehension, hypothesis awareness, and the weapons effect , 1976 .

[60]  张谷 实验经济学(Experimental Economics)研究思路及成果应用简述 , 1994 .

[61]  Allan J. Kimmel IN DEFENSE OF DECEPTION , 1998 .

[62]  Shane Bonetti,et al.  Experimental economics and deception , 1998 .

[63]  N. Endler,et al.  Relative competence, reinforcement and conformity , 1973 .

[64]  R. Hertwig,et al.  Experimental practices in economics: A methodological challenge for psychologists? , 2001, Behavioral and Brain Sciences.

[65]  D. Baumrind,et al.  Research using intentional deception. Ethical issues revisited. , 1985, The American psychologist.

[66]  Chuck Huff,et al.  Suspicion, Affective Response, and Educational Benefit as a Result of Deception in Psychology Research , 1998 .

[67]  David F. Allen Follow-up Analysis of Use of Forewarning and Deception in Psychological Experiments , 1983 .

[68]  Anne Locksley,et al.  Social stereotypes and judgments of individuals: An instance of the base-rate fallacy , 1982 .

[69]  C. Turner,et al.  Effects of subject sophistication and evaluation apprehension on aggressive responses to weapons. , 1974, Journal of personality and social psychology.

[70]  J. Ledyard Public Goods: A Survey of Experimental Research , 1994 .

[71]  Ralph L. Rosnow,et al.  Essentials of Behavioral Research: Methods and Data Analysis , 1984 .

[72]  S. Milgram BEHAVIORAL STUDY OF OBEDIENCE. , 1963, Journal of abnormal psychology.

[73]  J. Dickhaut,et al.  Trust Reciprocity and Interpersonal History: Fool Me Once Shame on You Fool Me Twice Shame on Me , 1998 .

[74]  R. Scheidt,et al.  The elusive weapons effect: demand awareness, evaluation apprehension, and slightly sophisticated subjects. , 1971, Journal of personality and social psychology.

[75]  M. Orne On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. , 1962 .

[76]  L. Berkowitz,et al.  The stimulating and inhibiting effects of weapons on Aggressive behavior , 1977 .

[77]  Andreas Ortmann,et al.  Gender differences in the laboratory: evidence from prisoner’s dilemma games , 1999 .

[78]  Joan E Sieber,et al.  Deception methods in psychology: have they changed in 23 years? , 1995, Ethics & behavior.

[79]  K. Higbee How Credible Are Psychological Researchers to College Students , 1978 .

[80]  E. Lichtenstein,et al.  Confession of awareness and prior knowledge of deception as a function of interview set and approval motivation. , 1970 .

[81]  Bobby J. Calder,et al.  Demand characteristics and three conceptions of the frequently deceived subject. , 1970 .

[82]  D. Baumrind Some thoughts on ethics of research: After reading Milgram's "Behavioral Study of Obedience." , 1964 .

[83]  V. Smith,et al.  Social Distance and Other-Regarding Behavior in Dictator Games: Reply , 1999 .

[84]  R. H. Willis,et al.  Role playing versus deception: An experimental comparison. , 1970 .

[85]  J. P. Lipton,et al.  Further evidence for subject pool contamination , 1978 .

[86]  R. F. Ettinger Effects of Agreement and Correctness on Relative Competence and Conformity. , 1971 .

[87]  X. Coulter Academic value of research participation by undergraduates. , 1986 .

[88]  A confederate's perspective on deception. , 1991, Ethics & behavior.

[89]  A. Ortmann,et al.  A SIMPLE PRINCIPAL‐AGENT EXPERIMENT FOR THE CLASSROOM , 1997 .

[90]  Marilyn Aitkenhead,et al.  What the subjects have to say. , 1985, The British journal of social psychology.

[91]  J. H. Korn THE REALITY OF DECEPTION , 1998 .

[92]  J. Shepperd,et al.  Probing Suspicion Among Participants in Deception Research , 1996 .

[93]  N. Endler,et al.  The effects of subject roles, demand characteristics, and suspicion on conformity. , 1973 .

[94]  T. Cook,et al.  The effects of suspiciousness of deception and the perceived legitimacy of deception on task performance in an attitude change experiment1 , 1971 .

[95]  Celia B. Fisher,et al.  Participant Partners: College Students Weigh the Costs and Benefits of Deceptive Research. , 1994 .

[96]  D. Toy,et al.  Effects of debriefing in marketing research involving “Mild” deceptions , 1989 .

[97]  D. Jackson,et al.  Evaluating deception in psychological research. , 1969 .

[98]  John G Adair,et al.  Ethical regulations and their impact on research practice. , 1985, The American psychologist.

[99]  N. Endler,et al.  Effects of prior group agreement and task correctness on relative competence mediating conformity , 1973 .

[100]  Probing Suspicion Among Participants in Deception Research , 1996 .

[101]  College Students' Reactions to Social Psychological Experiments Involving Deception. , 1979, The Journal of social psychology.

[102]  Richard J. Glinski,et al.  Nonnaivety Contamination in Conformity Experiments: Sources, Effects, and Implications for Control. , 1970 .

[103]  David M. Kreps,et al.  Game Theory and Economic Modelling , 1992 .

[104]  H. Kelman,et al.  Human use of human subjects: the problem of deception in social psychological experiments. , 1967, Psychological bulletin.

[105]  B. Newberry Truth telling in subjects with information about experiments: Who is being deceived? , 1973 .

[106]  John G. Adair,et al.  Demand characteristics or conformity?: Suspiciousness of deception and experimenter bias in conformity research. , 1972 .

[107]  R. Lindsay,et al.  Do ethically recommended research procedures influence the perceived ethicality of social psychological research? , 1990, Canadian journal of behavioural science. Revue canadienne des sciences du comportement.

[108]  E. Krupat,et al.  Subjects' expectations and the search for alternatives to deception in social psychology , 1994 .

[109]  B. Latané,et al.  Bystander intervention in emergencies: diffusion of responsibility. , 1968, Journal of personality and social psychology.

[110]  Timothy C. Brock,et al.  Debriefing and susceptibility to subsequent experimental manipulations. , 1966 .

[111]  John D. Hey,et al.  Experimental economics and deception: A comment , 1998 .

[112]  S. Fillenbaum,et al.  Prior deception and subsequent experimental performance: the "faithful" subject. , 1966, Journal of personality and social psychology.

[113]  G. Barnes,et al.  A reexamination of the faithful subject role , 1977 .

[114]  D P Schultz,et al.  The human subject in psychological research. , 1969, Psychological bulletin.

[115]  A. Chipman Conformity as a Differential Function of Social Pressure and Judgment Difficulty , 1966 .

[116]  D. Baumrind IRBs and social science research: the costs of deception. , 1979, IRB.