Incentivizing Responses to Self-report Questions in Perceptual Deterrence Studies: An Investigation of the Validity of Deterrence Theory Using Bayesian Truth Serum

AbstractObjective Criminological researchers want people to reveal considerable private information when utilizing self-report surveys, such as involvement in crime, subjective attitudes and expectations, and probability judgments. Some of this private information is easily accessible for subjects and all that is required is for individuals to be honest, while other information requires mental effort and cognitive reflection. Though researchers generally provide little or no incentive to be honest and thoughtful, it is generally assumed that subjects do provide honest and accurate information. We assess the accuracy of deterrence measures by employing a scoring rule known as the Bayesian truth serum (BTS)—that incentivizes honesty and thoughtfulness among respondents.MethodIndividuals are asked to report on self-report offending and estimates of risk after being assigned to one of two conditions: (1) a group where there is a financial incentive just for participation, and (2) a BTS financial incentive group where individuals are incentivized to be honest and thoughtful.ResultsWe find evidence that there are some important differences in the responses to self-reporting offending items and estimates of the probability of getting arrested between the groups. Individuals in the BTS condition report a greater willingness to offend and lower estimates of perceived risk for drinking and driving and cheating on exams. Moreover, we find that the negative correlation between perceived risk and willingness to offend that is often observed in scenario-based deterrence research does not emerge in conditions where respondents are incentivized to be accurate and thoughtful in their survey responses.ConclusionThe results raise some questions about the accuracy of survey responses in perceptual deterrence studies, and challenge the statistical relationship between perceived risk and offending behavior. We suggest further exploration within criminology of both BTS and other scoring rules and greater scrutiny of the validity of criminological data.

[1]  W. Gove,et al.  Deterrence: Some Theoretical Considerations , 1975 .

[2]  A. Coleman.  Picture imperfect , 1999 .

[3]  Lance Lochner,et al.  Individual Perceptions of the Criminal Justice System , 2003 .

[4]  G. Keren.  Calibration and probability judgements: Conceptual and methodological issues , 1991 .

[5]  Greg Pogarsky,et al.  PROJECTED OFFENDING AND CONTEMPORANEOUS RULE‐VIOLATION: IMPLICATIONS FOR HETEROTYPIC CONTINUITY* , 2004 .

[6]  S. Tibbetts,et al.  Shame and Rational Choice in Offending Decisions , 1997 .

[7]  Nils-Eric Sahlin,et al.  Decision making with unreliable probabilities , 1983 .

[8]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[9]  C. Manski.  The Use of Intentions Data to Predict Behavior: A Best-Case Analysis , 1990 .

[10]  Kyle J. Thomas,et al.  The Causal Impact of Exposure to Deviant Peers , 2013 .

[11]  J. Gibbs,et al.  Objective and Perceptual Properties of Legal Punishment and The Deterrence Doctrine , 1978 .

[12]  F. Kreuter,et al.  Social Desirability Bias in CATI, IVR, and Web Surveys The Effects of Mode and Question Sensitivity , 2008 .

[13]  R. Matsueda,et al.  Deterring Delinquents: A Rational Choice Model of Theft and Violence , 2006 .

[14]  Jeffrey A. Bouffard,et al.  Testing Theories of Criminal Decision Making: Some Empirical Questions about Hypothetical Scenarios , 2010 .

[15]  A. Schotter,et al.  An Experimental Study of Belief Learning Using Elicited Beliefs , 2002 .

[16]  J. Gibbs.  Crime, punishment, and deterrence , 1975 .

[17]  Linda Klebe Trevino,et al.  What We Know About Cheating In College Longitudinal Trends and Recent Developments , 1996 .

[18]  M. Tonry.  The Oxford handbook of crime and criminal justice , 2011 .

[19]  J. Krosnick.  Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[20]  B. Duffy,et al.  Closing the gaps – crime and public perceptions , 2008 .

[21]  Brent Davis,et al.  Mis)perceptions of crime in Australia , 2010 .

[22]  Marc Gertz,et al.  THE MISSING LINK IN GENERAL DETERRENCE RESEARCH , 2005 .

[23]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[24]  C. Manski,et al.  "Will Social Security Be There for You?": How Americans Perceive Their Benefits , 2003 .

[25]  Francesca Molinari,et al.  Rounding Probabilistic Expectations in Surveys , 2010, Journal of business & economic statistics : a publication of the American Statistical Association.

[26]  Ying Wang,et al.  Predicting new product adoption using Bayesian truth serum , 2010 .

[27]  Martin Gold,et al.  Delinquent behavior in an American city , 1971 .

[28]  R. Zeckhauser,et al.  Efficiency Despite Mutually Payoff-Relevant Private Information: The Finite Case , 1990 .

[29]  G. Loewenstein,et al.  Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling , 2012, Psychological science.

[30]  L. Lillard,et al.  Cognition and Wealth: The Importance of Probabilistic Thinking , 2001 .

[31]  Melanie C. Green,et al.  Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Response Bias , 2003 .

[32]  Daniel S. Nagin,et al.  INTEGRATING CELERITY, IMPULSIVITY, AND EXTRALEGAL SANCTION THREATS INTO A MODEL OF GENERAL DETERRENCE: THEORY AND EVIDENCE* , 2001 .

[33]  Thomas A. Loughran,et al.  TESTING A BAYESIAN LEARNING THEORY OF DETERRENCE AMONG SERIOUS JUVENILE OFFENDERS , 2011 .

[34]  C. Manski,et al.  Using Expectations Data to Study Subjective Income Expectations , 1994 .

[35]  R. Tourangeau,et al.  Sensitive questions in surveys. , 2007, Psychological bulletin.

[36]  Ab McClelland,et al.  The calibration of subjective probabilities: Theories and models 1980-1993 , 1994 .

[37]  Baruch Fischhoff,et al.  What Number is “Fifty‐Fifty”?: Redistributing Excessive 50% Responses in Elicited Probabilities , 2002, Risk analysis : an official publication of the Society for Risk Analysis.

[38]  K. Williams,et al.  Perceptual research on general deterrence: A critical review. , 1986 .

[39]  Fischhoff,et al.  Verbal and Numerical Expressions of Probability: "It's a Fifty-Fifty Chance" , 2000, Organizational behavior and human decision processes.

[40]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[41]  J. Sonnemans,et al.  A Truth Serum for Non-Bayesians: Correcting Proper Scoring Rules for Risk Attitudes* , 2009 .

[42]  Ted Chiricos,et al.  Punishment and Crime: An Examination of Some Empirical Evidence , 1970 .

[43]  G. Bodenhausen,et al.  Cuing Consumerism , 2012, Psychology Science.

[44]  Michael G. Turner,et al.  Self-Reported Intentions to Offend: All Talk and No Action? , 2012 .

[45]  Alex R. Piquero,et al.  ON AMBIGUITY IN PERCEPTIONS OF RISK:IMPLICATIONS FOR CRIMINAL DECISION MAKING AND DETERRENCE* , 2011 .

[46]  R. Fisher,et al.  Social-Desirability Bias and the Validity of Self-Reported Values , 2000 .

[47]  Gary D. Kleck,et al.  Deterrence and Macro-Level Perceptions of Punishment Risks , 2013 .

[48]  Baruch Fischhoff,et al.  Fifty–fifty = 50%? , 1999 .

[49]  Harold G. Grasmick,et al.  Conscience, significant others, and rational choice: Extending the deterrence model. , 1990 .

[50]  Drazen Prelec,et al.  Creating Truth-Telling Incentives with the Bayesian Truth Serum , 2013 .

[51]  David P. Farrington,et al.  The Delinquent Way Of Life , 1977 .

[52]  Thomas A. Loughran,et al.  Re-Examining the Functional Form of the Certainty Effect in Deterrence Theory , 2012 .

[53]  B. Fischhoff,et al.  Hypothesis Evaluation from a Bayesian Perspective. , 1983 .

[54]  Delbert S. Elliott,et al.  Reassessing the reliability and validity of self-report delinquency measures , 1986, Journal of Quantitative Criminology.

[55]  Robert J. Willis,et al.  Estimating Second Order Probability Beliefs from Subjective Survival Data , 2012, Decision Analytics.

[56]  Charles R. Tittle,et al.  Sanctions and social deviance: The question of deterrence , 1980 .

[57]  Thomas A. Loughran,et al.  “A Good Man Always Knows His Limitations” , 2013 .

[58]  D. Prelec.  A Bayesian Truth Serum for Subjective Data , 2004, Science.

[59]  Greg Pogarsky,et al.  Identifying “deterrable” offenders: Implications for research on deterrence , 2002 .

[60]  Gary F. Jensen,et al.  “Crime Doesn't Pay”: Correlates of a Shared Misunderstanding , 1969 .

[61]  H. Simon,et al.  Models of Man. , 1957 .

[62]  Alex R. Piquero,et al.  Handbook of Quantitative Criminology , 2010 .

[63]  Daniel S. Nagin,et al.  Criminal Deterrence Research at the Outset of the Twenty-First Century , 1998, Crime and Justice.

[64]  Harold Sigall,et al.  The bogus pipeline: A new paradigm for measuring affect and attitude. , 1971 .

[65]  G. Brier.  VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[66]  Ted Chiricos,et al.  Perceived risk and social control: Do sanctions really deter? , 1983 .

[67]  Min Sok Lee,et al.  A penny for your thoughts: Inducing truth-telling in stated preference elicitation , 2010 .

[68]  Teddy Seidenfeld,et al.  Calibration, Coherence, and Scoring Rules , 1985, Philosophy of Science.

[69]  Scott H. Decker,et al.  Armed Robbers in Action: Stickups and Street Culture , 1997 .

[70]  I. Ajzen,et al.  Understanding Attitudes and Predicting Social Behavior , 1980 .

[71]  R. Bachman,et al.  The Rationality of Sexual Offending: Testing a Deterrence/Rational Choice Conception of Sexual Assault , 1992 .

[72]  L. J. Savage.  Elicitation of Personal Probabilities and Expectations , 1971 .

[73]  D. Baumrind,et al.  Research using intentional deception. Ethical issues revisited. , 1985, The American psychologist.

[74]  I. Erev,et al.  Simultaneous Over- and Underconfidence: The Role of Error in Judgment Processes. , 1994 .

[75]  M. El-Gamal,et al.  Are People Bayesian? Uncovering Behavioral Strategies , 1995 .

[76]  Jack P. Gibbs,et al.  Perceived Risk of Punishment and Self-Reported Delinquency , 1978 .