Asking Sensitive Questions

This article is an empirical contribution to the evaluation of the randomized response technique (RRT), a prominent procedure to elicit more valid responses to sensitive questions in surveys. Based on individual validation data, we focus on two questions: First, does the RRT lead to higher prevalence estimates of sensitive behavior than direct questioning (DQ)? Second, are there differences in the effects of determinants of misreporting according to question mode? The data come from 552 face-to-face interviews with subjects who had been convicted by a court for minor criminal offences in a metropolitan area in Germany. For the first question, the answer is negative. For the second, it is positive, that is, effects of individual and situational determinants of misreporting differ between the two question modes. The effect of need for social approval, for example, tends to be stronger in RRT than in DQ mode. Interviewer experience turns out to be positively related to answer validity in DQ and negatively in RRT mode. Our findings support a skeptical position toward RRT, shed new light on long-standing debates within survey methodology, and stimulate theoretical reasoning about response behavior in surveys.

[1]  Sandra F. Beldt,et al.  The Takahasi-Sakasegawa Randomized Response Technique , 1982 .

[2]  Jean-Paul Fox,et al.  Reducing Social Desirability Bias through Item Randomized Response: An Application to Measure Underreported Desires , 2010 .

[3]  Michael D. Geurts,et al.  The Collection of Sensitive Information Using a Two-Stage, Randomized Response Model , 1975 .

[4]  J. Strickler,et al.  Measuring Induced Abortion in Mexico , 2004 .

[5]  Volker Stocké.  Entstehungsbedingungen von Antwortverzerrungen durch soziale Erwünschtheit , 2004 .

[6]  Gary King,et al.  Measuring Voter Turnout by Using the Randomized Response Technique: Evidence Calling into Question the Method's Validity , 2010 .

[7]  Peter G. M. van der Heijden,et al.  Meta-Analysis of Randomized Response Research , 2005 .

[8]  F. Al-Shamali,et al.  Author Biographies. , 2015, Journal of social work in disability & rehabilitation.

[9]  F. Kreuter,et al.  Social Desirability Bias in CATI, IVR, and Web Surveys The Effects of Mode and Question Sensitivity , 2008 .

[10]  Gerty J. L. M. Lensvelt-Mulders,et al.  Evaluating compliance with a computer assisted randomized response technique: a qualitative study into the origins of lying and cheating , 2007, Comput. Hum. Behav..

[11]  Ben Jann,et al.  Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT) , 2011 .

[12]  Ben Jann.  RRREG: Stata module to estimate linear probability model for randomized response data , 2011 .

[13]  H. Esser,et al.  Können Befragte lügen? Zum Konzept des "wahren Wertes" im Rahmen der handlungstheoretischen Erklärung von Situationseinflüssen bei der Befragung , 1986 .

[14]  Paul T. Costa,et al.  Social desirability scales: More substance than style. , 1983 .

[15]  Paul E. Tracy,et al.  The Validity of Randomized Response for Sensitive Measurements , 1981 .

[16]  Delroy L. Paulhus,et al.  Enhancement and Denial in Socially Desirable Responding , 1991 .

[17]  D. Marlowe,et al.  A new scale of social desirability independent of psychopathology. , 1960, Journal of consulting psychology.

[18]  Jon A. Krosnick,et al.  Measuring Voter Turnout By Using The Randomized Response Technique , 2010 .

[19]  R. Tourangeau,et al.  Sensitive questions in surveys. , 2007, Psychological bulletin.

[20]  Seymour Sudman,et al.  Improving Interview Method and Questionnaire Design. , 1982 .

[21]  D. Phillips,et al.  Some Effects of "Social Desirability" in Survey Studies , 1972, American Journal of Sociology.

[22]  P. Abramson,et al.  The Presence of Others and Overreporting of Voting in American National Elections , 1986 .

[23]  J. J. A. Moors,et al.  Optimization of the Unrelated Question Randomized Response Model , 1971 .

[24]  P. T. Liu,et al.  A new discrete quantitative randomized response model , 1976, SIML.

[25]  H. Hyman.  DO THEY TELL THE TRUTH , 1944 .

[26]  Bernard Wong-On-Wing,et al.  A comparative examination of auditor premature sign-offs using the direct and the randomized response methods , 1997 .

[27]  N. Bradburn,et al.  An Investigation of Interview Method, Threat and Response Distortion , 1976 .

[28]  Charles W. Lamb,et al.  An Empirical Validation of the Randomized Response Technique , 1978 .

[29]  Shawn A. Ross,et al.  Survey Methodology , 2005, The SAGE Encyclopedia of the Sociology of Religion.

[30]  W. R. Simmons,et al.  The Unrelated Question Randomized Response Model: Theoretical Framework , 1969 .

[31]  Ben Jann.  RRLOGIT: Stata module to estimate logistic regression for randomized response data , 2005 .

[32]  Sven Stadtmüller.  Rücklauf gut, alles gut? Zu erwünschten Effekten monetärer Anreize bei postalischen Befragungen , 2009 .

[33]  E. Jones,et al.  Underreporting of abortion in surveys of U.S. women: 1976 to 1988 , 1992, Demography.

[34]  G. Maddala.  Limited-dependent and qualitative variables in econometrics: Introduction , 1983 .

[35]  Volker Stocké.  The interdependence of determinants for the strength and direction of social desirability in racial attitude surveys , 2004 .

[36]  S. Edgell,et al.  Validity of Forced Responses in a Randomized Response Model , 1982 .

[37]  S. G. Blank.  Using the Randomized Response Technique to Investigate Illegal Fishing and Contribute to Abalone Management in Northern California , 2008 .

[38]  Rainer Schnell,et al.  Separating interviewer and sampling-point effects , 2003 .

[39]  J. Meyerhoff,et al.  To Pay or Not to Pay: Competing Theories to Explain Individuals’ Willingness to Pay for Public Environmental Goods , 2011 .

[40]  S. Tezcan,et al.  Prevalence and reporting of induced abortion in Turkey: two survey techniques. , 1981, Studies in family planning.

[41]  Peter G. M. van der Heijden,et al.  How to Improve the Efficiency of Randomised Response Designs , 2005 .

[42]  R. Montjoy,et al.  Overreporting voting: why it happens and why it matters. , 2001, Public opinion quarterly.

[43]  Robert A. Peterson,et al.  A Critical Evaluation of the Randomized Response Method , 1991 .

[44]  K. Rasinski,et al.  Methods of data collection, perceptions of risks and losses, and motivation to give truthful answers to sensitive survey questions , 1999 .

[45]  Johannes A. Landsheer,et al.  Trust and Understanding, Two Psychological Aspects of Randomized Response , 1999 .

[46]  Dan R. Dalton,et al.  Base rate for employee theft: Convergence of multiple methods. , 1997 .

[47]  Jochen Musch,et al.  A randomized‐response investigation of the education effect in attitudes towards foreigners , 2009 .

[48]  Volker Stocké.  Entstehungsbedingungen von Antwortverzerrungen durch soziale Erwünschtheit. Ein Vergleich der Prognosen der Rational-Choice Theorie und des Modells der Frame-Selektion , 2003 .

[49]  T. Johnson,et al.  An evaluation of the validity of the Crowne–Marlowe need for approval scale , 2012 .

[50]  Fred Luthans,et al.  Social Desirability Response Effects: Three Alternative Models , 1983 .

[51]  Joop J. Hox,et al.  The influence of interviewers' attitude and behaviour on household survey nonresponse: an international comparison , 2002 .

[52]  M. King,et al.  Social desirability bias: A neglected aspect of validity testing , 2000 .

[53]  W. Aquilino,et al.  Response Effects Due to Bystander Presence in CASI and Paper-and-Pencil Surveys of Drug Use and Alcohol Use , 2000, Substance use & misuse.

[54]  R. H. Moorman,et al.  A meta‐analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behaviour research , 1992 .

[55]  Anthony Y. C. Kuk,et al.  Asking sensitive questions indirectly , 1990 .

[56]  Leugnen oder gestehen? Bestimmungsfaktoren wahrer Antworten in Befragungen / To Deny or to Confess? Determinants of Truthful Answers in Surveys , 2012 .

[57]  D. Horvitz,et al.  Application of the Randomized Response Technique in Obtaining Quantitative Data , 1971 .

[58]  Bernard G. Greenberg,et al.  The Two Alternate Questions Randomized Response Model for Human Surveys , 1973 .

[59]  Andreas Diekmann,et al.  Anreizformen und Ausschöpfungsquoten bei postalischen Befragungen. Eine Prüfung der Reziprozitätshypothese , 2001 .

[60]  P. Schmidt,et al.  Limited-Dependent and Qualitative Variables in Econometrics. , 1984 .

[61]  I. Holme,et al.  Randomized response estimates for the purchase of smuggled liquor in Norway. , 1994, Addiction.

[62]  J. Hox,et al.  A Comparison of Randomized Response, Computer-Assisted Self-Interview, and Face-to-Face Direct Questioning , 2000 .

[63]  P T Liu,et al.  The efficiency of the multiple trial randomized response technique. , 1976, Biometrics.

[64]  S L Warner,et al.  Randomized response: a survey technique for eliminating evasive answer bias. , 1965, Journal of the American Statistical Association.