Design and Analysis of the Randomized Response Technique

About a half century ago, in 1965, Warner proposed the randomized response method as a survey technique to reduce potential bias due to nonresponse and social desirability when asking questions about sensitive behaviors and beliefs. This method asks respondents to use a randomization device, such as a coin flip, whose outcome is unobserved by the interviewer. By introducing random noise, the method conceals individual responses and protects respondent privacy. While numerous methodological advances have been made, we find surprisingly few applications of this promising survey technique. In this article, we address this gap by (1) reviewing standard designs available to applied researchers, (2) developing various multivariate regression techniques for substantive analyses, (3) proposing power analyses to help improve research designs, (4) presenting new robust designs that are based on less stringent assumptions than those of the standard designs, and (5) making all described methods available through open-source software. We illustrate some of these methods with an original survey about militant groups in Nigeria.

[1]  Arijit Chaudhuri,et al.  Using randomized response from a complex survey to estimate a sensitive proportion in a dichotomous finite population , 2001 .

[2]  Peter G. M. van der Heijden,et al.  How to Improve the Efficiency of Randomised Response Designs , 2005 .

[3]  Patrick D. Bourke,et al.  Estimating Proportions from Randomized Response Data Using the EM Algorithm , 1988 .

[4]  Walter T. Federer,et al.  Block Total Response as an Alternative to the Randomized Response Method in Surveys , 1979 .

[5]  Jean-Paul Fox,et al.  Reducing Social Desirability Bias through Item Randomized Response: An Application to Measure Underreported Desires , 2010 .

[6]  D. Horvitz,et al.  A Multi-Proportions Randomized Response Model , 1967 .

[7]  Paul E. Tracy,et al.  The Validity of Randomized Response for Sensitive Measurements , 1981 .

[8]  Ivar Krumpal,et al.  Estimating the prevalence of xenophobia and anti-Semitism in Germany: A comparison of randomized response and direct questioning. , 2012, Social science research.

[9]  A. Tamhane Randomized Response Techniques for Multiple Sensitive Attributes , 1981 .

[10]  Jon A. Krosnick,et al.  Measuring Voter Turnout By Using The Randomized Response Technique , 2010 .

[11]  Richard H. Shachtman,et al.  On the Relative Efficiency of Randomized Response Models , 1975 .

[12]  Robert L. Winkler,et al.  Warner's Randomized Response Model: A Bayesian Approach , 1979 .

[13]  Peter G M van der Heijden,et al.  Prevalence of use of performance enhancing drugs by fitness centre members. , 2013, Drug testing and analysis.

[14]  Ben Jann,et al.  Sensitive Questions in Online Surveys: An Experimental Evaluation of the Randomized Response Technique and the Crosswise Model , 2014 .

[15]  Paul E. Tracy,et al.  The Randomized Response Technique , 1986 .

[16]  Richard W. Yarnell,et al.  Identifying indicators of illegal behaviour: carnivore killing in human-managed landscapes , 2012, Proceedings of the Royal Society B: Biological Sciences.

[17]  W. R. Simmons,et al.  The Unrelated Question Randomized Response Model: Theoretical Framework , 1969 .

[18]  J. Hox,et al.  A Comparison of Randomized Response, Computer-Assisted Self-Interview, and Face-to-Face Direct Questioning , 2000 .

[19]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[20]  C. Mitchell Dayton,et al.  Covariate Randomized Response Models , 1988 .

[21]  S. Edgell,et al.  Validity of Forced Responses in a Randomized Response Model , 1982 .

[22]  Robert A. Peterson,et al.  A Critical Evaluation of the Randomized Response Method , 1991 .

[23]  Morten Moshagen,et al.  Correlation and Regression Analyses for Randomized Response Data , 2016 .

[24]  Antje Kirchner,et al.  Validating Sensitive Questions: A Comparison of Survey and Register Data , 2015 .

[25]  Damaraju Raghavarao,et al.  A test for detecting untruthful answering in randomized response procedures , 1992 .

[26]  D. Horvitz,et al.  Application of the Randomized Response Technique in Obtaining Quantitative Data , 1971 .

[27]  Daniel W. Gingerich,et al.  When to Protect? Using the Crosswise Model to Integrate Protected and Direct Responses in Surveys of Sensitive Behavior , 2014, Political Analysis.

[28]  Ben Jann,et al.  Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT) , 2011 .

[29]  David Mckie Sensitive Questions , 1987, The Lancet.

[30]  Henk Elffers,et al.  Explaining Regulatory Non-compliance: A Survey Study of Rule Transgression for Two Dutch Instrumental Laws, Applying the Randomized Response Method , 2003 .

[31]  Ulf Böckenholt,et al.  Log-Linear Randomized-Response Models Taking Self-Protective Response Behavior Into Account , 2007 .

[32]  Kenneth H. Pollock,et al.  A Comparison of Three Randomized Response Models for Quantitative Data , 1976 .

[33]  Gary King,et al.  Measuring Voter Turnout by Using the Randomized Response Technique: Evidence Calling into Question the Method's Validity , 2010 .

[34]  D. S. Fidler,et al.  Randomized response versus direct questioning: Two data-collection methods for sensitive information. , 1977 .

[35]  Arijit Chaudhuri,et al.  Randomized Response and Indirect Questioning Techniques in Surveys , 2010 .

[36]  P.G.M. Van der Heijden,et al.  Some logistic regression models for randomized response data , 1996 .

[37]  Gregory M. Hurtz,et al.  An Assessment of the Prevalence, Severity, and Verifiability of Entry-Level Applicant Faking Using the Randomized Response Technique , 2003 .

[38]  Anthony O'Hagan,et al.  Bayes Linear Estimators for Randomized Response Models , 1987 .

[39]  Ardo van den Hout,et al.  ACCOUNTING FOR NON‐COMPLIANCE IN THE ANALYSIS OF RANDOMIZED RESPONSE DATA , 2009 .

[40]  Charles W. Lamb,et al.  An Empirical Validation of the Randomized Response Technique , 1978 .

[41]  Ben Jann,et al.  Plagiarism in Student Papers: Prevalence Estimates Using Special Techniques for Sensitive Questions , 2011 .

[42]  Lakhbir S. Hayre,et al.  Scrambled randomized response methods for obtaining sensitive quantitative data , 1983 .

[43]  Dan R. Dalton,et al.  Base rate for employee theft: Convergence of multiple methods. , 1997 .

[44]  Robert A. Desharnais,et al.  Honest Answers to Embarrassing Questions: Detecting Cheating in the Randomized Response Model , 1998 .

[45]  N. Bradburn,et al.  An Investigation of Interview Method, Threat and Response Distortion , 1976 .

[46]  Samuel Himmelfarb,et al.  The Multi-Item Randomized Response Technique , 2008 .

[47]  L. Volicer,et al.  Randomized response technique for estimating alcohol use and noncompliance in hypertensives. , 1982, Journal of studies on alcohol.

[48]  Ben Jann,et al.  Asking Sensitive Questions Using the Crosswise Model An Experimental Survey Measuring Plagiarism , 2012 .

[49]  C. Ellertson,et al.  The Measure of Induced Abortion Levels in Mexico Using Random Response Technique , 2006 .

[50]  Tasos C. Christofides Randomized response technique for two sensitive characteristics at the same time , 2005 .

[51]  Ming Tan,et al.  Sample Surveys With Sensitive Questions: A Nonrandomized Response Approach , 2009 .

[52]  Michael D. Geurts,et al.  The Collection of Sensitive Information Using a Two-Stage, Randomized Response Model , 1975 .

[53]  Martin Korndörfer,et al.  Measuring and explaining tax evasion: Improving self-reports using the crosswise model , 2014 .

[54]  Julie. Barnett,et al.  Asking sensitive questions. , 1998 .

[55]  Felix Wolter,et al.  Validation Data Response Technique Versus Direct Questioning Using Individual Asking Sensitive Questions: An Evaluation of the Randomized , 2013 .

[56]  Bernard G. Greenberg,et al.  Estimates of induced abortion in urban North Carolina , 1970, Demography.

[57]  N. S. Mangat,et al.  An Improved Randomized Response Strategy , 1994 .

[58]  Ben Jann RRLOGIT: Stata module to estimate logistic regression for randomized response data , 2005 .

[59]  Paul E. Tracy,et al.  Randomized Response: A Method for Sensitive Surveys , 1986 .

[60]  Anthony Y. C. Kuk,et al.  Asking sensitive questions indirectly , 1990 .

[61]  Naurang Singh Mangat,et al.  An alternative randomized response procedure , 1990 .

[62]  J. J. A. Moors,et al.  Optimization of the Unrelated Question Randomized Response Model , 1971 .

[63]  Michael S. Goodstadt,et al.  The Randomized Response Technique: A Test on Drug Use , 1975 .

[64]  Milani Y. Chaloupka,et al.  Application of the randomized response technique to marine park management: an assessment of permit compliance , 1985 .

[65]  Paul E. Tracy,et al.  Measuring associations with randomized response , 1984 .

[66]  Anja Vogler,et al.  Randomized Response A Method For Sensitive Surveys , 2016 .

[67]  G. Tian,et al.  Two new models for survey sampling with sensitive characteristic: design and analysis , 2008 .

[68]  Peter G. M. van der Heijden,et al.  The logistic regression model with response variables subject to randomized response , 2007, Comput. Stat. Data Anal..

[69]  Daniel W. Gingerich Understanding Off-the-Books Politics: Conducting Inference on the Determinants of Sensitive Behavior with Randomized Response Surveys , 2010, Political Analysis.

[70]  S L Warner,et al.  Randomized response: a survey technique for eliminating evasive answer bias. , 1965, Journal of the American Statistical Association.

[71]  S. Tezcan,et al.  Prevalence and reporting of induced abortion in Turkey: two survey techniques. , 1981, Studies in family planning.

[72]  J. Abernathy,et al.  Purposive concealment of death in household surveys in Misamis Oriental Province. , 1976, Population studies.

[73]  Kosuke Imai,et al.  An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions , 2016 .

[74]  Peter G. M. van der Heijden,et al.  Meta-Analysis of Randomized Response Research , 2005 .

[75]  L. P. Chow,et al.  The Randomized Response Technique as Used in the Taiwan Outcome of Pregnancy Study , 1972 .

[76]  J. Strickler,et al.  Measuring Induced Abortion in Mexico , 2004 .

[77]  Felix Wolter,et al.  Asking Sensitive Questions , 2013 .

[78]  Kenneth F. Greene,et al.  Using the Predicted Responses from List Experiments as Explanatory Variables in Regression Models , 2015, Political Analysis.

[79]  Arijit Chaudhuri,et al.  Optional versus compulsory randomized response techniques in complex surveys , 2005 .