A stochastic lie detector

Surveys on sensitive issues provide distorted prevalence estimates when participants fail to respond truthfully. The randomized-response technique (RRT) encourages more honest responding by adding random noise to responses, thereby removing any direct link between a participant’s response and his or her true status with regard to a sensitive attribute. However, in spite of the increased confidentiality, some respondents still refuse to disclose sensitive attitudes or behaviors. To remedy this problem, we propose an extension of Mangat’s (Journal of the Royal Statistical Society: Series B, 56, 93–95, 1994) variant of the RRT that allows for determining whether participants respond truthfully. This method offers the genuine advantage of providing undistorted prevalence estimates for sensitive attributes even if respondents fail to respond truthfully. We show how to implement the method using both closed-form equations and easily accessible free software for multinomial processing tree models. Moreover, we report the results of two survey experiments that provide evidence for the validity of our extension of Mangat’s RRT approach.

[1]  Timothy R. C. Read,et al.  Goodness-Of-Fit Statistics for Discrete Multivariate Data , 1988 .

[2]  David Brockington,et al.  Social Desirability and Response Validity: A Comparative Analysis of Overreporting Voter Turnout in Five Countries , 2005 .

[3]  R. Tourangeau,et al.  Sensitive questions in surveys. , 2007, Psychological bulletin.

[4]  Estimation of proportions using symmetric randomized response designs , 1984 .

[5]  B. Hilbig,et al.  Multinomial processing tree models: A review of the literature. , 2009 .

[6]  Morten Moshagen,et al.  multiTree: A computer program for the analysis of multinomial processing tree models , 2010, Behavior research methods.

[7]  Lars Ljungqvist,et al.  A Unified Approach to Measures of Privacy in Randomized Response Models: A Utilitarian Perspective , 1993 .

[8]  Gary King,et al.  Measuring Voter Turnout by Using the Randomized Response Technique: Evidence Calling into Question the Method's Validity , 2010 .

[9]  W. Batchelder,et al.  The statistical analysis of general processing tree models with the EM algorithm , 1994 .

[10]  Gerty J. L. M. Lensvelt-Mulders,et al.  Evaluating compliance with a computer assisted randomized response technique: a qualitative study into the origins of lying and cheating , 2007, Comput. Hum. Behav..

[11]  P. V. D. van der Heijden,et al.  The analysis of randomized response sum score variables , 2007 .

[12]  Anthony Y. C. Kuk,et al.  Asking sensitive questions indirectly , 1990 .

[13]  Peter G. M. van der Heijden,et al.  Meta-Analysis of Randomized Response Research , 2005 .

[14]  Peter G. M. van der Heijden,et al.  How to Improve the Efficiency of Randomised Response Designs , 2005 .

[15]  G. Macready,et al.  Randomized Response Parameters as Factors in Frequency Estimates , 1985 .

[16]  N. Bradburn,et al.  An Investigation of Interview Method, Threat and Response Distortion , 1976 .

[17]  J. J. A. Moors,et al.  Optimization of the Unrelated Question Randomized Response Model , 1971 .

[18]  Jochen Musch,et al.  Defection in the dark? A randomized-response investigation of cooperativeness in social dilemma games , 2011 .

[19]  N. S. Mangat,et al.  An Improved Randomized Response Strategy , 1994 .

[20]  David M. Riefer,et al.  Theoretical and empirical review of multinomial process tree modeling , 1999, Psychonomic bulletin & review.

[21]  M. W. Birch.  A New Proof of the Pearson-Fisher Theorem , 1964 .

[22]  R. Montjoy,et al.  Overreporting voting: why it happens and why it matters. , 2001, Public opinion quarterly.

[23]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[24]  Ulf Böckenholt,et al.  Do randomized-response designs eliminate response biases? An empirical study of non-compliance behavior , 2009 .

[25]  S. Edgell,et al.  An empirical test of the unrelated question randomized response technique , 1992 .

[26]  Robert A. Desharnais,et al.  Honest Answers to Embarrassing Questions: Detecting Cheating in the Randomized Response Model , 1998 .

[27]  Jochen Musch,et al.  Improving self-report measures of medication non-adherence using a cheating detection extension of the randomised-response-technique , 2011, Statistical methods in medical research.

[28]  Ulf Böckenholt,et al.  Estimating the prevalence of sensitive behaviour and cheating with a dual design for direct questioning and randomized response , 2010, Journal of the Royal Statistical Society. Series C, Applied statistics.

[29]  S L Warner,et al.  Randomized response: a survey technique for eliminating evasive answer bias. , 1965, Journal of the American Statistical Association.

[30]  J. Felsenstein.  Probability models and statistical methods in genetics , 1972 .

[31]  X Hu,et al.  GPT.EXE: A powerful tool for the visualization and analysis of general processing tree models , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[32]  Jochen Musch,et al.  Assessing Sensitive Attributes Using the Randomized Response Technique: Evidence for the Importance of Response Symmetry , 2009 .

[33]  Jochen Musch,et al.  Surveying Multiple Sensitive Attributes using an Extension of the Randomized-Response Technique , 2012 .

[34]  Jochen Musch,et al.  A randomized‐response investigation of the education effect in attitudes towards foreigners , 2009 .

[35]  Ulf Böckenholt,et al.  Item Randomized-Response Models for Measuring Noncompliance: Risk-Return Perceptions, Social Influences, and Self-Protective Responses , 2007 .

[36]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[37]  Kar Yan Tam,et al.  Research Note - Applying the Randomized Response Technique to Elicit Truthful Responses to Sensitive Questions in IS Research: The Case of Software Piracy Behavior , 2010, Inf. Syst. Res..

[38]  P. McCrystal,et al.  Response consistency in young adolescents' drug use self-reports: a recanting rate analysis. , 2005, Addiction.

[39]  W. R. Simmons,et al.  The Unrelated Question Randomized Response Model: Theoretical Framework , 1969 .

[40]  Christoph Stahl,et al.  HMMTree: A computer program for latent-class hierarchical multinomial processing tree models , 2007, Behavior research methods.

[41]  Morten Moshagen,et al.  Reducing Socially Desirable Responses in Epidemiologic Surveys: An Extension of the Randomized-response Technique , 2010, Epidemiology.

[42]  George B. Macready,et al.  Respondents' perceived protection when using randomized response. , 1982 .

[43]  A. Campbell.  Randomized response technique. , 1987, Science.