Meta-Analysis of Randomized Response Research

This article discusses two meta-analyses on randomized response technique (RRT) studies, the first on 6 individual validation studies and the second on 32 comparative studies. The meta-analyses focus on the performance of RRTs compared to conventional question-and-answer methods. The authors use the percentage of incorrect answers as effect size for the individual validation studies and the standardized difference score (d-probit) as effect size for the comparative studies. Results indicate that compared to other methods, randomized response designs result in more valid data. For the individual validation studies, the mean percentage of incorrect answers for the RRT condition is .38; for the other conditions, it is .49. The more sensitive the topic under investigation, the higher the validity of RRT results. However, both meta-analyses have unexplained residual variances across studies, which indicates that RRTs are not completely under the control of the researcher.

[1]  Peter G. M. van der Heijden,et al.  How to Improve the Efficiency of Randomised Response Designs , 2005 .

[2]  J. Gill.  Hierarchical Linear Models , 2005 .

[3]  Hennie Boeije,et al.  Honest by Chance: a Qualitative Interview Study to Clarify Respondents' (Non-)Compliance With Computer-Assisted Randomized Response , 2002 .

[4]  R. Turner,et al.  Multilevel models for meta-analysis , 2001 .

[5]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[6]  J. Hox,et al.  A Comparison of Randomized Response, Computer-Assisted Self-Interview, and Face-to-Face Direct Questioning , 2000 .

[7]  W. Aquilino,et al.  Collecting Sensitive Self-Report Data With Laptop Computers: Impact on the Response Tendencies of Adolescents in a Home Interview , 1999 .

[8]  K. Rasinski,et al.  Methods of data collection, perceptions of risks and losses, and motivation to give truthful answers to sensitive survey questions , 1999 .

[9]  Fritz Drasgow,et al.  A Meta-Analytic Study of Social Desirability Distortion in Computer- Administered Questionnaires, Traditional Questionnaires, and Interviews , 1999 .

[10]  Johannes A. Landsheer,et al.  Trust and Understanding, Two Psychological Aspects of Randomized Response , 1999 .

[11]  Joop J. Hox,et al.  A comparison of randomized response, CASAO, and direct questioning; eliciting sensitive information in the context of social security fraud , 1998 .

[12]  Dan R. Dalton,et al.  Base rate for employee theft: Convergence of multiple methods. , 1997 .

[13]  Roger Tourangeau,et al.  Effects of Interview Mode on Sensitive Questions in a Fertility Survey , 1997 .

[14]  J T Lessler,et al.  Mode of interview and reporting of sensitive issues: design and implementation of audio computer-assisted self-interviewing. , 1997, NIDA research monograph.

[15]  S. Raudenbush,et al.  A multivariate mixed linear model for meta-analysis. , 1996 .

[16]  Suzanne P. Weisband,et al.  Self disclosure on computer forms: meta-analysis and implications , 1996, CHI.

[17]  P.G.M. Van der Heijden,et al.  Some logistic regression models for randomized response data , 1996 .

[18]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[19]  Ger Snijkers,et al.  The Effect of Computer-assisted Interviewing on Data Quality. A Review , 1995 .

[20]  Dan R. Dalton,et al.  USING THE UNMATCHED COUNT TECHNIQUE (UCT) TO ESTIMATE BASE RATES FOR SENSITIVE BEHAVIOR , 1994 .

[21]  H. Suen,et al.  A Methodological Comparison of Survey Techniques in Obtaining Self-Reports of Condom-Related Behaviors , 1994, Psychological reports.

[22]  R. Hanka.  The Handbook of Research Synthesis , 1994 .

[23]  I. Holme,et al.  Randomized response estimates for the purchase of smuggled liquor in Norway. , 1994, Addiction.

[24]  Joe Kerkvliet,et al.  Cheating by Economics Students: A Comparison of Survey Results. , 1994 .

[25]  R. Rosenthal.  Parametric measures of effect size. , 1994 .

[26]  S. Edgell,et al.  An empirical test of the unrelated question randomized response technique , 1992 .

[27]  M. Fisher,et al.  Substance use in a school-based clinic population: use of the randomized response technique to estimate prevalence. , 1992, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[28]  C. Renzetti.  Doing Research on Sensitive Topics , 1992 .

[29]  Jamshid C. Hosseini,et al.  An Empirical Comparison of Direct Questioning, Scenario, and Randomized Response Methods for Obtaining Sensitive Business Information* , 1991 .

[30]  Robert A. Peterson,et al.  A Critical Evaluation of the Randomized Response Method , 1991 .

[31]  Anthony Y. C. Kuk,et al.  Asking sensitive questions indirectly , 1990 .

[32]  C. Mitchell Dayton,et al.  Covariate Randomized Response Models , 1988 .

[33]  R. Tourangeau,et al.  Cognitive Processes Underlying Context Effects in Attitude Measurement , 1988 .

[34]  J. Duffy,et al.  RANDOMISED RESPONSE VS. DIRECT QUESTIONING: ESTIMATING THE PREVALENCE OF ALCOHOL RELATED PROBLEMS IN A FIELD SURVEY , 1988 .

[35]  A. Chaudhuri,et al.  Randomized Response: Theory and Techniques , 1987 .

[36]  C. Mitchell Dayton,et al.  Improved estimation of academic cheating behavior using the randomized response technique , 1987 .

[37]  R. Steer,et al.  Estimating illicit drug use through telephone interviews and the randomized response technique. , 1986, Drug and alcohol dependence.

[38]  K. Soeken,et al.  Randomized Response Technique: Applications to Research on Rape , 1986 .

[39]  Donald E. Stem,et al.  Telephone Interview and Mail Questionnaire Applications of the Randomized Response Model , 1984 .

[40]  P. Schmidt,et al.  Limited-Dependent and Qualitative Variables in Econometrics. , 1984 .

[41]  B. Volicer,et al.  Randomized response estimates of problem use of alcohol among employed females. , 1983, Alcoholism, clinical and experimental research.

[42]  Samuel Himmelfarb,et al.  Social desirability and the randomized response technique. , 1982 .

[43]  S. Edgell,et al.  Validity of Forced Responses in a Randomized Response Model , 1982 .

[44]  Sandra F. Beldt,et al.  The Takahasi-Sakasegawa Randomized Response Technique , 1982 .

[45]  L. Volicer,et al.  Randomized response technique for estimating alcohol use and noncompliance in hypertensives. , 1982, Journal of studies on alcohol.

[46]  R. Shotland,et al.  The Random Response Method , 1982 .

[47]  Thomas A. Buchman,et al.  Obtaining Responses To Sensitive Questions - Conventional Questionnaire Versus Randomized-Response Technique , 1982 .

[48]  K. Brewer.  Estimating Marihuana Usage Using Randomized Response—Some Paradoxical Findings , 1981 .

[49]  S. Tezcan,et al.  Prevalence and reporting of induced abortion in Turkey: two survey techniques. , 1981, Studies in family planning.

[50]  Paul E. Tracy,et al.  The Validity of Randomized Response for Sensitive Measurements , 1981 .

[51]  G. Barrie Wetherill,et al.  Random Effects Models , 1981 .

[52]  M. Boivin,et al.  Comparison of Data Gathered on Sensitive Questions via Direct Questionnaire, Randomized Response Technique, and a Projective Method , 1980 .

[53]  Isabelle N. Rhodes,et al.  The Validity of the Randomized Response Technique , 1979 .

[54]  M. Boivin,et al.  Sensitive Data Collection Through the Random Response Technique: Some Improvements , 1979 .

[55]  Charles W. Lamb,et al.  An Empirical Validation of the Randomized Response Technique , 1978 .

[56]  D. S. Fidler,et al.  Randomized response versus direct questioning: Two data-collection methods for sensitive information. , 1977 .

[57]  Isabelle N. Rhodes,et al.  Making the Randomized Response Technique Work , 1976 .

[58]  N. Bradburn,et al.  An Investigation of Interview Method, Threat and Response Distortion , 1976 .

[59]  H. Sandler,et al.  Evaluation of the randomized response technique in a drinking survey. , 1976, Journal of studies on alcohol.

[60]  Michael S. Goodstadt,et al.  The Randomized Response Technique: A Test on Drug Use , 1975 .

[61]  L. P. Chow,et al.  The Randomized Response Technique as Used in the Taiwan Outcome of Pregnancy Study , 1972 .

[62]  W. R. Simmons,et al.  The Unrelated Question Randomized Response Model: Theoretical Framework , 1969 .

[63]  S L Warner,et al.  Randomized response: a survey technique for eliminating evasive answer bias. , 1965, Journal of the American Statistical Association.

[64]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[65]  H. V. Aune.  The public health conference on records and statistics. , 1951, Canadian journal of public health = Revue canadienne de sante publique.