Sensitive Survey Questions with Auxiliary Information

Scholars increasingly rely on indirect questioning techniques to reduce social desirability bias and item nonresponse for sensitive survey questions. The major drawback of these approaches, however, is their inefficiency relative to direct questioning. We show how to improve the statistical analysis of the list experiment, randomized response technique, and endorsement experiment by exploiting auxiliary information on the sensitive trait. We apply the proposed methodology to survey experiments conducted among voters in a controversial antiabortion referendum held during the 2011 Mississippi General Election. By incorporating the official county-level election results, we obtain precinct- and individual-level estimates that are more accurate than standard indirect questioning estimates and occasionally even more efficient than direct questioning. Our simulation studies shed light on the conditions under which our approach can improve the efficiency and robustness of estimates based on indirect questioning techniques. Open-source software is available for implementing the proposed methodology.

[1]  Otis Dudley Duncan,et al.  An Alternative to Ecological Correlation , 1953 .

[2]  James H. Kuklinski,et al.  Racial Attitudes and the "New South" , 1997, The Journal of Politics.

[3]  Kosuke Imai,et al.  An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions , 2016 .

[4]  J. Hox,et al.  A Comparison of Randomized Response, Computer-Assisted Self-Interview, and Face-to-Face Direct Questioning , 2000 .

[5]  S L Warner,et al.  Randomized response: a survey technique for eliminating evasive answer bias. , 1965, Journal of the American Statistical Association.

[6]  Lawrence F. Katz,et al.  Neighborhood Effects on Crime for Female and Male Youth: Evidence from a Randomized Housing Voucher Experiment , 2004 .

[7]  Kosuke Imai,et al.  Multivariate Regression Analysis for the Item Count Technique , 2011 .

[8]  Jörg-Peter Schräpler,et al.  Respondent Behavior in Panel Studies , 2004 .

[9]  Jacob E. Cheadle,et al.  5. Improved Regression Estimation of a Multivariate Relationship with Population Data on the Bivariate Relationship , 2005 .

[10]  Adam J. Branscum,et al.  Informative g-Priors for Logistic Regression , 2014 .

[11]  J. Schupp,et al.  The German Socio-Economic Panel (SOEP) , 2018, Jahrbücher für Nationalökonomie und Statistik.

[12]  Kosuke Imai,et al.  Statistical Analysis of List Experiments , 2012, Political Analysis.

[13]  Ivar Krumpal,et al.  Estimating the prevalence of xenophobia and anti-Semitism in Germany: A comparison of randomized response and direct questioning. , 2012, Social science research.

[14]  Adrian E. Raftery,et al.  Inference from a Deterministic Population Dynamics Model for Bowhead Whales , 1995 .

[15]  Kosuke Imai,et al.  Improving Ecological Inference by Predicting Individual Ethnicity from Voter Registration Records , 2016, Political Analysis.

[16]  Forrest W. Crawford,et al.  Combining List Experiment and Direct Question Estimates of Sensitive Behavior Prevalence. , 2013, Journal of survey statistics and methodology.

[17]  A. Janus,et al.  The Influence of Social Desirability Pressures on Expressed Immigration Attitudes , 2010 .

[18]  K. Imai,et al.  Comparing and Combining List and Endorsement Experiments: Evidence from Afghanistan , 2014 .

[19]  N. Calonge,et al.  Validation of self-reported chronic conditions and health services in a managed care population. , 2000, American journal of preventive medicine.

[20]  Jacob N. Shapiro,et al.  Statistical Analysis of Endorsement Experiments: Measuring Support for Militant Groups in Pakistan , 2011, Political Analysis.

[21]  Charles F. Manski,et al.  Regressions, Short and Long , 2002 .

[22]  Kevin M. Quinn,et al.  Exit Polling and Racial Bloc Voting: Combining Individual-Level and R X C Ecological Data , 2010, 1101.0985.

[23]  Daniel W. Gingerich Understanding Off-the-Books Politics: Conducting Inference on the Determinants of Sensitive Behavior with Randomized Response Surveys , 2010, Political Analysis.

[24]  Kosuke Imai,et al.  Design and Analysis of the Randomized Response Technique , 2015 .

[25]  Ben Jann,et al.  Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT) , 2011 .

[26]  G. Imbens,et al.  Combining Micro and Macro Data in Microeconometric Models , 1994 .

[27]  David Brockington,et al.  Social Desirability and Response Validity: A Comparative Analysis of Overreporting Voter Turnout in Five Countries , 2005 .

[28]  Guido W. Imbens,et al.  Imposing Moment Restrictions from Auxiliary Data by Weighting , 1996, Review of Economics and Statistics.

[29]  Jörg-Peter Schräpler Respondent Behavior in Panel Studies: A Case Study of the German Socio-Economic Panel (GSOEP) , 2001 .

[30]  Ezequiel Gonzalez-Ocantos,et al.  Vote Buying and Social Desirability Bias: Experimental Evidence from Nicaragua , 2012 .

[31]  Gordon A. Wyner Response Errors in Self-Reported Number of Arrests , 1980 .

[32]  S. Richardson,et al.  Hierarchical related regression for combining aggregate and individual data in studies of socio‐economic disease risk factors , 2007 .

[33]  Kosuke Imai,et al.  Explaining Support for Combatants during Wartime: A Survey Experiment in Afghanistan , 2013, American Political Science Review.

[34]  L. Hansen Large Sample Properties of Generalized Method of Moments Estimators , 1982 .

[35]  Greg D. Adams,et al.  Abortion: Evidence of an Issue Evolution , 1997 .

[36]  L. Hansen,et al.  Finite Sample Properties of Some Alternative Gmm Estimators , 2015 .