Wording Effects in Survey Research: Using Meta-Analysis to Explain the Forbid/Allow Asymmetry

Answers to standardised attitude questions not only depend on the attitude respondents have on the issue, but are also influenced by the wording of the question. A well known example of this phenomenon is the forbid/allow asymmetry. Although the verbs ‘forbid’ and ‘allow’ are supposed to be each others’ counterparts, the answers to questions worded with the verb ‘forbid’ turn out not to be opposite to answers to equivalent ‘allow’-questions: respondents turn out to be more likely to respond ‘no’ rather than ‘yes’ to ‘forbid’ questions. It is commonly assumed that this is caused by the extreme connotations of both verbs. In this article a meta-analysis is reported over all forbid/allow research since 1940. First of all it is analysed whether the asymmetry can be generalised over questions and experiments. This turns out to be the case. The answer ‘no, not forbid’ is obtained more than ‘yes, allow’, and the mean effect size turns out to be quite large. The huge variance in asymmetry size however, offers roo...

[1]  Richard F. Beltramini,et al.  Meta-Analysis: Quantitative Methods for Research Synthesis , 1987 .

[2]  Russell H. Fazio,et al.  The feature-positive effect in the self-perception process: Does not doing matter as much as doing? , 1982 .

[3]  Oliver P. John,et al.  It’s What You Ask and How You Ask It: An Itemmetric Analysis of Personality Questionnaires , 1986 .

[4]  J. S. Wiggins,et al.  Personality assessment via questionnaires : current issues in theory and measurement , 1986 .

[5]  J. Cacioppo,et al.  ASSERTION VERSUS INTERROGATION FORMAT IN OPINION SURVEYS QUESTIONS ENHANCE THOUGHTFUL RESPONDING , 1987 .

[6]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[7]  R. Tourangeau,et al.  Cognitive Processes Underlying Context Effects in Attitude Measurement , 1988 .

[8]  J. Krosnick,et al.  Attitude intensity, importance, and certainty and susceptibility to response effects. , 1988 .

[9]  S. Presser,et al.  Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording, and Context , 1996 .

[10]  F. Strack,et al.  A comparison of response effects in self-administered and telephone surveys , 1987 .

[11]  Donald D. Rugg,et al.  EXPERIMENTS IN WORDING QUESTIONS: II , 1941 .

[12]  Context, meaning, and interpretation, in a practical approach to linguistics. , 1997 .

[13]  Norbert Schwarz,et al.  Not Forbidding Isn't Allowing: The Cognitive Basis of the Forbid-Allow Asymmetry , 1986 .

[14]  J. Jobe,et al.  Cognition and survey measurement: History and overview , 1991 .