The effect of questionnaire length on survey response

Survey textbooks suggest that long questionnaires should be avoided, and a careful reading of the available empirical evidence confirms the negative effects of substantial length on both response rates and the quality of those responses which are obtained. Data is presented from a lengthy survey in Britain in 1987. Analysis of reasons for nonresponse to this survey suggest that length may indeed have been a significant disincentive to respond for many. However, no effect of length was found on item quality as measured by the number of responses given to open-ended questions. Unexpectedly, the variance in number of responses was greater when the questions were asked later in the questionnaire. The results are interpreted as resulting from the greater power that respondents gain as the survey proceeds.

[1]  Michael J. Shapiro.  DISCOVERING INTERVIEWER BIAS IN OPEN-ENDED SURVEY RESPONSES , 1970 .

[2]  M. Sirken,et al.  Survey Procedures for Supplementing Mortality Statistics. , 1960, American journal of public health and the nation's health.

[3]  F. M. Andrews.  Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach , 1984 .

[4]  Ward S. Mason,et al.  LIVING RESEARCHAN EXPERIMENTAL STUDY OF FACTORS AFFECTING RESPONSE TO A MAIL SURVEY OF BEGINNING TEACHERS , 1961 .

[5]  James D. Wright,et al.  Handbook of Survey Research. , 1985 .

[6]  R. Anderson,et al.  Mechanisms of closure of perimembranous ventricular septal defect. , 1983, The American journal of cardiology.

[7]  W. J. Goode,et al.  Methods in Social Research , 1952 .

[8]  D. R. Berdie.  Questionnaire length and response rate. , 1973 .

[9]  R. F. Sletto.  Pretesting of Questionnaires , 1940 .

[10]  D. Dillman.  Mail and telephone surveys : the total design method , 1979 .

[11]  D. Gibson,et al.  The Elderly Respondent , 1983 .

[12]  B. H. Layne,et al.  Questionnaire Page Length and Return Rate , 1981 .

[13]  T. Heberlein,et al.  Factors affecting response rates to mailed questionnaires: A quantitative analysis of the published literature. , 1978 .

[14]  S. Schleifer,et al.  Trends in Attitudes Toward and Participation in Survey Research , 1986 .

[15]  Jagdish N. Sheth,et al.  MAIL SURVEYS: CAN SEGMENTATION AND EXPERIMENTATION IMPROVE THEM? , 1973 .

[16]  R. Jowell,et al.  Survey Research Practice. , 1977 .

[17]  A. Hare,et al.  Response Rates in Postal Surveys , 1974 .

[18]  Daniel Katz,et al.  Research Methods in the Behavioral Sciences. , 1954 .

[19]  Robert Ferber,et al.  ITEM NONRESPONSE IN A CONSUMER SURVEY , 1966 .

[20]  W. Russell Johnson,et al.  Effects of alternative positioning of open-ended questions in multiple-choice questionnaires. , 1974 .

[21]  L. Sharp,et al.  Respondent Burden: A Test of Some Common Assumptions , 1983 .

[22]  W. J. Goode,et al.  Methods in Social Research. , 1954 .

[23]  C. Scott.  Research on Mail Surveys , 1961 .

[24]  Harris Cooper,et al.  A Quantitative Review of Research Design Effects on Response Rates to Questionnaires , 1983 .

[25]  P. Sheatsley.  Chapter 6 – Questionnaire Construction and Item Writing , 1983 .

[26]  Geert Loosveldt,et al.  IMPROVEMENT OF THE QUALITY OF RESPONSES TO FACTUAL SURVEY QUESTIONS BY INTERVIEWER TRAINING , 1988 .

[27]  Alexander Basilevsky,et al.  Chapter 12 – Missing Data: A Review of the Literature , 1983 .

[28]  Allen I. Kraut,et al.  Some effects of position on opinion survey items. , 1975 .

[29]  D. Dillman,et al.  Increasing Mail Questionnaire Response: A Four State Comparison , 1974 .

[30]  Seymour Sudman,et al.  Response Effects in Surveys: A Review and Synthesis , 1974 .

[31]  B. W. Roper.  Evaluating Polls with Poll Data , 1986 .

[32]  L. Festinger,et al.  Research Methods in the Behavioral Sciences. , 1954 .

[33]  Eli S. Marks,et al.  Influence of the Interviewer on the Accuracy of Survey Results , 1958 .

[34]  A. Furnham.  EXPLANATIONS FOR UNEMPLOYMENT IN BRITAIN , 1982 .

[35]  J. Bachman,et al.  Effects of Questionnaire Length on Response Quality , 1981 .

[36]  J. Goyder,et al.  Further Evidence on Factors Affecting Response Rates to Mailed Questionnaires , 1982 .