The Impact of Incentives and Interview Methods on Response Quantity and Quality in Diary- and Booklet-Based Surveys:

This paper investigates the impact on response quantity and quality of a diary- and booklet-based survey of using different interview methods and lottery prizes. In addition to a conventional questionnaire the survey included time-diaries for household members and a expenditure booklet for recording the previous month's spending by the household. The respondents could choose to use either CATI (Computer-Assisted Telephone Interviewing) or web-based CAPI (Computer-Assisted Personal Interviewing) for the different parts of the survey. Lottery prizes varied during the survey period, and the prizes were doubled if they had used only the CAPI method. The response rate was significantly affected by the size of the lottery prizes, and the doubling of these prizes for using the web had a high impact on the number of respondents choosing this method. The implication was that also the response quality increased as a result of the impact on the number of web interviews, because this method was found to yield a significantly higher quality for the diary, booklet and questionnaire information.

[1]  Anja S. Göritz,et al.  Contingent versus unconditional incentives in WWW-studies , 2005, Advances in Methodology and Statistics.

[2]  Geert Loosveldt,et al.  Face-to-Face versus Web Surveying in a High-Internet-Coverage Population Differences in Response Quality , 2008 .

[3]  Mick P. Couper,et al.  Survey Incentives: Cash vs. In-Kind; Face-to-Face vs. Mail; Response Rate vs. Nonresponse Error , 2006 .

[4]  J. Heckman,et al.  The Economics and Econometrics of Active Labor Market Programs , 1999 .

[5]  Are Busy People Under-or Over-represented in National Time Budget Surveys? , 1998 .

[6]  M. Couper A REVIEW OF ISSUES AND APPROACHES , 2000 .

[7]  John P. Robinson,et al.  Time for Life: The Surprising Ways Americans Use Their Time , 1998 .

[8]  Phawn M. Letourneau,et al.  Nonresponse in the American Time Use Survey , 2008 .

[9]  Ann P. Rafferty,et al.  The Cost-Effectiveness of Alternative Advance Mailings in a Telephone Survey , 2005 .

[10]  W. Saris,et al.  Large Differences in Time Use for Three Data Collection Systems , 1998 .

[11]  Roger Tourangeau,et al.  Eye-Tracking Data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding. , 2008, Public opinion quarterly.

[12]  Katharine G. Abraham,et al.  Non-Response in the American Time Use Survey: Who is Missing from the Data and How Much Does it Matter? , 2006 .

[13]  E. Singer,et al.  Experiments with incentives in telephone surveys. , 2000, Public opinion quarterly.

[14]  E. Ziegel,et al.  Nonresponse In Household Interview Surveys , 1998 .

[15]  J. Armstrong Monetary Incentives in Mail Surveys , 1975 .

[16]  E. D. de Leeuw,et al.  Trends in household survey nonresponse: a longitudinal and international comparison , 2002 .

[17]  Kasper M. Hansen The Effects of Incentives, Interview Length, and Interviewer Characteristics on Response Rates in a CATI-Study , 2006 .

[18]  Anja S Göritz,et al.  Individual payments as a longer-term incentive in online panels , 2008, Behavior research methods.

[19]  F. Kreuter,et al.  Social Desirability Bias in CATI, IVR, and Web Surveys The Effects of Mode and Question Sensitivity , 2008 .

[20]  Stanley Presser,et al.  Changes in Telephone Survey Nonresponse over the Past Quarter Century , 2005 .

[21]  Anja S. Göritz,et al.  Cash Lotteries as Incentives in Online Panels , 2006 .

[22]  Anja S. Göritz,et al.  The impact of material incentives on response quantity, response quality, sample composition, survey outcome, and cost in online access panels , 2004 .

[23]  John P. Robinson ACTIVITY PATTERNS OF TIME-DIARY DROPOUTS , 1998 .

[24]  R. Groves Nonresponse Rates and Nonresponse Bias in Household Surveys , 2006 .

[25]  Stephen R. Porter,et al.  The Impact of Lottery Incentives on Student Survey Response Rates , 2003 .

[26]  Kathleen Mcspurren,et al.  CHARITIES, NO; LOTTERIES, NO; CASH, YES MAIN EFFECTS AND INTERACTIONS IN A CANADIAN INCENTIVES EXPERIMENT , 1996 .