Does It Pay Off to Include Non-Internet Households in an Internet Panel?

This paper investigates whether it is possible to improve the representativeness of an Internet panel by including non-Internet households. We study the LISS panel, managed by CentERdata, an Internet panel based on a probability sample that comprises approximately 5000 households. The LISS panel provides non-Internet households, households with no Internet access at the time of the sampling, with cost-free equipment and an Internet connection. Early 2010 the LISS panel contained 545 non-Internet households, this equals approximately 10% of the entire panel. The analyses show that particularly older households, non-western immigrants, and one-person households are less likely to have Internet access. The LISS panel includes a representative sample of non-Internet households except for households with high average age ("the oldest old"). Non-Internet households who participate in the panel show higher response rates on the individual questionnaires and lower attrition rates. While significant differences between the panel and the Dutch population remain, the complete LISS panel, with both Internet and non-Internet households, appears to be closer to the Dutch population than the panel consisting only of Internet households for all socio-demographic variables we tested. Furthermore, about half of the non-Internet households start to use the Internet after they have become panel members. They use less of the options offered by Internet, and mainly use the simpler applications, such as e-mail and information search, compared to persons living in Internet households. In this sense, they remain different from the original Internet households and continue to contribute to the quality of the panel data.

[1]  Jacco Daalmans,et al.  Nonresponse in the Recruitment of an Internet Panel Based on Probability Sampling , 2009 .

[2]  B. Anderson,et al.  Digital Living , 2001 .

[3]  Gerty J. L. M. Lensvelt-Mulders,et al.  Nonresponse Among Ethnic Minorities: A Multivariate Analysis , 2007 .

[4]  Marek Fuchs,et al.  The Coverage Bias of Mobile Web Surveys Across European Countries , 2009 .

[5]  Ulf-Dietrich Reips,et al.  Advice in surveying the general public over the internet , 2010 .

[6]  K. Vos,et al.  The representativeness of LISS, an online probability panel , 2009 .

[7]  Matthias Schonlau,et al.  Noncoverage and nonresponse in an Internet survey , 2007 .

[8]  Don A. Dillman,et al.  Does a Probability-Based Household Panel Benefit from Assignment to Postal Response as an Alternative to Internet-Only? , 2008 .

[9]  Mario Callegaro,et al.  Computing Response Metrics for Online Panels , 2008 .

[10]  Robert D. Tortora,et al.  Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet , 2009 .

[11]  Robert E. Kraut,et al.  Information and Communication: Alternative Uses of the Internet in Households , 1999, Inf. Syst. Res..

[12]  G. Loosveldt,et al.  An evaluation of the weighting procedures for an online access panel survey , 2008 .

[13]  Viswanath Venkatesh,et al.  Model of Adoption and Technology in Households: A Baseline Model Test and Extension Incorporating Household Life Cycle , 2005, MIS Q..

[14]  Vera Toepoel,et al.  Recruiting a Probability Sample for an Online Panel Effects of Contact Mode, Incentives, and Information , 2012 .

[15]  R. Iyer,et al.  The impact of cognitive age on Internet use of the elderly: an introduction to the public policy implications , 2005 .

[16]  Vijay Mahajan,et al.  Determination of Adopter Categories by Using Innovation Diffusion Models , 1990 .

[17]  M. Couper A REVIEW OF ISSUES AND APPROACHES , 2000 .

[18]  Mario Callegaro,et al.  Recruiting Probability-Based Web Panel Members Using an Address-Based Sample Frame: Results from a Pilot Study Conducted by Knowledge Networks , 2009 .

[19]  J. G. Bethlehem,et al.  How representative are online panels? Problems of coverage and selection and possible solutions , 2011 .