Noncoverage and nonresponse in an Internet survey

We explore the correlates of noncoverage and nonresponse in an Internet survey conducted as part of the Health and Retirement Study (HRS), a panel study of persons 50 years old and older in the US. About 30\% of HRS respondents indicated they used the Internet. Of these, 73\% expressed willingness to do a Web survey. A subset of this group was subsequently sent a mailed invitation to participate in a Web survey and 78\% completed the survey. Using multivariate models, we find significant demographic, financial, and health-related differences in access, consistent with other research. There are fewer differences in willingness (given access) and response (given willingness). However, disparities in health and socio-economic status persist after controlling for demographic differences in coverage and response. Weighting on demographics alone is thus unlikely to yield a representative sample in such surveys. Noncoverage (lack of access to the Internet) appears to be of greater concern than nonresponse (unwillingness to participate given access) for representation in Internet surveys of this age group.

[1]  Ulf-Dietrich Reips,et al.  Dimensions of Internet science , 2001 .

[2]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[3]  J. Pitkow,et al.  Surveying the Territory: GVU's Five WWW User Surveys , 1997 .

[4]  Matthias Schonlau,et al.  A Comparison Between Responses From a Propensity-Weighted Web Survey and an Identical RDD Survey , 2004 .

[5]  Matthias Schonlau,et al.  Web Surveys as Part of a Mixed-Mode Strategy for Populations that cannot be Contacted by E-Mail , 2003 .

[6]  Samuel J. Best,et al.  An Assessment of the Generalizability of Internet Surveys , 2001 .

[7]  Robert P. Berrens,et al.  The Advent of Internet Surveys for Political Research: A Comparison of Telephone and Internet Samples , 2003, Political Analysis.

[8]  Matthias Schonlau,et al.  Advantages and Disadvantages of Internet Research Surveys: Evidence from the Literature , 2002 .

[9]  R. Rice,et al.  Comparing internet and mobile phone usage: digital divides of usage, adoption, and dropouts , 2003 .

[10]  P. Howard,et al.  Method and Representation in Internet-Based Survey Tools— Mobility, Community, and Cultural Identity in Survey2000 , 2000 .

[11]  Wayne L. Pines,et al.  The Challenge of the Internet , 1998 .

[12]  S. Z. Nagi.  An epidemiology of disability among adults in the United States. , 1976, The Milbank Memorial Fund quarterly. Health and society.

[13]  John Curtice,et al.  Measuring the Attitudes of the General Public via Internet Polls: An Evaluation , 2004 .

[14]  F. Conrad,et al.  Spacing, Position, and Order Interpretive Heuristics for Visual Features of Survey Questions , 2004 .

[15]  N. Nagelkerke,et al.  A note on a general definition of the coefficient of determination , 1991 .

[16]  Norman K. Denzin,et al.  Disability and rehabilitation : legal, clinical, and self-concepts and measurements , 1971 .

[17]  M. Couper.  A REVIEW OF ISSUES AND APPROACHES , 2000 .

[18]  L. Radloff.  The CES-D Scale , 1977 .

[19]  S. Katz,et al.  STUDIES OF ILLNESS IN THE AGED. THE INDEX OF ADL: A STANDARDIZED MEASURE OF BIOLOGICAL AND PSYCHOSOCIAL FUNCTION. , 1963, JAMA.

[20]  Tom W. Smith.  An Experimental Comparison of Knowledge Networks and the GSS , 2003 .

[21]  P. Howard,et al.  Research Methodology , 2000 .

[22]  M. Lawton,et al.  Assessment of Older People: Self-Maintaining and Instrumental Activities of Daily Living , 1969 .

[23]  David R. Cox.  The analysis of binary data , 1970 .

[24]  Joo-Young Jung,et al.  Exploring the Digital Divide , 2001, Commun. Res..