Who needs RDD? Combining directory listings with cell phone exchanges for an alternative telephone sampling frame

Abstract The traditional Random Digit Dialing method (list-assisted RDD using a frame of landline phone numbers) is clearly under threat. The difficulty and costs of completing telephone surveys have increased due to rising rates of refusal and non-contact. The completeness of coverage of list-assisted RDD samples has diminished due to the proliferation of cell-phone only households. The ability of list-assisted RDD to capture young, mobile, unmarried, and minority households is thus diminishing as well. Increasingly, survey researchers have been adding a cell phone component to their sampling frames for telephone surveys, despite the increased costs and other issues associated with RDD calling of cell phones. Recent research by Guterbock, Oldendick, and others has explored the extent to which “electronic white pages” (EWP) samples really differ from RDD samples. Oldendick et al. and Guterbock, Diop and Holian have emphasized that minority households are seriously underrepresented in EWP samples. Nevertheless, EWP samples have distinct advantages whenever a survey is aimed at a restricted geographic area. This paper considers the feasibility of combining EWP samples with cell-phone RDD, eliminating the ordinary RDD component from the sampling frame. We analyze the components of the telephone population, showing that the proposed method would fail to cover only one segment of the telephone population: unlisted landline households that have no cell phone. We analyze data from the 2006 National Health Interview Study to estimate the size of this segment, its demographic profile, the degree to which selected demographic and health behavior characteristics are different from those in the segments that this sampling strategy would capture, and what biases are present in the various sampling frames of interest. Trend data from the NHIS are used to assess how these biases are changing. A simple cost comparison is made among the RDD, RDD + cell and EWP + cell frames. The proposed alternative “EWP + cell” sampling frame provides relatively small bias compared to RDD + cell at costs comparable to RDD-only designs. The portion of the telephone universe that is excluded in the EWP + cell design is getting smaller all the time, therefore its bias relative to the RDD + cell design is decreasing over time. Overall, the EWP + cell design seems to be a useful alternative.

[1]  Courtney Kennedy,et al.  Evaluating the Effects of Screening for Telephone Service in Dual Frame RDD Surveys , 2007 .

[2]  B. Psaty,et al.  Sampling elderly in the community: a comparison of commercial telemarketing lists and random digit dialing techniques for assessing health behaviors and health status. , 1991, American journal of epidemiology.

[3]  Shirley A. Star,et al.  AMERICAN ASSOCIATION FOR PUBLIC OPINION RESEARCH , 1980 .

[4]  Sunghee Lee,et al.  Sampling Telephone Numbers and Adults, Interview Length, and Weighting in The California Health Interview Survey Cell Phone Pilot Study , 2007 .

[5]  Mario Callegaro,et al.  Guidelines and Considerations for Survey Researchers When Planning and Conducting RDD and Other Telephone Surveys in the U.S. With Respondents Reached via Cell Phone Numbers , 2010 .

[6]  R. Groves,et al.  Survey Errors and Survey Costs. , 1991 .

[7]  Patrick Ehlen,et al.  Cellular-Only Substitution in the United States as Lifestyle Adoption Implications for Telephone Survey Coverage , 2007 .

[8]  Charlotte Steeh,et al.  The State of Surveying Cell Phone Numbers in the United States , 2007 .

[9]  S. Blumberg,et al.  Recent Trends in Household Telephone Coverage in the United States , 2007 .

[10]  Edith D. de Leeuw,et al.  Advances in Telephone Survey Methodology , 2007 .

[11]  Anne W. Taylor,et al.  Random digit dialling and Electronic White Pages samples compared: demographic profiles and health estimates , 1999, Australian and New Zealand journal of public health.

[12]  M. Traugott,et al.  USING DUAL FRAME DESIGNS TO REDUCE NONRESPONSE IN TELEPHONE SURVEYS , 1987 .

[13]  Karen L. Soderberg,et al.  Wireless substitution: state-level estimates from the National Health Interview Survey, January-December 2007. , 2009, National health statistics reports.

[14]  Earl R. Babbie,et al.  The practice of social research , 1969 .

[15]  Robert M. Groves,et al.  A Mean Squared Error Model for Dual Frame, Mixed Mode Survey Design , 1986 .

[16]  Michael W. Link,et al.  Reaching the U.S. Cell Phone Generation Comparison of Cell Phone Survey Results with an Ongoing Landline Telephone Survey , 2007 .

[17]  Linda B Piekarski,et al.  The Current Efficiency of List-Assisted Telephone Sampling Designs , 2002 .