Nonresponse and Measurement Error in Employment Research: Making Use of Administrative Data

Linking paradata from a survey on labor market participation to administrative data, this article has a unique opportunity to examine nonresponse and measurement error jointly and provide estimates for bias, variance, and mean square error. We find that increased contact attempts resulted in significant reductions in nonresponse bias. Measure- ment error increased somewhat with increased effort, though total bias was nevertheless reduced. One of the key survey indicators revealed an interesting case of counteracting effects of nonresponse and measure- ment error whereby increased effort to recruit nonrespondents led to an increase in mean square error with increased level of effort despite a reduction in nonresponse bias and constant measurement error.

[1]  A. Peytchev,et al.  Not All Survey Effort is Equal: Reduction of Nonresponse Bias and Nonresponse Error , 2009 .

[2]  Mark Trappmann,et al.  Design and stratification of PASS: a new panel study for research on long term unemployment , 2009 .

[3]  Katharine G. Abraham,et al.  How Social Processes Distort Measurement: The Impact of Survey Nonresponse on Estimates of Volunteer Work in the United States1 , 2008, American Journal of Sociology.

[4]  Mark Trappmann,et al.  Befragung von Arbeitslosengeld-II-Beziehern: Wege aus der Grundsicherung , 2009 .

[5]  Roger Tourangeau,et al.  The presentation of a web survey, nonresponse and measurement error among members of web panel , 2009 .

[6]  Markus Köhler,et al.  Data integration and consolidation of administrative data from various sources: the case of Germans' employment histories , 2009 .

[7]  Tobias Winnerling.  Invention Formosa, the empire of the Great Khan and Lilliput : can 18th century fiction be counterfactual? , 2009 .

[8]  Robert M. Groves,et al.  The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis , 2008 .

[9]  Roger Tourangeau,et al.  Good item or bad—can latent class analysis tell?: the utility of latent class analysis for the evaluation of survey questions , 2008 .

[10]  K. Olson,et al.  When do nonresponse follow-ups improve or reduce data quality? A meta-analysis and review of the existing literature , 2008 .

[11]  R. Tourangeau,et al.  Sensitive questions in surveys. , 2007, Psychological bulletin.

[12]  Bernd Fitzenberger,et al.  Which Program for Whom? Evidence on the Comparative Effectiveness of Public Sponsored Training Programs in Germany , 2007, SSRN Electronic Journal.

[13]  Scott Fricker.  The Relationship Between Response Propensity and Data Quality in the Current Population Survey and the American Time Use Survey , 2007 .

[14]  Stefan Seth,et al.  European Data Watch: The German Integrated Employment Biographies Sample IEBS , 2007 .

[15]  T. Graf,et al.  Erwerbstätige Leistungsbezieher im SGB II: Aufstocker - bedürftig trotz Arbeit , 2007 .

[16]  K. Olson.  An Investigation of the Nonresponse - Measurement Error Nexus. , 2007 .

[17]  Michael A. Dimock,et al.  Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey , 2006 .

[18]  R. Groves.  Nonresponse Rates and Nonresponse Bias in Household Surveys , 2006 .

[19]  Examination of the Relationship between Nonresponse and Measurement Error in a Validation Study of Alumni , 2006 .

[20]  Kristen Olson,et al.  Survey Participation, Nonresponse Bias, Measurement Error Bias, and Total Bias , 2006 .

[21]  R. Little,et al.  Does Weighting for Nonresponse Increase the Variance of Survey Means? (Conference Paper) , 2004 .

[22]  Paul P. Biemer,et al.  Introduction to Survey Quality , 2003 .

[23]  G. Kleinhenz.  IAB-Kompendium : Arbeitsmarkt- und Berufsforschung , 2002 .

[24]  Stefan Bender,et al.  Die IAB-Beschäftigtenstichprobe , 2002 .

[25]  J. Krosnick.  The Causes of No-Opinion Responses to Attitude Measures in Surveys: They Are Rarely What They Appear to Be , 2002 .

[26]  R. Groves,et al.  A Theory-Guided Interviewer Training Protocol Regarding Survey Participation , 2001 .

[27]  Christopher R. Bollinger,et al.  Estimation With Response Error and Nonresponse , 2001 .

[28]  R M Groves,et al.  Consequences of reducing nonresponse in a national telephone survey. , 2000, Public opinion quarterly.

[29]  E. Singer,et al.  The effects of response rate changes on the index of consumer sentiment. , 2000, Public opinion quarterly.

[30]  E. Ziegel,et al.  Nonresponse In Household Interview Surveys , 1998 .

[31]  K. Green.  Reluctant Respondents: Differences between Early, Late and Nonresponders to a Mail Survey. , 1991 .

[32]  R. Groves,et al.  Survey Errors and Survey Costs. , 1991 .

[33]  J. Krosnick,et al.  AN EVALUATION OF A COGNITIVE THEORY OF RESPONSE-ORDER EFFECTS IN SURVEY MEASUREMENT , 1987 .

[34]  S. Stokes,et al.  Optimal Design of Interviewer Variance Experiments in Complex Surveys , 1985 .

[35]  J. Cuzick.  A Wilcoxon-type test for trend. , 1985, Statistics in medicine.

[36]  Charles F. Cannell,et al.  COMPARISON OF A SELF-ENUMERATIVE PROCEDURE AND A PERSONAL INTERVIEW: A VALIDITY STUDY , 1963 .