Occupation coding during the interview

"Currently, most surveys ask for occupation with open-ended questions. The verbatim responses are coded afterwards, which is error-prone and expensive. We describe an alternative approach that allows occupation coding during the interview. Our new technique utilizes a supervised learning algorithm to predict candidate job categories. These suggestions are presented to the respondent, who can in turn choose the most adequate occupation. 72.4% of the respondents selected an occupation when the new instrument was tested in a telephone survey, implicating potential cost savings. To aid further improvements, we identify a number of factors how to increase quality and reduce interview duration." (Author's abstract, IAB-Doku) ((en)) Additional Information Appendix A: Additional Results Appendix B: Questionnaire Appendix C: Description of the Algorithm Appendix D: Instructions for Validation Appendix E: Behavior Coding Manual

[1]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[2]  Mario Bossler.  Employment Expectations and Uncertainties Ahead of the New German Minimum Wage , 2017 .

[3]  Jürgen H. P. Hoffmeyer-Zlotnik,et al.  Computerunterstützte Vercodung der International Standard Classification of Occupations (ISCO-88) , 2004 .

[4]  Geert Loosveldt,et al.  IMPROVEMENT OF THE QUALITY OF RESPONSES TO FACTUAL SURVEY QUESTIONS BY INTERVIEWER TRAINING , 1988 .

[5]  Mark Trappmann,et al.  The PASS panel survey after six waves , 2013 .

[6]  John G. Kovar,et al.  Editing of Survey Data: How Much Is Enough? , 1997 .

[7]  Paul P. Biemer,et al.  Introduction to Survey Quality , 2003 .

[8]  Mick P Couper,et al.  Helping Respondents Provide Good Answers in Web Surveys. , 2016, Survey research methods.

[9]  Britta Matthes,et al.  Arbeiten und Lernen im Wandel: Teil I: Überblick über die Studie - März 2011 (2. aktualisierte Fassung des Berichtes vom Mai 2010) , 2010 .

[10]  Melanie C. Green,et al.  Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Response Bias , 2003 .

[11]  D. R. Matteson.  Interviewers and Interviewing , 1993 .

[12]  Jörgen Svensson.  Quality control of coding of survey responses at Statistics Sweden , 2012 .

[13]  C. Carroll.  CODING MAJOR FIELD OF STUDY , 2002 .

[14]  U. Trautwein,et al.  Intercoder-Reliabilität bei der Berufscodierung nach der ISCO-88 und Validität des sozioökonomischen Status , 2009 .

[15]  Kea Tijdens,et al.  Measuring and Detecting Errors in Occupational Coding: an Analysis of SHARE Data , 2016 .

[16]  F. J. Fowler,et al.  Standardized Survey Interviewing: Minimizing Interviewer-Related Error. , 1989 .

[17]  F. Conrad,et al.  Classifying Open-Ended Reports: Factors Affecting the Reliability of Occupation Codes , 2016 .

[18]  Kea Tijdens,et al.  Self-identification of occupation in web surveys: requirements for search trees and look-up tables , 2015 .

[19]  Sander Scholtus,et al.  Handbook of Statistical Data Editing and Imputation , 2011 .

[20]  Paul Biemer,et al.  Continuous quality improvement for survey operations: some general principles and applications , 1994 .

[21]  Alexander C. Measure,et al.  Automated Coding of Worker Injury Narratives , 2014 .

[22]  Torsten Hothorn,et al.  Model-based Boosting 2.0 , 2010, J. Mach. Learn. Res..

[23]  Kaczmirek Lars,et al.  Three Methods for Occupation Coding Based on Statistical Learning , 2017 .

[24]  L. Rips,et al.  The Psychology of Survey Response , 2000 .

[25]  Peter Elias,et al.  Occupational Classification (ISCO-88): Concepts, Methods, Reliability, Validity and Cross-National Comparability , 1997 .

[26]  Sander Scholtus,et al.  Handbook of Statistical Data Editing and Imputation , 2011 .

[27]  K. Tijdens.  Dropout Rates and Response Times of an Occupation Search Tree in a Web Survey , 2014 .

[28]  M. Stone,et al.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[29]  Leah Melani Christian,et al.  The Influence of Topic Interest and Interactive Probing on Responses to Open-Ended Questions in Web Surveys , 2009 .

[30]  Faizan Javed,et al.  Carotene: A Job Title Classification System for the Online Recruitment Domain , 2015, 2015 IEEE First International Conference on Big Data Computing Service and Applications.

[31]  H Kromhout,et al.  The use of occupation and industry classifications in general population studies. , 2003, International journal of epidemiology.

[32]  Wil Dijkstra,et al.  Methods of behavior coding of survey interviews , 2006 .

[33]  F. Kreuter,et al.  Evaluating Active (Opt-In) and Passive (Opt-Out) Consent Bias in the Transfer of Federal Contact Data to a Third-Party Survey Agency , 2016 .

[34]  Matthew Thompson,et al.  Creating an Automated Industry and Occupation Coding Process for the American Community Survey , 2012 .

[35]  David L. Waltz,et al.  Trading MIPS and memory for knowledge engineering , 1992, CACM.

[36]  R. Tibshirani,et al.  Combining Estimates in Regression and Classification , 1996 .

[37]  Pamela Campanelli,et al.  The Quality of Occupational Coding in the United Kingdom , 1997 .

[38]  Sung-Hyon Myaeng,et al.  A Web-Based Automated System for Industry and Occupation Coding , 2008, WISE.

[39]  L. G. Bobbitt,et al.  Coding Major Fields of Study. , 1993 .

[40]  Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys , 2005 .

[41]  Leo Breiman,et al.  Stacked regressions , 2004, Machine Learning.

[42]  P. Elias,et al.  What kind of work do you do? data collection and processing strategies when measuring "occupation" for statistical surveys and administrative records , 1995 .

[43]  Howard Speizer,et al.  Automated Coding of Survey Data , 1999 .

[44]  M. Galesic,et al.  Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey , 2009 .

[45]  F. J. Fowler,et al.  Standardized Survey Interviewing , 1990 .