Analytical Modeling in Complex Surveys of Work Practices

Quantitative industrial relations research frequently relies on data collected from large surveys of establishments that use complex sampling designs, such as stratified and unequal probability sampling. The authors analyze two complex surveys of establishments, the National Organizations Survey and the National Survey of Establishments. They discuss design-based (survey-weighted) and model-based (unweighted) strategies for analyzing these data. They show that the choice of strategy can affect inferences about parameters, and hence conclusions drawn from analyses. They discuss the advantages of model-based approaches that include independent variables corresponding to design features, such as functions of size measures or indicator variables for strata or clusters, relative to purely design-based approaches.

[1]  Ivar Berg,et al.  Sociological perspectives on labor markets , 1982 .

[2]  Graham Kalton,et al.  Models in the Practice of Survey Sampling , 1983 .

[3]  D. Pfeffermann.  The Role of Sampling Weights when Modeling Survey Data , 1993 .

[4]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[5]  Steven B. Cohen.  An Evaluation of Alternative PC-Based Software Packages Developed for the Analysis of Complex Survey Data , 1997 .

[6]  Phillip S. Kott,et al.  A Model-Based Look at Linear Regression with Survey Data , 1991 .

[7]  Sharon L. Lohr,et al.  A comparison of weighted and unweighted analyses in the national Crime Victimization Survey , 1994 .

[8]  D. Rubin.  Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician , 1984 .

[9]  John Paul Macduffie.  Human Resource Bundles and Manufacturing Performance: Organizational Logic and Flexible Production Systems in the World Auto Industry , 1995 .

[10]  R. Althauser.  INTERNAL LABOR MARKETS , 1989 .

[11]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[12]  Jeffrey Pfeffer,et al.  Determinants of Internal Labor Markets in Organizations , 1984 .

[13]  G. Kalton,et al.  The treatment of missing survey data , 1986 .

[14]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[15]  Cynthia L. Gramm,et al.  The Use of Flexible Staffing Arrangements in Core Production Jobs , 2001 .

[16]  W. DuMouchel,et al.  Using Sample Survey Weights in Multiple Regression Analyses of Stratified Samples , 1983 .

[17]  Joseph L Schafer,et al.  Analysis of Incomplete Multivariate Data , 1997 .

[18]  Russell V. Lenth,et al.  Statistical Analysis With Missing Data (2nd ed.) (Book) , 2004 .

[19]  K. R. W. Brewer,et al.  THE EFFECT OF SAMPLE STRUCTURE ON ANALYTICAL SURVEYS1,2 , 1973 .

[20]  D. Rubin.  Multiple imputation for nonresponse in surveys , 1989 .

[21]  Peter Cappelli.  The National Employer Survey: Employer Data on Employment Practices , 2001 .

[22]  T. Shakespeare,et al.  Observational Studies , 2003 .

[23]  Stanley Lemeshow,et al.  Applied Logistic Regression, Second Edition , 1989 .

[24]  D. Rubin.  INFERENCE AND MISSING DATA , 1975 .

[25]  H. James.  VARIETIES OF SELECTION BIAS , 1990 .

[26]  Christopher Winship,et al.  Sample Selection Bias , 2000 .

[27]  Paul Osterman,et al.  Work Reorganization in an Era of Restructuring: Trends in Diffusion and Effects on Employee Welfare , 2000 .

[28]  Frank P. Ardaiolo,et al.  Models in practice. , 1987, Professional nurse.

[29]  Christopher Winship,et al.  Sampling Weights and Regression Analysis , 1994 .

[30]  Edward L. Korn,et al.  Examples of Differing Weighted and Unweighted Estimates from a Sample Survey , 1995 .

[31]  Carl-Erik Särndal,et al.  Model Assisted Survey Sampling , 1997 .

[32]  Peter B. Doeringer,et al.  Internal Labor Markets and Manpower Analysis , 2020 .

[33]  David Knoke,et al.  Organizations in America : analyzing their structures and human resource practices , 1997 .

[34]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[35]  David A. Binder,et al.  Fitting Cox's proportional hazards models from survey data , 1992 .

[36]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[37]  Sandra E. Black,et al.  Beyond the Incidence of Employer-Provided Training , 1998 .

[38]  Mark A. Huselid.  The Impact of Human Resource Management Practices on Turnover, Productivity, and Corporate Financial Performance , 1995 .

[39]  L. Chambless,et al.  Maximum likelihood methods for complex sample data: logistic regression and discrete proportional hazards models , 1985 .

[40]  R. Sugden,et al.  Ignorable and informative designs in survey sampling inference , 1984 .

[41]  John Paul Macduffie,et al.  The Adoption of High‐Involvement Work Practices , 1996 .

[42]  D. O'Rourke,et al.  Designing and Implementing the National Organizations Study , 1994 .

[43]  P. Osterman.  How Common is Workplace Transformation and Who Adopts it? , 1994 .

[44]  D. Horvitz,et al.  A Generalization of Sampling Without Replacement from a Finite Universe , 1952 .

[45]  Richard M. Royall.  An Evaluation of Model-Dependent and Probability-Sampling Inferences in Sample Surveys: Comment , 1983 .

[46]  D. Rubin,et al.  Reducing Bias in Observational Studies Using Subclassification on the Propensity Score , 1984 .

[47]  D. Binder.  On the variances of asymptotically normal estimators from complex surveys , 1983 .

[48]  M. H. Hansen.  An Evaluation of Model-Dependent and Probability-Sampling Inferences in Sample Surveys , 1983 .

[49]  W. W. Muir,et al.  Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1980 .

[50]  James J. Heckman,et al.  Alternative methods for evaluating the impact of interventions: An overview , 1985 .

[51]  J. Heckman.  Sample selection bias as a specification error , 1979 .

[52]  J. Schafer,et al.  Missing data: our view of the state of the art. , 2002, Psychological methods.

[53]  K. Wolter.  Introduction to Variance Estimation , 1985 .

[54]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[55]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[56]  Patrick M. Wright,et al.  Measurement error in research on human resources and firm performance: How much error is there and how does it influence effect size estimates? , 2000 .