Evaluating continuous training programmes by using the generalized propensity score

Summary.  The paper assesses the heterogeneity of treatment effects arising from variation in the duration of training. We use German administrative data that have the extraordinary feature that the amount of treatment varies continuously from 10 days to 395 days (i.e. 13 months). This feature allows us to estimate a continuous dose–response function that relates each value of the dose, i.e. days of training, to the individual post‐treatment probability of employment (the response). The dose–response function is estimated after adjusting for covariate imbalance by using the generalized propensity score, which is a recently developed method for covariate adjustment under continuous treatment regimes. Our data have the advantage that we can consider both the actual and the planned durations of training as treatment variables: if only actual durations are observed, treatment effect estimates may be biased because of endogenous exits. Our results indicate an increasing dose–response function for treatments of up to 120 days, which then flattens out, i.e. longer training programmes do not seem to add an additional treatment effect.

[1]  W G Cole,et al.  And Then There Were Four. , 1950, American journal of public health and the nation's health.

[2]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[3]  James J. Heckman,et al.  Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: the Case of Manpower Training , 1989 .

[4]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1995 .

[5]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1994 .

[6]  James J. Heckman,et al.  Characterizing Selection Bias Using Experimental Data , 1998 .

[7]  J. Heckman,et al.  The Economics and Econometrics of Active Labor Market Programs , 1999 .

[8]  M. Lechner Identification and Estimation of Causal Effects of Multiple Treatments Under the Conditional Independence Assumption , 1999, SSRN Electronic Journal.

[9]  G. Imbens The Role of the Propensity Score in Estimating Dose-Response Functions , 1999 .

[10]  P. Todd,et al.  Evaluating Preschool Programs When Length of Exposure to the Program Varies: A Nonparametric Approach , 2000 .

[11]  Uwe Blien,et al.  Typisierung von Bezirken der Agenturen für Arbeit , 2004 .

[12]  Kosuke Imai,et al.  Causal Inference With General Treatment Regimes , 2004 .

[13]  Jochen Kluve,et al.  Assessing the Performance of Matching Algorithms When Selection into Treatment is Strong , 2007, SSRN Electronic Journal.

[14]  Bundesministerium für Wirtschaft und Arbeit,et al.  Evaluation der Maßnahmen zur Umsetzung der Vorschläge der Hartz-Kommission: Modul 1b, Förderung beruflicher Weiterbildung und Transferleistungen ; Bericht 2005 für das Bundesministerium für Wirtschaft und Arbeit , 2005 .

[15]  Conny Wunsch,et al.  Labour Market Policy in Germany: Institutions, Instruments and Reforms Since Unification , 2005 .

[16]  Keying Ye,et al.  Applied Bayesian Modeling and Causal Inference From Incomplete-Data Perspectives , 2005, Technometrics.

[17]  G. Imbens,et al.  The Propensity Score with Continuous Treatments , 2005 .

[18]  Jochen Kluve The Effectiveness of European Active Labor Market Policy , 2006, SSRN Electronic Journal.

[19]  Hilmar Schneider,et al.  Die Wirkung der Hartz-Reform im Bereich der beruflichen Weiterbildung , 2006 .

[20]  Lars Wiethaus,et al.  RWI: Discussion Papers , 2003 .

[21]  Juan-José Díaz,et al.  An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator , 2006, The Journal of Human Resources.

[22]  Kenneth R. Troske,et al.  Using State Administrative Data to Measure Program Performance , 2003, The Review of Economics and Statistics.

[23]  K. Zimmermann,et al.  And then There Were Four... How Many (and Which) Measures of Active Labour Market Policy Do We Still Need? , 2007 .

[24]  Gary King,et al.  Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference , 2007, Political Analysis.

[25]  Alfonso Flores-Lagunes,et al.  Estimating the Effects of Length of Exposure to a Training Program: The Case of Job Corps , 2007, SSRN Electronic Journal.

[26]  L. Keele Semiparametric Regression for the Social Sciences , 2008 .

[27]  Ulf Rinne,et al.  Too Bad to Benefit? Effect Heterogeneity of Public Training Programs , 2008, SSRN Electronic Journal.

[28]  Gary King,et al.  Misunderstandings between experimentalists and observationalists about causal inference , 2008 .

[29]  R. Moffitt Estimating Marginal Treatment Effects in Heterogeneous Populations , 2008 .

[30]  Michael Lechner,et al.  Long-Run Effects of Public Sector Sponsored Training in West Germany , 2004, SSRN Electronic Journal.