Some practical issues in the evaluation of heterogeneous labour market programmes by matching methods

Recently, several studies have analysed active labour market policies by using a recently proposed matching estimator for multiple programmes. Since there is only very limited practical experience with this estimator, this paper checks its sensitivity with resprect to issues that are of practical importance in this kind of evaluation study. The estimator turns out to be fairly robust to several features that concern its implementation. Furthermore, the paper demonstrates that the matching approach per se is no panacea for solving all the problems of evaluation studies, but that its success depends critically on the information that is available in the data. Finally, a comparison with a bootstrap distribution provides some justification for using a simplified approximation of the distribution of the estimator that ignores its sequential nature.

[1]  J. Heckman,et al.  The Economics and Econometrics of Active Labor Market Programs , 1999 .

[2]  James J. Heckman,et al.  Characterizing Selection Bias Using Experimental Data , 1998 .

[3]  V. Hajivassiliou,et al.  Smooth unbiased multivariate probability simulators for maximum likelihood estimation of limited dependent variable models , 1993 .

[4]  Joshua D. Angrist,et al.  Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants , 1998 .

[5]  J. Geweke,et al.  Alternative computational approaches to inference in the multinomial probit model , 1994 .

[6]  M. Lechner.  Identification and Estimation of Causal Effects of Multiple Treatments Under the Conditional Independence Assumption , 1999, SSRN Electronic Journal.

[7]  Bruno Crépon,et al.  Using matching estimators to evaluate alternative youth employment programs: Evidence from France, 1986–1988 , 2000 .

[8]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator , 1998 .

[9]  M. Lechner,et al.  A Microeconometric Evaluation of Active Labor Market Policy in Switzerland , 2001 .

[10]  P. Holland.  Statistics and Causal Inference , 1985 .

[11]  Jeffrey A. Smith,et al.  Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators? , 2000 .

[12]  A. Heshmati,et al.  A Microeconometric Evaluation of Rehabilitation of Long-term Sickness in Sweden , 2004 .

[13]  D. Rubin.  Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[14]  Michael Lechner,et al.  Programme Heterogeneity and Propensity Score Matching: An Application to the Evaluation of Active Labour Market Policies , 2000 .

[15]  Laura Larsson.  Evaluation of Swedish Youth Labor Market Programs , 2003, The Journal of Human Resources.

[16]  R. Lalonde.  Evaluating the Econometric Evaluations of Training Programs with Experimental Data , 1984 .

[17]  J. Heckman,et al.  The Pre‐programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies , 1999 .

[18]  Michael Lechner,et al.  Microeconometric Evaluation of the Active Labour Market Policy in Switzerland , 2000 .

[19]  Michael Lechner.  A Note on the Common Support Problem in Applied Evaluation Studies , 2000 .

[20]  Robert G. Fay.  Enhancing the Effectiveness of Active Labour Market Policies: Evidence from Programme Evaluations in OECD Countries , 1996 .

[21]  Aris Spanos,et al.  Probability theory and statistical inference: econometric modelling with observational data , 1999 .

[22]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[23]  J. Zweimüller,et al.  The Impact of Active Labor Market Programs and Benefit Entitlement on the Duration of Unemployment , 2000 .

[24]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme , 1997 .

[25]  A. Roy.  Some thoughts on the distribution of earnings , 1951 .

[26]  G. Imbens.  The Role of the Propensity Score in Estimating Dose-Response Functions , 1999 .

[27]  M. Lechner.  Earnings and Employment Effects of Continuous Gff-the-Job Training in East Germany After Unification , 1995 .

[28]  James J. Heckman,et al.  Alternative methods for solving the problem of selection bias in evaluating the impact of treatments , 1986 .

[29]  J. Angrist,et al.  Empirical Strategies in Labor Economics , 1998 .

[30]  J. Zweimüller,et al.  The Impact Of Active Labour Market Policies And Benefit Entitlement Rules On The Duration Of Unemployment , 2000 .

[31]  M. Lechner.  An Evaluation of Public-Sector-Sponsored Continuous Vocational Training Programs in East Germany , 1999 .