Duration models: specification, identification and multiple durations

Since the early 1980s, the econometric analysis of duration variables has become widespread. This chapter provides an overview of duration analysis, with an emphasis on the specification and identification of duration models, and with special attention to models for multiple durations. Most of the chapter deals with so-called reduced-form duration models, notably the popular Mixed Proportional Hazard (MPH) model and its multivariate extensions. The MPH model is often used to describe the relation between the empirical exit rate and "background variables[equal, rising dots] in a concise way. However, since the applications usually interpret the results in terms of some economic-theoretical model, we examine to what extent the deep structural parameters of some important theoretical models can be related to reduced-form parameters. We subsequently examine the specification and identification of the MPH model in great detail, we provide intuition on what drives identification, and we infer to what extent biases may occur because of misspecifications. This examination is carried out separately for the case of single-spell data and the case of multi-spell data. We also compare different functional forms for the unobserved heterogeneity distribution.Next, we examine models for multiple durations. In the applied econometric literature on the estimation of multiple-duration models, the range of different models is actually not very large. Typically, the models allow for dependence between the duration variables by way of their unobserved determinants, with each single duration following its own MPH model. In addition to this, the model may allow for an interesting "causal[equal, rising dots] effect of one duration on the other, as motivated by an underlying economic theory. For all these models we examine the conditions for identification. Some of these are intimately linked to particular estimation strategies. The multiple-duration model where the marginal duration distributions each satisfy an MPH specification, and the durations can only be dependent by way of their unobserved determinants, is called the Multivariate Mixed Proportional Hazard (MMPH) model. For this model, we address the issue of the dimensionality of the heterogeneity distribution and we compare the flexibility of different parametric heterogeneity distributions.On a number of occasions, we incorporate recent insights from the biostatistical literature on duration analysis, and we contrast points of view in this literature to those in the econometric literature. Finally, throughout the chapter, we discuss the importance of the possible collection of additional data.

[1]  N. Keiding,et al.  Survival models and martingale dynamics: original text, discussion and reply , 1989 .

[2]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[3]  Tony Lancaster,et al.  The Econometric Analysis of Transition Data. , 1992 .

[4]  Gerard J. van den Berg,et al.  An empirical equilibrium search model of the labour market , 1998 .

[5]  Nancy Flournoy,et al.  Assessment of Dependence In the Life Times of Twins , 1992 .

[6]  J. Heckman,et al.  Models for the Analysis of Labor Force Dynamics , 1982 .

[7]  Yoshiaki Omori,et al.  Stigma Effects of Nonemployment , 1997 .

[8]  Christopher A. Sims,et al.  Advances in Econometrics , 1996 .

[9]  N. Sastry A nested frailty model for survival data, with an application to the study of child survival in northeast Brazil. , 1997, Journal of the American Statistical Association.

[10]  N. Kiefer Economic Duration Data and Hazard Functions , 1988 .

[11]  Constantijn Panis,et al.  Panel Attrition from the Panel Study of Income Dynamics Household Income, Marital Status, and Mortality , 1998 .

[12]  A. Yashin,et al.  What Difference Does the Dependence Between Durations Make? Insights for Population Studies of Aging , 1999, Lifetime data analysis.

[13]  Stanley Wasserman,et al.  Sociological Methodology, 1987 , 1989 .

[14]  G. J. van den Berg,et al.  Search Behaviour, Transitions to Nonparticipation and the Duration of Unemployment , 1990 .

[15]  Tony Lancaster,et al.  Generalised residuals and heterogeneous duration models: With applications to the Weilbull model , 1985 .

[16]  Tony Lancaster,et al.  Simultaneous equations models in applied search theory , 1985 .

[17]  Geert Ridder,et al.  The Non-Parametric Identification of Generalized Accelerated Failure-Time Models , 1990 .

[18]  W. Narendranathan,et al.  Job Search In A Dynamic Environment An Empirical Analysis , 1993 .

[19]  Kannan Srinivasan,et al.  Consumer Purchase Behavior in a frequently Bought Product Category: Estimation Issues and Managerial Insights from a Hazard Function Model with Heterogeneity , 1993 .

[20]  Geert Ridder,et al.  Attrition in longitudinal panel data, and the empirical analysis of dynamic labour market behaviour , 1994 .

[21]  Richard D. Gill,et al.  A counting process approach to maximum likelihood estimation in frailty models , 1992 .

[22]  P H Zahl,et al.  Frailty modelling for the excess hazard. , 1997, Statistics in medicine.

[23]  García Pérez,et al.  Non-Stationary Job Search with Firing: A Structural Estimation , 1998 .

[24]  C. Genest,et al.  The Joy of Copulas: Bivariate Distributions with Uniform Marginals , 1986 .

[25]  Robert J. LaLonde,et al.  THE EFFECT OF SAMPLE SELECTION AND INITIAL CONDITIONS IN DURATION MODELS: EVIDENCE FROM EXPERIMENTAL DATA ON TRAINING , 1996 .

[26]  Dale T. Mortensen,et al.  Chapter 15 Job search and labor market analysis , 1986 .

[27]  Dale T. Mortensen,et al.  Chapter 39 New developments in models of search in the labor market , 1999 .

[28]  Gerard J. van den Berg,et al.  An empirical equilibrium job search model with search on the job and heterogeneous workers and firms , 1999 .

[29]  David R. Cox,et al.  Regression models and life tables (with discussion , 1972 .

[30]  Tony Lancaster,et al.  ECONOMETRIC METHODS FOR THE DURATION OF UNEMPLOYMENT , 1979 .

[31]  Jeffrey R. Russell,et al.  Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data , 1998 .

[32]  J. Heckman,et al.  Econometric duration analysis , 1984 .

[33]  Kazuo Yamaguchi,et al.  ALTERNATIVE APPROACHES TO UNOBSERVED HETEROGENEITY IN THE ANALYSIS OF REPEATABLE EVENTS , 1986 .

[34]  Tony Lancaster,et al.  Generalised Residuals and Heterogeneous Duration Models: The Exponential Case , 1983 .

[35]  William J. Horvath,et al.  A statistical model for the duration of wars and strikes , 1968 .

[36]  W. V. D. Klaauw,et al.  Female Labour Supply and Marital Status Decisions: A Life-Cycle Model , 1996 .

[37]  Philip Hougaard,et al.  Measuring the Similarities between the Lifetimes of Adult Danish Twins Born between 1881–1930 , 1992 .

[38]  T. Richards,et al.  Correcting for unmeasured heterogeneity in hazard models using the Heckman-Singer procedure , 1985 .

[39]  James J. Heckman,et al.  Identifying the Hand of the Past: Distinguishing State Dependence from Heterogeneity , 1991 .

[40]  D. Dabrowska Non-parametric regression with censored survival time data , 1987 .

[41]  L. Bauwens,et al.  The Logarithmic Acd Model: An Application to the Bid-Ask Quote Process of Three NYSE Stocks , 2000 .

[42]  John C. Ham,et al.  Unemployment Insurance and Male Unemployment Duration in Canada , 1987, Journal of Labor Economics.

[43]  J. Kalbfleisch,et al.  The Statistical Analysis of Failure Time Data , 1980 .

[44]  J. E. Freund A Bivariate Extension of the Exponential Distribution , 1961 .

[45]  M. Lindeboom,et al.  Heterogeneity in Models for Bivariate Survival: the Importance of the Mixing Distribution , 1994 .

[46]  Tiemen M Woutersen,et al.  Estimators for Panel Duration Data with Endogenous Censoring and Endogenous Regressors , 2000 .

[47]  Bong Joon Yoon,et al.  A MODEL OF UNEMPLOYMENT DURATION WITH VARIABLE SEARCH INTENSITY , 1981 .

[48]  M. Gail,et al.  Biased estimates of treatment effect in randomized experiments with nonlinear regressions and omitted covariates , 1984 .

[49]  Kazuo Yamaguchi,et al.  Event History Analysis. , 1992 .

[50]  S Greenland,et al.  The probability of causation under a stochastic model for individual risk. , 1989, Biometrics.

[51]  John P. Klein,et al.  Semi‐parametric estimation of covariate effects using the positive stable frailty model , 1995 .

[52]  G. Ridder,et al.  Stratified partial likelihood estimation. , 1999, Journal of econometrics.

[53]  J. Heckman Sample selection bias as a specification error , 1979 .

[54]  P. Hougaard A class of multivanate failure time distributions , 1986 .

[55]  Brian P. McCall,et al.  The Identifiability of the Mixed Proportional Hazards Model with Time-Varying Coefficients , 1996, Econometric Theory.

[56]  James J. Heckman,et al.  Are Unemployment and Out of the Labor Force Behaviorally Distinct Labor Force States? , 1982, Journal of Labor Economics.

[57]  Jonathan M. Thomas The Role of Selective Job Search in UK Unemployment , 1998 .

[58]  Michael Visser,et al.  Nonparametric estimation of the bivariate survival function with an application to vertically transmitted AIDS , 1996 .

[59]  C. McCulloch,et al.  A hazard rate approach to the timing of births. , 1984, Econometrica : journal of the Econometric Society.

[60]  Gerard J. van den Berg,et al.  Empirical equilibrium search models , 1997 .

[61]  J. Heckman,et al.  The Identifiability of the Proportional Hazard Model , 1984 .

[62]  Stephen Nickell,et al.  Estimating the Probability of Leaving Unemployment , 1979 .

[63]  Gerard J. van den Berg,et al.  Punitive sanctions and the transition rate from welfare to work , 1998 .

[64]  N. Kiefer,et al.  Equilibrium Search Models and the Transition from School to Work , 1997 .

[65]  George R. Neumann Search Models and Duration Data , 1995 .

[66]  Nancy Brandon Tuma,et al.  Sociological Methodology 1985. , 1987 .

[67]  Niels Keiding,et al.  Statistical Models Based on Counting Processes , 1993 .

[68]  Gary Solon,et al.  Work Incentive Effects of Taxing Unemployment Benefits , 1985 .

[69]  J. Heckman,et al.  New Methods for Analyzing Structural Models of Labor Force Dynamics , 1982 .

[70]  John P. Klein,et al.  Estimating the Survival Function in the Proportional Hazards Regression Model: A Study of the Small Sample Size Properties , 1996 .

[71]  Jean-Marc Robin,et al.  The Demand for Food Products: An Analysis of Interpurchase Times and Purchased Quantities , 2001 .

[72]  Francis X. Diebold,et al.  A Nonparametric Investigation of Duration Dependence in the American Business Cycle , 1990, Journal of Political Economy.

[73]  Cheng Hsiao,et al.  Some econometrics of scarring , 2001 .

[74]  Christopher J. Flinn Labor market structure and welfare : a comparison of Italy and the U.S. , 1997 .

[75]  Jan C. van Ours,et al.  Do stepping-stone jobs exist? Early career paths in the medical profession , 2002 .

[76]  Ørnulf Borgan,et al.  Counting process models for life history data: a review , 1984 .

[77]  Bo E. Honoré,et al.  IDENTIFICATION RESULTS FOR DURATION MODELS WITH MULTIPLE SPELLS OR TIME-VARYING COVARIATES , 1990 .

[78]  Geert Ridder,et al.  Constructive identification of the mixed proportional hazards model , 1995 .

[79]  Naufel J. Vilcassim,et al.  Modeling Purchase-Timing and Brand-Switching Behavior Incorporating Explanatory Variables and Unobserved Heterogeneity , 1991 .

[80]  K. Carling,et al.  Modeling unemployment duration in a dependent competing risks framework: Identification and estimation , 1995, Lifetime data analysis.

[81]  Ron Brookmeyer,et al.  Bivariate frailty model for the analysis of multivariate survival time , 1996, Lifetime data analysis.

[82]  Nicholas M. Kiefer,et al.  Empirical Labor Economics: The Search Approach , 1991 .

[83]  R. Cook,et al.  Modeling Two-state Disease Processes with Random Effects , 1997, Lifetime data analysis.

[84]  Costas Meghir,et al.  Labour market transitions and retirement of men in the UK , 1997 .

[85]  Philip Hougaard MODELLING HETEROGENEITY IN SURVIVAL DATA , 1991 .

[86]  Bong Joon Yoon,et al.  A non-stationary hazard function of leaving unemployment for employment , 1985 .

[87]  John Kennan,et al.  The duration of contract strikes in U.S. manufacturing , 1985 .

[88]  D. Oakes,et al.  Bivariate survival models induced by frailties , 1989 .

[89]  Douglas A. Wolf,et al.  A random-effects logit model of work-welfare transitions , 1990 .

[90]  James J. Heckman,et al.  The identifiability of the competing risks model , 1989 .

[91]  Guang Guo,et al.  Estimating a Multivariate Proportional Hazards Model for Clustered Data Using the EM Algorithm, with an Application to Child Survival in Guatemala , 1992 .

[92]  M. Lindeboom,et al.  Attrition in panel survey data and the estimation of multi-state labor market models , 1998 .

[93]  M. Kendall Rank Correlation Methods , 1949 .

[94]  Michael Rosholm,et al.  The Risk of marginalization in the Labour Market: Application of the Three State Dependent Competing Risks Duration Model , 1997 .

[95]  H. Bunzel,et al.  Panel Data and Structural Labour Market Models , 2000 .

[96]  K Borch-Johnsen,et al.  Heterogeneity models of disease susceptibility, with application to diabetic nephropathy. , 1994, Biometrics.

[97]  D. Weir,et al.  Structural change in life cycle fertility during the fertility transition: France before and after the Revolution of 1789. , 1990, Population studies.

[98]  Angelo Melino,et al.  Duration dependence and nonparametric heterogeneity: A Monte Carlo study , 2000 .

[99]  A. Pakes,et al.  The Rate of Obsolescence of Knowledge, Research Gestation Lags, and the Private Rate of Return to Research Resources , 1979 .

[100]  C. Huber-Carol,et al.  Effects of omitting covariates in Cox's model for survival data , 1988 .

[101]  Joel L. Horowitz,et al.  Semiparametric Estimation of a Regression Model with an Unknown Transformation of the Dependent Variable , 1996 .

[102]  David M. Kreps,et al.  Advances In Economics and Econometrics: Theory And Applications: Seventh World Congress , 1997 .

[103]  James J. Heckman,et al.  Using Goodness of Fit and Other Criteria to Choose among Competing Duration Models: A Case Study of Hutterite Data , 1987 .

[104]  N. Keiding,et al.  The role of frailty models and accelerated failure time models in describing heterogeneity due to omitted covariates. , 1997, Statistics in medicine.

[105]  Gerard J. van den Berg,et al.  Equilibrium search with continuous productivity dispersion: theory and nonparametric estimation , 2000 .

[106]  Gideon Fishelson,et al.  Advances in the theory and measurement of unemployment , 1990 .

[107]  C. A. Pissarides,et al.  Equilibrium Unemployment Theory , 1990 .

[108]  Geert Ridder,et al.  The Distribution of Single-Spell Duration Data , 1984 .

[109]  Maarten Lindeboom,et al.  Multistate Models for Clustered Duration Dataan Application to Workplace Effects on Individual Sickness Absenteeism , 2000, Review of Economics and Statistics.

[110]  K. Wolpin Estimating a Structural Search Model: The Transition from School to Work , 1987 .

[111]  Patricia J. Solomon,et al.  Effect of misspecification of regression models in the analysis of survival data , 1984 .

[112]  Keunkwan Ryu,et al.  Structural duration analysis of management data , 1993 .

[113]  Thomas Coleman,et al.  Unemployment Behavior Evidence from the CPS Work Experience Survey , 1989 .

[114]  L A Lillard,et al.  Simultaneous equations for hazards: marriage duration and fertility timing. , 1993, Journal of econometrics.

[115]  Fabio Schiantarelli,et al.  Zeroes and Lumps in Investment: Empirical Evidence on Irreversibilities and Non-Convexities , 1998 .

[116]  George R. Neumann,et al.  Studies in Labor Market Dynamics , 1984 .

[117]  Related Topics,et al.  Survival analysis : state of the art , 1992 .

[118]  Kenneth I. Wolpin Empirical Methods for the Study of Labour Force Dynamics , 2002 .

[119]  J J Heckman,et al.  Econometric mixture models and more general models for unobservables in duration analysis , 1994, Statistical methods in medical research.

[120]  John Rust,et al.  Structural estimation of markov decision processes , 1986 .

[121]  J. Heckman,et al.  The Economics and Econometrics of Active Labor Market Programs , 1999 .

[122]  Jean-Pierre Florens,et al.  Noncausality in Continuous Time , 1996 .

[123]  Gerard J. van den Berg,et al.  Unemployment Dynamics and Duration Dependence , 1996, Journal of Labor Economics.

[124]  Donald L. Snyder,et al.  Random Point Processes in Time and Space , 1991 .

[125]  R. M. Gritz,et al.  The impact of training on the frequency and duration of employment , 1993 .

[126]  Ruud H. Koning,et al.  The relation between wages and labor market frictions: An empirical analysis based on matched worker-firm data , 2000 .

[127]  Gilbert MacKenzie,et al.  The Statistical Analysis of Failure Time Data , 1982 .

[128]  David Card,et al.  Measuring the Effect of Subsidized Training Programs on Movements in Andout of Employment , 1987 .

[129]  J J Heckman,et al.  The relationship between wages and income and the timing and spacing of births: evidence from Swedish longitudinal data. , 1990, Econometrica : journal of the Econometric Society.

[130]  Thomas A. Louis,et al.  Time-Dependent Association Measures for Bivariate Survival Distributions , 1992 .

[131]  Glenn Firebaugh,et al.  Sociological Methodology 1986. , 1988 .

[132]  Boyan Jovanovic,et al.  Wages and Turnover: A Parametrization of the Job-Matching Model , 1984 .

[133]  Jinyong Hahn,et al.  The Efficiency Bound of the Mixed Proportional Hazard Model , 1994 .

[134]  Jan C. van Ours,et al.  The Effect of Unemployment Insurance Sanctions on the Transition Rate from Unemployment to Employment , 1996 .

[135]  Philip Hougaard,et al.  Modelling multivariate survival , 1987 .

[136]  Andrew Chesher,et al.  The Estimation of Models of Labour Market Behaviour , 1983 .

[137]  Elja Arjas,et al.  Survival models and martingale dynamics , 1989 .

[138]  Geert Ridder,et al.  Estimating Measures of Labor Market Imperfection for Five OECD Countries , Using Aggregate Data in an Equilibrium Search Framework , 1998 .

[139]  Gary Chamberlain,et al.  Longitudinal Analysis of Labor Market Data: Heterogeneity, omitted variable bias, and duration dependence , 1985 .

[140]  James J. Heckman,et al.  Longitudinal Analysis of Labor Market Data , 1985 .

[141]  James J. Heckman,et al.  New Evidence on the Timing and Spacing of Births , 1985 .

[142]  Jaap H. Abbring,et al.  The Non-Parametric Identification of the Mixed Proportional Hazards Competing Risks Model , 2000 .

[143]  Chris Elbers,et al.  True and Spurious Duration Dependence: The Identifiability of the Proportional Hazard Model , 1982 .

[144]  J. Heckman,et al.  Does Unemployment Cause Future Unemployment? Definitions, Questions and Answers from a Continuous Time Model of Heterogeneity and State Dependence. , 1980 .

[145]  Gerard J. van den Berg,et al.  Association measures for durations in bivariate hazard rate models , 1997 .

[146]  G. J. van den Berg,et al.  Empirical inference with equilibrium search models of the labor market - A survey , 1998 .

[147]  G. V. D. Berg,et al.  Nonstationarity in job search theory , 1990 .

[148]  T. Lancaster The incidental parameter problem since 1948 , 2000 .

[149]  Richard V. Burkhauser,et al.  Work and Health after Retirement: A Competing Risks Model with Semiparametric Unobserved Heterogeneity , 1989 .

[150]  Junsen Zhang,et al.  Dynamic microeconomic models of fertility choice: A survey , 1997, Journal of population economics.

[151]  John P. Klein,et al.  Effects of model misspecification in estimating covariate effects in survival analysis for small sample sizes , 1996 .

[152]  C. F. Kossack,et al.  Rank Correlation Methods , 1949 .

[153]  J. Heckman,et al.  A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data , 1984 .

[154]  Robert J. LaLonde,et al.  The Impact of Being Offered and Receiving Classroom Training on the Employment Histories of Disadvantaged Women: Evidence from Experimental Data , 1997 .

[155]  Gerard J. van den Berg,et al.  Explicit expressions for the reservation wage path and the unemployment duration density in nonstationary job search models , 1995 .

[156]  Stephen Nickell,et al.  Modelling the process of job search , 1985 .

[157]  Glenn T. Sueyoshi,et al.  A simple approach to the identifiability of the proportional hazards model , 1990 .

[158]  D. Cox Regression Models and Life-Tables , 1972 .

[159]  D. Harrington,et al.  Counting Processes and Survival Analysis , 1991 .

[160]  Denis Fougère,et al.  Evaluating the Impact of French Employment Policies on Individual Labour Market Histories , 1997 .

[161]  Joel L. Horowitz,et al.  Semiparametric Estimation of a Proportional Hazard Model with Unobserved Heterogeneity , 1999 .

[162]  John P. Klein,et al.  ANALYSIS OF SURVIVAL DATA: A COMPARISON OF THREE MAJOR STATISTICAL PACKAGES (SAS, SPSS, BMDP) , 1995 .

[163]  Richard V. Burkhauser,et al.  Testing the relationship between work and health: A bivariate hazard model , 1986 .