Another Look at the Identification of Dynamic Discrete Decision Processes

This paper presents an econometric approach to estimate the behavioral effects of counterfactual policy experiments in the context of dynamic decision models where the current utility function and the distribution of unobservables are nonparametrically specified. Previous studies have shown that the identification of the current utility function in dynamic decision models requires of stronger assumptions than in static decision models. We show in this paper that knowledge of the current utility function (or of a 'normalized' utility function) is not necessary to identify counterfactual choice probabilities in dynamic models. To identify these counterfactuals we need the probability distribution of the unobservables and the difference between the present value of choosing always the same alternative and the present value of deviating one period from this strategy. We show that both functions are identified from the factual choice probabilities under similar conditions as in static decision models. Based on this result we propose a nonparametric procedure to estimate the behavioral effects of counterfactual experiments in dynamic decision models. We apply this method to evaluate the effects of an investment subsidy program in the context of a model of machine replacement.

[1]  C. Manski.  Dynamic choice in social settings: Learning from the experiences of others , 1993 .

[2]  Robert A. Moffitt,et al.  Institute for Research on Poverty Discussion Paper no. 1080-96 A Structural Model of Multiple Welfare Program Participation and Labor Supply , 1996 .

[3]  Edward Vytlacil,et al.  Local Instrumental Variables , 2000 .

[4]  Paola Rota,et al.  Estimating Labor Demand with Fixed Costs , 2004 .

[5]  John Rust.  DYNAMIC STRUCTURAL MODELS OF RETIREMENT AND DISABILITY , 2003 .

[6]  Antti Valmari,et al.  Stubborn sets for reduced state space generation , 1991, Applications and Theory of Petri Nets.

[7]  John Rust,et al.  How Social Security and Medicare affect retirement behavior in a world of incomplete markets , 1994 .

[8]  J J Heckman,et al.  Local instrumental variables and latent variable models for identifying and bounding treatment effects. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Russell Cooper,et al.  Machine Replacement and the Business Cycle: Lumps and Bumps , 1995 .

[10]  D. McFadden.  Econometric Models of Probabilistic Choice , 1981 .

[11]  Charles F. Manski,et al.  The Selection Problem , 1990 .

[12]  Kenneth I. Wolpin,et al.  The Effect of Parental Transfers and Borrowing Constraints On Educational Attainment , 1999 .

[13]  J. Heckman,et al.  Longitudinal Analysis of Labor Market Data: Alternative methods for evaluating the impact of interventions , 1985 .

[14]  Kenneth I. Wolpin,et al.  Public-Policy Uses of Discrete-Choice Dynamic Programming Models , 1996 .

[15]  Sanghamitra Das,et al.  A Micro-Econometric Model of Capital Utilization and Retirement: The Case of the U.S. Cement Industry , 1992 .

[16]  Christopher Ferrall,et al.  Unemployment Insurance Eligibility and the School-to-Work Transition in Canada and the United States , 1997 .

[17]  Han Hong,et al.  Semiparametric Estimation of a Dynamic Game of Incomplete Information , 2006 .

[18]  C. Manski.  Anatomy of the Selection Problem , 1989 .

[19]  H. Dette,et al.  A simple nonparametric estimator of a monotone regression function , 2003 .

[20]  Christopher R. Taber.  Semiparametric identification and heterogeneity in discrete choice dynamic programming models , 2000 .

[21]  D. Mark Kennet,et al.  A Structural Model of Aircraft Engine Maintenance , 1994 .

[22]  Ariel Pakes,et al.  Patent Renewal Data , 1989 .

[23]  T. Magnac,et al.  Identifying Dynamic Discrete Decision Processes , 2002 .

[24]  M. Keane,et al.  Estimating Welfare Effects Consistent with Forward-Looking Behavior. Part I: Lessons from a Simulation Exercise , 2000 .

[25]  Jerome Adda,et al.  Balladurette and Juppette: A Discrete Analysis of Scrapping Subsidies , 1997, Journal of Political Economy.

[26]  D. Kennet,et al.  Did Deregulation Affect Aircraft Engine Maintenance? An Empirical Policy Analysis , 1993 .

[27]  Zvi Eckstein,et al.  Why Youths Drop out of High School: The Impact of Preferences , 1999 .

[28]  Victor Aguirregabiria,et al.  Swapping the Nested Fixed-Point Algorithm: a Class of Estimators for Discrete Markov Decision Models , 2002 .

[29]  M. Keane,et al.  Estimating Welfare Effects Consistent with Forward-Looking Behavior. Part Ii: Empirical Results , 2000 .

[30]  Sumru Altug,et al.  The Effect of Work Experience on Female Wages and Labour Supply , 1998 .

[31]  Sanghamitra Das.  A Micro Econometric Model of Capital Utilization and Retirement , 1990 .

[32]  James J. Heckman,et al.  Alternative methods for evaluating the impact of interventions: An overview , 1985 .

[33]  Geoffrey Rothwell,et al.  Optimal Response to a Shift in Regulatory Regime: The Case of the US Nuclear Power Industry , 1995 .

[34]  John Rust,et al.  When Is It Optimal to Kill Off the Market for Used Durable Goods , 1986 .

[35]  Anders Karlström,et al.  A dynamic programming approach to model the retirement behaviour of blue-collar workers in Sweden , 2004 .

[36]  Steven Stern,et al.  Job Exit Behavior of Older Men , 1991 .

[37]  James J. Heckman,et al.  Estimating treatment effects for discrete outcomes when responses to treatment vary: an application to Norwegian vocational rehabilitation programs , 2005 .

[38]  V. J. Hotz,et al.  Conditional Choice Probabilities and the Estimation of Dynamic Models , 1993 .

[39]  John Rust.  Structural estimation of markov decision processes , 1986 .

[40]  Nonparametric Identification of Behavioral Responses to Counterfactual Policy Interventions in Dynamic Discrete Decision Processes , 2005 .

[41]  Petra E. Todd,et al.  Using a Social Experiment to Validate a Dynamic Behavioral Model of Child Schooling and Fertility: Assessing the Impact of a School Subsidy Program in Mexico , 2003 .

[42]  Z. Eckstein,et al.  The Effects of Compulsory Schooling on Growth, Income Distribution and Welfare , 1994 .

[43]  C. Manski.  Nonparametric Bounds on Treatment Effects , 1989 .

[44]  Enno Mammen,et al.  Estimating a Smooth Monotone Regression Function , 1991 .

[45]  Jeffrey A. Smith,et al.  Evaluating the Welfare State , 1998 .

[46]  John Rust.  Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher , 1987 .

[47]  Hari Mukerjee,et al.  Monotone Nonparametric Regression , 1988 .

[48]  Malte Helmert,et al.  The Fast Downward Planning System , 2006, J. Artif. Intell. Res..

[49]  Robert A. Miller,et al.  Human capital development and welfare participation , 1997 .

[50]  F. T. Wright,et al.  Order restricted statistical inference , 1988 .

[51]  P. Hall,et al.  NONPARAMETRIC KERNEL REGRESSION SUBJECT TO MONOTONICITY CONSTRAINTS , 2001 .