Dynamic Optimal Choice When Rewards are Unbounded Below

We propose a new approach to solving dynamic decision problems with rewards that are unbounded below. The approach involves transforming the Bellman equation in order to convert an unbounded problem into a bounded one. The major advantage is that, when the conditions stated below are satisfied, the transformed problem can be solved by iterating with a contraction mapping. While the method is not universal, we show by example that many common decision problems do satisfy our conditions.

[1]  Nancy L. Stokey,et al.  Dynamic Programming with Homogeneous Functions , 1998 .

[2]  Omer Acikgoz.  On the Existence and Uniqueness of Stationary Equilibrium in Bewley Economies with Production , 2015 .

[3]  John Stachurski,et al.  Dynamic Programming Deconstructed: Transformations of the Bellman Equation and Computational Efficiency , 2018 .

[4]  Anthony A. Smith,et al.  A Comprehensive Quantitative Theory of the U . S . Wealth Distribution , 2018 .

[5]  A. Nowak,et al.  On discounted dynamic programming with unbounded returns , 2011 .

[6]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[7]  Nan Yang,et al.  Very Simple Markov-Perfect Industry Dynamics: Theory , 2017 .

[8]  C. Arellano.  Default risk and income fluctuations in emerging economies , 2008 .

[9]  Greg Kaplan,et al.  How Much Consumption Insurance Beyond Self-Insurance? , 2009 .

[10]  D. Blackwell.  Discounted Dynamic Programming , 1965 .

[11]  A. Nowak,et al.  Discounted dynamic programming with unbounded returns: Application to economic models , 2011 .

[12]  Anna Jaskiewicz,et al.  Stochastic optimal growth model with risk sensitive preferences , 2015, J. Econ. Theory.

[13]  The Macroeconomic Implications of Rising Wage Inequality in the United States , 2010, Journal of Political Economy.

[14]  Dimitri P. Bertsekas,et al.  Abstract Dynamic Programming , 2013 .

[15]  Jess Benhabib,et al.  The wealth distribution in Bewley economies with capital income risk , 2015, J. Econ. Theory.

[16]  Hugo Hopenhayn,et al.  Take the Short Route: Equilibrium Default and Debt Maturity , 2016, Econometrica.

[17]  Dan Cao.  Recursive Equilibrium in Krusell and Smith (1998) , 2019, J. Econ. Theory.

[18]  J. Stachurski,et al.  Solving the income fluctuation problem with unbounded rewards , 2014 .

[19]  Very Simple Markov-Perfect Industry Dynamics , 2013 .

[20]  John Rust.  Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher , 1987 .

[21]  Cuong Le Van,et al.  Recursive utility and optimal growth with bounded or unbounded returns , 2005, J. Econ. Theory.

[22]  John H Boud.  Recursive utility and the Ramsey problem , 1990 .

[23]  Mark Aguiar,et al.  A contraction for sovereign debt models , 2019, J. Econ. Theory.

[24]  J. Wessels.  Markov programming by successive approximations by respect to weighted supremum norms , 1976, Advances in Applied Probability.

[25]  Boyan Jovanovic.  Selection and the evolution of industry , 1981 .

[26]  J. McCall.  Economics of Information and Job Search , 1970 .

[27]  Ömer T. Açikgöz.  On the existence and uniqueness of stationary equilibrium in Bewley economies with production , 2018, J. Econ. Theory.

[28]  J. P. Rincón-Zapatero,et al.  Existence and Uniqueness of Solutions to the Bellman Equation in the Unbounded Case , 2003 .

[29]  V. Martins-da-Rocha,et al.  Existence and uniqueness of a fixed-point for local contractions , 2010 .