Optimal investment models with vintage capital: Dynamic programming approach

The dynamic programming approach for a family of optimal investment models with vintage capital is here developed. The problem falls into the class of infinite horizon optimal control problems of PDE's with age structure that have been studied in various papers ([Barucci and Gozzi, 1998], [Barucci and Gozzi, 2001], [Feichtinger et al., 2003] and [Feichtinger et al., 2006]) either in cases when explicit solutions can be found or using Maximum Principle techniques. The problem is rephrased into an infinite dimensional setting, it is proven that the value function is the unique regular solution of the associated stationary Hamilton-Jacobi-Bellman equation, and existence and uniqueness of optimal feedback controls is derived. It is then shown that the optimal path is the solution to the closed loop equation. Similar results were proven in the case of finite horizon by (Faggian, 2005b) and (Faggian, 2008a). The case of infinite horizon is more challenging as a mathematical problem, and indeed more interesting from the point of view of optimal investment models with vintage capital, where what mainly matters is the behavior of optimal trajectories and controls in the long run. Finally it is explained how the results can be applied to improve the analysis of the optimal paths previously performed by Barucci and Gozzi and by Feichtinger et al.

[1]  Jonathan P. Caulkins,et al.  An age-structured single-state drug initiation model--cycles of drug epidemics and optimal prevention programs , 2004 .

[2]  V. Barbu,et al.  Hamilton-Jacobi equations in Hilbert spaces; variational and semigroup approach , 1985 .

[3]  Fausto Gozzi.  Some results for an infinite horizon control problem governed by a semilinear state equation. , 1989 .

[4]  K. Brown,et al.  Graduate Texts in Mathematics , 1982 .

[5]  H. Soner,et al.  A Dynamic Programming Approach to Nonlinear Boundary Control Problems of Parabolic Type , 1993 .

[6]  P. Lions,et al.  Viscosity solutions of Hamilton-Jacobi equations in infinite dimensions. IV: Hamiltonians with unbounded linear terms , 1990 .

[7]  Emilio Barucci,et al.  Technology adoption and accumulation in a vintage-capital model , 2001 .

[8]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[9]  Paolo Acquistapace,et al.  Infinite-horizon linear-quadratic regulator problems for nonautonomous parabolic systems with boundary control , 1996 .

[10]  Paolo Acquistapace,et al.  Classical Solutions of Nonautonomous Riccati Equations Arising in Parabolic Boundary Control Problems , 1999 .

[11]  Silvia Faggian.  Boundary control problems with convex cost and dynamic programming in infinite dimension part II: Existence for HJB , 2004 .

[12]  G. Di Blasio.  Global solutions for a class of Hamilton-Jacobi equations in Hilbert spaces , 1986 .

[13]  G. Di Blasio.  Optimal control with infinite horizon for distributed parameter systems with constrained controls , 1991 .

[14]  Fausto Gozzi,et al.  ON THE DYNAMIC PROGRAMMING APPROACH FOR OPTIMAL CONTROL PROBLEMS OF PDE'S WITH AGE STRUCTURE , 2004 .

[15]  Fausto Gozzi,et al.  Solving optimal growth models with vintage capital: The dynamic programming approach , 2008, J. Econ. Theory.

[16]  Oscillatory and asymptotic behavior of second order functional differential equations , 1979 .

[17]  Xun Yu Zhou,et al.  Erratum: "A Corrected Proof of the Stochastic Verification Theorem within the Framework of Viscosity Solutions" , 2010, SIAM J. Control. Optim..

[18]  E. Wagner.  International Series of Numerical Mathematics , 1963 .

[19]  Piermarco Cannarsa,et al.  Infinite-Dimensional Hamilton--Jacobi Equations and Dirichlet Boundary Control Problems of Parabolic Type , 1996 .

[20]  Silvia Faggian,et al.  Regular Solutions of First-Order Hamilton–Jacobi Equations for Boundary Control Problems and Applications to Economics , 2005 .

[21]  P. Lions,et al.  Hamilton-Jacobi equations in infinite dimensions. II. Existence of viscosity solutions , 1986 .

[22]  P. Lions,et al.  Hamilton-Jacobi Equations in Infinite Dimensions. Part 1. Uniqueness of Viscosity Solutions, , 1984 .

[23]  Silvia Faggian,et al.  Boundary-control problems with convex cost and dynamic programming in infinite dimension. I. The maximum principle , 2004, Differential and Integral Equations.

[24]  Peter M. Kort,et al.  Anticipation effects of technological progress on capital accumulation: a vintage capital approach , 2006, J. Econ. Theory.

[25]  Irena Lasiecka,et al.  Abstract parabolic systems , 2000 .

[26]  Silvia Faggian,et al.  Hamilton--Jacobi Equations Arising from Boundary Control Problems with State Constraints , 2008, SIAM J. Control. Optim..

[27]  M. Crandall,et al.  Hamilton-Jacobi Equations in Infinite Dimensions , 2003 .

[28]  P. Lions,et al.  Hamilton-Jacobi equations in infinite dimensions, III , 1986 .

[29]  Giuseppe Da Prato,et al.  Stochastic Partial Differential Equations and Applications - VII , 2005 .

[30]  David L. Russel.  Representation and Control of Infinite Dimensional Systems, Vols. 1 and 2 (A. Bensonssan, G. Da Prato, M. Delfour, and S. Mitter) , 1995, SIAM Rev..

[31]  Silvia Faggian,et al.  Maximum Principle for Boundary Control Problems Arising in Optimal Investment with Vintage Capital , 2008 .

[32]  Giuseppe Da Prato,et al.  Hamilton-Jacobi equations in Hilbert spaces , 1983 .

[33]  P. Acquistapace,et al.  Classical Solutions of Nonautonomous Riccati Equations Arising in Parabolic Boundary Control Problems, II , 2000 .

[34]  Varadarajan V. Chari,et al.  Vintage Human Capital, Growth, and the Diffusion of New Technology , 1991, Journal of Political Economy.

[35]  S. Faggian.  Equilibrium points for Optimal Investment with Vintage Capital , 2007, 0712.0025.

[36]  R. Hartl,et al.  Dynamic Optimal Control Models in Advertising: Recent Developments , 1994 .

[37]  F. Flandoli,et al.  Initial boundary value problems and optimal control for nonautonomous parabolic systems , 1991 .

[38]  S. Dietze.  Barbu, V./Precupanu, Th., Convexity and Optimization in Banach Spaces. Bucuresti. Editura Academiei. Alphen an de Rijn. Sijthoff & Noordhoff Intern. Publ. 1978. XI, 316 S., Dfl. 60.00. $ 28.00 , 1979 .

[39]  S. Faggian.  Maximum Principle for Linear-Convex Boundary Control Problems applied to Optimal Investment with Vintage Capital. , 2007, 0711.3694.

[40]  Emilio Barucci,et al.  Investment in a vintage capital model , 1998 .

[41]  J. Craggs.  Applied Mathematical Sciences , 1973 .

[42]  Viorel Barbu,et al.  Existence and uniqueness of the dynamic programming equation in Hilbert space , 1983 .

[43]  R. Triggiani,et al.  Control Theory for Partial Differential Equations: Continuous and Approximation Theories , 2000 .

[44]  R. Nagel,et al.  One-parameter semigroups for linear evolution equations , 1999 .

[45]  Alain Bensoussan,et al.  Representation and Control of Infinite Dimensional Systems (Systems & Control: Foundations & Applications) , 2006 .

[46]  Peter M. Kort,et al.  Dynamic Investment Behavior Taking into Account Ageing of the Capital Good , 2001 .

[47]  Carlo Marinelli,et al.  Stochastic optimal control of delay equations arising in advertising models , 2004, math/0412403.

[48]  Viorel Barbu,et al.  A note on a Hamilton-Jacobi equation in Hilbert space , 1985 .

[49]  P. Lions,et al.  Hamilton-Jacobi equations in infinite dimensions I. Uniqueness of viscosity solutions , 1985 .

[50]  V. Barbu,et al.  Convexity and optimization in banach spaces , 1972 .

[51]  Aldo Rustichini,et al.  Vintage capital, investment, and growth , 1991 .

[52]  乔花玲,et al.  关于Semigroups of Linear Operators and Applications to Partial Differential Equations的两个注解 , 2003 .

[53]  Silvia Faggian.  Applications of dynamic programming to economic problems with vintage capital , 2008 .

[54]  Vladimir M. Veliov,et al.  Optimality conditions for age-structured control systems☆ , 2003 .

[55]  Piermarco Cannarsa,et al.  A direct approach to infinite-dimensional Hamilton-Jacobi equations and applications to convex control with state constraints , 1995, Differential and Integral Equations.

[56]  Xun Yu Zhou,et al.  A Corrected Proof of the Stochastic Verification Theorem within the Framework of Viscosity Solutions , 2005, SIAM J. Control. Optim..

[57]  Irena Lasiecka,et al.  Abstract hyperbolic-like systems over a finite time horizon , 2000 .

[58]  Raouf Boucekkine,et al.  Vintage capital and the dynamics of the AK model , 2005, J. Econ. Theory.

[59]  Fausto Gozzi.  Some results for an optimal control problem with semilinear state equation , 1991 .