DPSIM Modelling: Dynamic Optimization in Large Scale Simulation Models

Although it is well established that dynamically optimal policies should be “closed loop” so that policies take into account changing conditions of a system, it is rare for such optimization to actually be carried out in large-scale simulation models. Computational limitations remain a major barrier to the study of dynamically optimal policies. Since the size of dynamic optimization problems grows approximately geometrically with the state space, this problem will continue to inhibit the identification of dynamically optimal policies for the foreseeable future. In this chapter, we explore in detail the problem of solving dynamic optimization problems for large-scale simulation models and consider methods to work around the computational barriers. We show that a reasonable approach is to solve a small-scale problem to identify an approximate value function that can then be embedded directly in the simulation model to find approximately optimal time-paths. We present and compare two ways to specify the small-scale problem: a traditional “meta-modelling” approach, and a new “direct approach” in which the simulation model is embedded directly in the dynamic optimization algorithm. The methods are employed in a model of the Gulf of Mexico’s red snapper fishery and used to identify the dynamically optimal total allowable catch for the recreational and commercial sectors of the fishery.

[1]  G. Cornelis van Kooten,et al.  A Safety-First Approach to Dynamic Cropping Decisions , 1997 .

[2]  K. Judd Numerical methods in economics , 1998 .

[3]  Ronald D. Lacewell,et al.  An Intraseasonal Dynamic Optimization Model to Allocate Irrigation Water between Crops , 1993 .

[4]  M. Mrkaić Policy iteration accelerated with Krylov methods , 2002 .

[5]  Jon M. Conrad,et al.  Kennedy, John O. S. Dynamic Programming Applications to Agriculture and Natural Resources. London: Elsevier Applied Science Publishers, 1986, xv + 341 pp., $76.00 , 1987 .

[6]  Wen-Yuan Huang,et al.  ECONOMIC AND ENVIRONMENTAL FEASIBILITY OF VARIABLE RATE NITROGEN FERTILIZER APPLICATION WITH CARRY-OVER EFFECTS , 1998 .

[7]  S. Kauffman,et al.  Dealing with the Complexity of Economic Calculations , 1997 .

[8]  D. Bertsekas,et al.  Dynamic Programming and Stochastic Control , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  John Rust Using Randomization to Break the Curse of Dimensionality , 1997 .

[10]  Teofilo Ozuna,et al.  A Bioeconomic Assessment of Gulf of Mexico Red Snapper Management Policies , 2001 .

[11]  J. P. Nichols,et al.  Bioeconomic Modeling of the Gulf Shrimp Fishery: An Application to Galveston Bay and Adjacent Offshore Areas , 1978, Journal of Agricultural and Applied Economics.

[12]  Wade L. Griffin,et al.  A general bioeconomic simulation model for annual-crop marine fisheries , 1981 .

[13]  R. Bellman FUNCTIONAL EQUATIONS IN THE THEORY OF DYNAMIC PROGRAMMING. V. POSITIVITY AND QUASI-LINEARITY. , 1955, Proceedings of the National Academy of Sciences of the United States of America.

[14]  D. H. Noble Dynamic Programming: Applications to Agriculture and Natural Resources , 1988 .

[15]  R. Schaller,et al.  Moore's law: past, present and future , 1997 .

[16]  Wade L. Griffin,et al.  Living with the Curse of Dimensionality: Closed‐Loop Optimization in a Large‐Scale Fisheries Simulation Model , 2005 .