Optimal ergodic harvesting under ambiguity

We consider an ergodic harvesting problem with model ambiguity that arises from biology. To account for the ambiguity, the problem is constructed as a stochastic game with two players: the decision-maker (DM) chooses the ‘best’ harvesting policy and an adverse player chooses the ‘worst’ probability measure. The main result is establishing an optimal strategy (also referred to as a control) of the DM and showing that it is a threshold policy. The optimal threshold and the optimal payoff are obtained by solving a free-boundary problem emerging from the Hamilton–Jacobi–Bellman (HJB) equation. As part of the proof, we fix a gap that appeared in the HJB analysis of [Alvarez and Hening, Stochastic Process. Appl., 2019, [5]], a paper that analyzed the risk-neutral version of the ergodic harvesting problem. Finally, we study the dependence of the optimal threshold and the optimal payoff on the ambiguity parameter and show that if the ambiguity goes to 0, the problem converges, to the risk-neutral problem. AMS Classification: Primary: 93E20, 91A15, 92D25; secondary: 49J15, 60J70, 35R35.

[1]  Asaf Cohen,et al.  On Singular Control Problems, the Time-Stretching Method, and the Weak-M1 Topology , 2019, SIAM J. Control. Optim..

[2]  M. Zervos,et al.  Ergodic singular stochastic control motivated by the optimal sustainable exploitation of an ecosystem , 2020, 2008.05576.

[3]  Pascal J. Maenhout.  Robust Portfolio Rules and Asset Pricing , 2004 .

[4]  A. Xepapadeas,et al.  Model Uncertainty, Ambiguity and the Precautionary Principle: Implications for Biodiversity Management , 2008 .

[5]  Arnold Neumaier,et al.  Introduction to Numerical Analysis , 2001 .

[6]  Andrew E. B. Lim,et al.  On the optimality of threshold control in queues with model uncertainty , 2010, Queueing Syst. Theory Appl..

[7]  Marcel Nutz,et al.  ROBUST UTILITY MAXIMIZATION WITH LÉVY PROCESSES , 2015, 1502.05920.

[8]  Henry Lam,et al.  Robust rare-event performance analysis with natural non-convex constraints , 2014, Proceedings of the Winter Simulation Conference 2014.

[9]  Mihail Zervos,et al.  A singular control problem with an expected and a pathwise ergodic performance criterion , 2006 .

[10]  Alexandru Hening,et al.  Harvesting and seeding of stochastic populations: analysis and numerical approximation , 2019, Journal of mathematical biology.

[11]  Asaf Cohen,et al.  Asymptotic Analysis of a Multiclass Queueing Control Problem Under Heavy Traffic with Model Uncertainty , 2017, Stochastic Systems.

[12]  Tien T. Phan,et al.  Harvesting of interacting stochastic populations , 2018, Journal of Mathematical Biology.

[13]  A. Budhiraja,et al.  Existence of optimal controls for singular control problems with state constraints , 2006, math/0702418.

[14]  Erhan Bayraktar,et al.  Ergodicity of Robust Switching Control and Nonlinear System of Quasi-Variational Inequalities , 2015, SIAM J. Control. Optim..

[15]  Robustness , 2020, The Science of Quantitative Information Flow.

[16]  Erhan Bayraktar,et al.  Minimizing the Probability of Lifetime Ruin Under Ambiguity Aversion , 2015, SIAM J. Control. Optim..

[17]  B. Øksendal,et al.  Optimal multi-dimensional stochastic harvesting with density-dependent prices , 2014, 1406.7668.

[18]  Subhamay Saha,et al.  Asymptotic optimality of the generalized cμ rule under model uncertainty , 2020, 2004.01232.

[19]  Luis H. R. Alvarez,et al.  Singular Stochastic Control, Linear Diffusions, and Optimal Stopping: A Class of Solvable Problems , 2000, SIAM J. Control. Optim..

[20]  M. Clyde,et al.  Model Uncertainty , 2003 .

[21]  L. Alvarez.  On the option interpretation of rational harvesting planning , 2000, Journal of mathematical biology.

[22]  Amarjit Budhiraja,et al.  HJB equations for certain singularly controlled diffusions , 2007, 0711.0641.

[23]  H. Kushner.  Heavy Traffic Analysis of Controlled Queueing and Communication Networks , 2001 .

[24]  B. Øksendal,et al.  Optimal harvesting from interacting populations in a stochastic environment , 2001 .

[25]  M. K. Ghosh,et al.  Discrete-time controlled Markov processes with average cost criterion: a survey , 1993 .

[26]  Alexandru Hening,et al.  Optimal sustainable harvesting of populations in random environments , 2018, Stochastic Processes and their Applications.

[27]  Asaf Cohen,et al.  Brownian Control Problems for a Multiclass M/M/1 Queueing Problem with Model Uncertainty , 2017, Math. Oper. Res..

[28]  F. Verhulst.  Nonlinear Differential Equations and Dynamical Systems , 1989 .

[29]  Alexandru Hening,et al.  Asymptotic harvesting of populations in random environments , 2017, Journal of Mathematical Biology.

[30]  S. Shreve,et al.  An explicit formula for the Skorokhod map on [0,a]. , 2007, 0710.2977.

[31]  S. Karlin,et al.  A second course in stochastic processes , 1981 .

[32]  Michael I. Taksar,et al.  Singular ergodic control for multidimensional Gaussian processes , 1992, Math. Control. Signals Syst..

[33]  Luis H. R. Alvarez,et al.  Optimal harvesting of stochastically fluctuating populations , 1998 .

[34]  Henry Lam,et al.  Robust Sensitivity Analysis for Stochastic Systems , 2013, Math. Oper. Res..

[35]  A. Borodin,et al.  Handbook of Brownian Motion - Facts and Formulae , 1996 .

[36]  Lars Peter Hansen,et al.  Robust control and model misspecification , 2006, J. Econ. Theory.

[37]  Y. Kamarianakis.  Ergodic control of diffusion processes , 2013 .

[38]  Rein Luus,et al.  Singular control problems , 2000, Iterative Dynamic Programming.

[39]  B. Øksendal,et al.  Optimal harvesting from a population in a stochastic crowded environment. , 1997, Mathematical biosciences.

[40]  Chao Zhu,et al.  On Optimal Harvesting Problems in Random Environments , 2010, SIAM J. Control. Optim..