Beyond stochastic dynamic programming: a heuristic sampling method for optimizing conservation decisions in very large state spaces

1. When managing endangered species the consequences of making a poor decision can be extinction. To make a good decision, we must account for the stochastic dynamic of the population over time. To this end stochastic dynamic programming (SDP) has become the most widely used tool to calculate the optimal policy to manage a population over time and under uncertainty.

[1]  C. Walters.  Optimal Harvest Strategies for Salmon in Relation to Environmental Variability and Uncertain Production Parameters , 1975 .

[2]  R. Hilborn,et al.  Optimal Exploitation of Multiple Stocks by a Common Fishery: A New Methodology , 1976 .

[3]  H. Possingham,et al.  The mathematics of designing a network of protected areas for conservation , 1993 .

[4]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[5]  Hugh P. Possingham,et al.  A Stochastic Metapopulation Model with Variability in Patch Size and Position , 1995 .

[6]  R. Wheeler,et al.  Effect of Age at Release on the Susceptibility of Captive-reared Malleefowl Leipoa ocellata to Predation by the Introduced Fox Vulpes vulpes , 1996 .

[7]  Bruce C. Lubow.  Optimal Translocation Strategies for Enhancing Stochastic Metapopulation Viability , 1996 .

[8]  C. T. Moore,et al.  Uncertainty and the management of mallard harvests , 1997 .

[9]  R. Wheeler,et al.  Efficacy of Fox Control in Reducing the Mortality of Released Captive-reared Malleefowl, Leipoa ocellata , 1997 .

[10]  Hugh P. Possingham,et al.  OPTIMAL FIRE MANAGEMENT FOR MAINTAINING COMMUNITY DIVERSITY , 1999 .

[11]  B. Roitberg,et al.  Stochastic variation in food availability influences weight and age at maturity. , 2000, Journal of theoretical biology.

[12]  Hugh P. Possingham,et al.  Marine protected areas for spatially structured exploited stocks , 2000 .

[13]  Hugh P. Possingham,et al.  Optimal release strategies for biological control agents: an application of stochastic dynamic programming to population management , 2000 .

[14]  K. Rose,et al.  The effectiveness of a large-scale baiting campaign and an evaluation of a buffer zone strategy for fox control , 2000 .

[15]  S. Andelman,et al.  Making smart conservation decisions , 2001 .

[16]  A. Gill,et al.  Using stochastic dynamic programming to determine optimal fire management for Banksia ornata , 2001 .

[17]  C. Clark,et al.  Dynamic State Variable Models in Ecology: Methods and Applications , 2001 .

[18]  Wayne M. Getz,et al.  The use of stochastic dynamic programming in optimal landscape reconstruction for metapopulations , 2003 .

[19]  Hugh P. Possingham,et al.  Optimizing reserve expansion for disjunct populations of San Joaquin kit fox , 2004 .

[20]  Frédérick Garcia,et al.  On-Line Search for Solving Markov Decision Processes via Heuristic Sampling , 2004, ECAI.

[21]  S. Polasky,et al.  Dynamic reserve site selection , 2004 .

[22]  R. Armstrong.  Baiting operations: Western Shield review—February 2003 , 2004 .

[23]  Captive breeding programs and their contribution to Western Shield: Western Shield review—February 2003 , 2004 .

[24]  Hugh P. Possingham,et al.  Does conservation planning matter in a dynamic and uncertain world , 2004 .

[25]  C. Hunter,et al.  THE IMPORTANCE OF ENVIRONMENTAL VARIABILITY AND MANAGEMENT CONTROL ERROR TO OPTIMAL HARVEST POLICIES , 2004 .

[26]  Daniel Spring,et al.  Existence value and optimal timber-wildlife management in a flammable multistand forest , 2005 .

[27]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[28]  Hugh P. Possingham,et al.  Prioritizing global conservation efforts , 2006, Nature.

[29]  Peter W J Baxter,et al.  Optimal eradication: when to stop looking for an invasive plant. , 2006, Ecology letters.

[30]  Bo Jellesmark Thorsen,et al.  Optimal reserve selection in a dynamic world , 2006 .

[31]  Hugh P. Possingham,et al.  Minimise long-term loss or maximise short-term gain? Optimal translocation strategies for threatened species , 2007 .

[32]  H. Possingham,et al.  Cost-effective global conservation spending is robust to taxonomic group , 2008, Proceedings of the National Academy of Sciences.

[33]  H. Possingham,et al.  The need for speed: informed land acquisitions for conservation in a dynamic property market. , 2008, Ecology letters.

[34]  Katriona Shea,et al.  A state-dependent model for the optimal management of an invasive metapopulation. , 2008, Ecological applications : a publication of the Ecological Society of America.

[35]  Emanuel Todorov,et al.  Efficient computation of optimal actions , 2009, Proceedings of the National Academy of Sciences.

[36]  Nicklas Forsell,et al.  Planning Under Risk and Uncertainty: Optimizing Spatial Forest Management Strategies , 2009 .

[37]  Hugh P Possingham,et al.  Should metapopulation restoration strategies increase patch area or number of patches? , 2010, Ecological applications : a publication of the Ecological Society of America.

[38]  P. Schrimpf,et al.  Dynamic Programming , 2011 .

[39]  Ljusk Ola Eriksson,et al.  Management of the risk of wind damage in forestry: a graph-based Markov decision process approach , 2011, Ann. Oper. Res..