GMDPtoolbox: A Matlab library for designing spatial management policies. Application to the long-term collective management of an airborne disease

Designing management policies in ecology and agroecology is complex. Several components must be managed together while they strongly interact spatially. Decision choices must be made under uncertainty on the results of the actions and on the system dynamics. Furthermore, the objectives pursued when managing ecological systems or agroecosystems are usually long term objectives, such as biodiversity conservation or sustainable crop production. The framework of Graph-Based Markov Decision Processes (GMDP) is well adapted to the qualitative modeling of such problems of sequential decision under uncertainty. Spatial interactions are easily modeled and integrated control policies (combining several action levers) can be designed through optimization. The provided policies are adaptive, meaning that management actions are decided at each time step (for instance yearly) and the chosen actions depend on the current system state. This framework has already been successfully applied to forest management and invasive species management. However, up to now, no “easy-to-use” implementation of this framework was available. We present GMDPtoolbox, a Matlab toolbox which can be used both for the design of new management policies and for comparing policies by simulation. We provide an illustration of the use of the toolbox on a realistic crop disease management problem: the design of long term management policy of blackleg of canola using an optimal combination of three possible cultural levers. This example shows how GMDPtoolbox can be used as a tool to support expert thinking.

[1]  Ljusk Ola Eriksson,et al.  Management of the risk of wind damage in forestry: a graph-based Markov decision process approach , 2011, Ann. Oper. Res..

[2]  Claire A. Montgomery,et al.  Where to put things? Spatial land management to sustain biodiversity and economic returns , 2008 .

[3]  Jean-Noël Aubertot,et al.  SIPPOM-WOSR: A Simulator for Integrated Pathogen POpulation Management of phoma stem canker on Winter OilSeed Rape I. Description of the model , 2010 .

[4]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[5]  Nathalie Peyrard,et al.  A framework and a mean-field algorithm for the local control of spatial processes , 2012, Int. J. Approx. Reason..

[6]  Jesse Hoey,et al.  SPUDD: Stochastic Planning using Decision Diagrams , 1999, UAI.

[7]  Alex L. Melander Insecticide resistance management : reflections and way forward * , 2014 .

[8]  B. Tabashnik,et al.  Large-scale test of the natural refuge strategy for delaying insect resistance to transgenic Bt crops , 2014, Nature Biotechnology.

[9]  Qiang Liu,et al.  Variational Planning for Graph-based MDPs , 2013, NIPS.

[10]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[11]  Jesse Hoey,et al.  APRICODD: Approximate Policy Construction Using Decision Diagrams , 2000, NIPS.

[12]  Benjamin Van Roy,et al.  The Linear Programming Approach to Approximate Dynamic Programming , 2003, Oper. Res..

[13]  A. J. Diggle,et al.  Improved Resistance Management for Durable Disease Control: A Case Study of Phoma Stem Canker of Oilseed Rape (Brassica napus) , 2005, European Journal of Plant Pathology.

[14]  Nathalie Peyrard,et al.  Solving F3MDPs: Collaborative Multiagent Markov Decision Processes with Factored Transitions, Rewards and Stochastic Policies , 2015, PRIMA.

[15]  Christophe Le Page,et al.  Co-constructing with stakeholders a role-playing game to initiate collective management of erosive runoff risks at the watershed scale , 2010, Environ. Model. Softw..

[16]  Thierry Doré,et al.  The effects of sowing date and nitrogen availability during vegetative stages on Leptosphaeria maculans development on winter oilseed rape , 2004 .

[17]  T. S. Thind Fungicide resistance in crop protection: risk and management. , 2012 .

[18]  Barbara J. Howlett,et al.  Crop isolation, not extended rotation length, reduces blackleg (Leptosphaeria maculans) severity of canola (Brassica napus) in south-eastern Australia , 2004 .

[19]  Marie-Josée Cros,et al.  MDPtoolbox: a multi-platform toolbox to solve stochastic dynamic programming problems , 2014 .

[20]  Harold D. Coble,et al.  Call to Action on Herbicide Resistance Management , 2016, Weed Science.

[21]  Jacques Baudry,et al.  A social–ecological approach to managing multiple agro-ecosystem services , 2015 .

[22]  Hugh P. Possingham,et al.  Does conservation planning matter in a dynamic and uncertain world , 2004 .

[23]  Bruce D.L. Fitt,et al.  Epidemiology and management of Leptosphaeria maculans (phoma stem canker) on oilseed rape in Australia, Canada and Europe , 2001 .

[24]  Carlos Guestrin,et al.  Multiagent Planning with Factored MDPs , 2001, NIPS.

[25]  Hugh P. Possingham,et al.  Prioritizing global conservation efforts , 2006, Nature.

[26]  Thierry Doré,et al.  Effect of seeders and tillage equipment on vertical distribution of oilseed rape stubble , 2006 .

[27]  E. Justes,et al.  How to implement biodiversity-based agriculture to enhance ecosystem services: a review , 2015, Agronomy for Sustainable Development.

[28]  Groupe Pdmia Markov Decision Processes In Artificial Intelligence , 2009 .

[29]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[30]  Kee-Eung Kim,et al.  Solving Factored MDPs with Large Action Space Using Algebraic Decision Diagrams , 2002, PRICAI.