On the uncertainty and confidence in decision support tools (DSTs) with insights from the Baltic Sea ecosystem

Ecosystems around the world are increasingly exposed to multiple, often interacting human activities, leading to pressures and possibly environmental state changes. Decision support tools (DSTs) can assist environmental managers and policy makers to evaluate the current status of ecosystems (i.e. assessment tools) and the consequences of alternative policies or management scenarios (i.e. planning tools) to make the best possible decision based on prevailing knowledge and uncertainties. However, to be confident in DST outcomes it is imperative that known sources of uncertainty such as sampling and measurement error, model structure, and parameter use are quantified, documented, and addressed throughout the DST set-up, calibration, and validation processes. Here we provide a brief overview of the main sources of uncertainty and methods currently available to quantify uncertainty in DST input and output. We then review 42 existing DSTs that were designed to manage anthropogenic pressures in the Baltic Sea to summarise how and what sources of uncertainties were addressed within planning and assessment tools. Based on our findings, we recommend future DST development to adhere to good modelling practise principles, and to better document and communicate uncertainty among stakeholders.

[1]  Johanna Schumacher,et al.  Decision-Support Tools Used in the Baltic Sea Area: Performance and End-User Preferences , 2020, Environmental Management.

[2]  Joseph H. A. Guillaume,et al.  Characterising performance of environmental models , 2013, Environ. Model. Softw..

[3]  Dennis Prangle,et al.  Taking error into account when fitting models using Approximate Bayesian Computation. , 2018, Ecological applications : a publication of the Ecological Society of America.

[4]  Anthony J. Jakeman,et al.  Ten iterative steps in development and evaluation of environmental models , 2006, Environ. Model. Softw..

[5]  C. Chatfield Model uncertainty, data mining and statistical inference , 1995 .

[6]  Andrew J Davies,et al.  Bayesian inference-based environmental decision support systems for oil spill response strategy selection. , 2015, Marine pollution bulletin.

[7]  Peter A. Vanrolleghem,et al.  Uncertainty in the environmental modelling process - A framework and guidance , 2007, Environ. Model. Softw..

[8]  Annukka Lehikoinen,et al.  Incorporating stakeholders' values into environmental decision support: A Bayesian Belief Network approach. , 2019, The Science of the total environment.

[9]  M. G. Morgan Use (and abuse) of expert elicitation in support of decision making for public policy , 2014, Proceedings of the National Academy of Sciences.

[10]  J. Gareth Polhill,et al.  The ODD protocol: A review and first update , 2010, Ecological Modelling.

[11]  Daniel J. Conley,et al.  Ecology: Save the Baltic Sea , 2012, Nature.

[12]  E J Milner-Gulland,et al.  Embracing uncertainty in applied ecology. , 2017, The Journal of applied ecology.

[13]  T. Sullivan EVALUATING ENVIRONMENTAL DECISION SUPPORT TOOLS. , 2004 .

[14]  Gerard B. M. Heuvelink,et al.  A probabilistic framework for representing and simulating uncertain environmental variables , 2007, Int. J. Geogr. Inf. Sci..

[15]  Laura Uusitalo,et al.  An overview of methods to evaluate uncertainty of deterministic models in decision support , 2015, Environ. Model. Softw..

[16]  Urmila Jha-Thakur,et al.  Managing uncertainties through scenario analysis in strategic environmental assessment , 2019 .

[17]  S. Carpenter,et al.  Planetary boundaries: Guiding human development on a changing planet , 2015, Science.

[18]  Volker Grimm,et al.  Ecological models supporting environmental decision making: a strategy for the future. , 2010, Trends in ecology & evolution.

[19]  Berit Hasler,et al.  The Baltic Sea as a time machine for the future coastal ocean , 2018, Science Advances.

[20]  G. Malescio Coping with uncertainty , 2006, Nature.

[21]  Warren E. Walker,et al.  Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support , 2003 .

[22]  Daniel McNeish,et al.  On Using Bayesian Methods to Address Small Sample Problems , 2016 .

[23]  Jacob Carstensen,et al.  Confidence in ecological indicators: A framework for quantifying uncertainty components from monitoring data , 2016 .

[24]  Helen M. Regan,et al.  A TAXONOMY AND TREATMENT OF UNCERTAINTY FOR ECOLOGY AND CONSERVATION BIOLOGY , 2002 .

[25]  K. Hüssy,et al.  Eastern Baltic cod in distress biological changes and challenges for stock assessment , 2015 .

[26]  K. Casey,et al.  Spatial and temporal changes in cumulative human impacts on the world's ocean , 2015, Nature Communications.

[27]  Efstathios Tapinos,et al.  Perceived environmental uncertainty in scenario planning , 2012 .

[28]  Kevin Stokes,et al.  Coping with uncertainty in ecological advice: lessons from fisheries , 2003 .

[29]  Victoria Marie Conlu Embracing Uncertainty. , 2015, Imprint.

[30]  David J. Spiegelhalter,et al.  Communicating uncertainty about facts, numbers and science , 2019, Royal Society Open Science.

[31]  Emanuele Borgonovo,et al.  Sensitivity Analysis in Decision Making , 2013 .

[32]  Xiao Feng,et al.  A standard protocol for reporting species distribution models , 2020, Ecography.