Uncertainty analysis in integrated environmental models for ecosystem service assessments: Frameworks, challenges and gaps

Integrated Environmental Models (IEMs) incorporating ecosystem services (ES) can be useful tools to support the decision-making. However, their successful application strongly depends upon the confidence decision-makers can place in their outputs. Uncertainty analysis (UA), including uncertainty location, identification, characterization, treatment and communication to decision-makers, can increase their confidence in the used model. To support the use of UA in practice we first focus on the purpose, concepts and methods underpinning UA in environmental modelling. As a main contribution, we then review existing UA frameworks and their coverage, before reviewing the current practice of performing UA for a set of 25 IEM tools. Based on our review we derive and discuss four perceived challenges and gaps whose significance may vary in different contexts: (1) the lack of consensus on terminologies for uncertainty locations; (2) characterization of uncertainty locations beyond variables; (3) treatment of heterogeneous uncertainty; and (4) the lack of a practical framework toward uncertainty communication. We suggest some steps forward for each of these challenges aiming at facilitating the application of UA to IEMs.

[1]  Hauke Riesch.  Levels of Uncertainty , 2013 .

[2]  Bernard P. Zeigler,et al.  Theory of Modeling and Simulation: Integrating Discrete Event and Continuous Complex Dynamic Systems , 2000 .

[3]  Jan Rotmans,et al.  Uncertainty in Integrated Assessment Modelling , 2002 .

[4]  Reinout Heijungs,et al.  Methods for uncertainty propagation in life cycle assessment , 2014, Environ. Model. Softw..

[5]  S. Schneider,et al.  Climate change policy: quantifying uncertainties for damages and optimal carbon taxes , 1999 .

[6]  Paola Annoni,et al.  Sixth International Conference on Sensitivity Analysis of Model Output How to avoid a perfunctory sensitivity analysis , 2010 .

[7]  J. Farley,et al.  SPECIAL ISSUE: The Dynamics and Value of Ecosystem Services: Integrating Economic and Ecological Perspectives Modeling the dynamics of the integrated earth system and the value of global ecosystem services using the GUMBO model , 2002 .

[8]  Adam J. Vanbergen,et al.  Frontiers inEcology and the Environment Threats to an ecosystem service : pressures on pollinators , 2013 .

[9]  A. Troy,et al.  Mapping ecosystem services: Practical challenges and opportunities in linking GIS and value transfer , 2006 .

[10]  Joseph H. Tarnecki,et al.  Diet composition uncertainty determines impacts on fisheries following an oil spill , 2018, Ecosystem Services.

[11]  Peter A. Vanrolleghem,et al.  Uncertainty in the environmental modelling process - A framework and guidance , 2007, Environ. Model. Softw..

[12]  Shakhawat Chowdhury,et al.  Uncertainty characterization approaches for risk assessment of DBPs in drinking water: a review. , 2009, Journal of environmental management.

[13]  Ann-Margaret Esnard,et al.  An integrated multi-criteria scenario evaluation web tool for participatory land-use planning in urbanized areas: The Ecosystem Portfolio Model , 2013, Environ. Model. Softw..

[14]  Jack P. C. Kleijnen,et al.  Techniques for sensitivity analysis of simulation models: A case study of the CO2 greenhouse effect , 1992, Simul..

[15]  Bernard Krzykacz-Hausmann.  An approximate sensitivity analysis of results from complex computer models in the presence of epistemic and aleatory uncertainties , 2006, Reliab. Eng. Syst. Saf..

[16]  George Z. Gertner,et al.  Extending a global sensitivity analysis technique to models with correlated parameters , 2007, Comput. Stat. Data Anal..

[17]  Wim J. de Lange,et al.  Uncertainty Matters: Computer Models at the Science–Policy Interface , 2007 .

[18]  S. Carpenter,et al.  Decision-making under great uncertainty: environmental management in an era of global change. , 2011, Trends in ecology & evolution.

[19]  Les Kaufman,et al.  The Multiscale Integrated Model of Ecosystem Services (MIMES): Simulating the interactions of coupled human and natural systems , 2015 .

[20]  Alexey Voinov,et al.  A review of methods, data, and models to assess changes in the value of ecosystem services from land degradation and restoration , 2016 .

[21]  R. Lempert,et al.  What are robust strategies in the face of uncertain climate threshold responses? , 2012, Climatic Change.

[22]  Jeroen P. van der Sluijs,et al.  A framework for dealing with uncertainty due to model structure error , 2004 .

[23]  James D. Brown.  Knowledge, uncertainty and physical geography: towards the development of methodologies for questioning belief , 2004 .

[24]  Keith Beven,et al.  Facets of uncertainty: epistemic uncertainty, non-stationarity, likelihood, hypothesis testing, and communication , 2016 .

[25]  Andrew Stirling,et al.  Keep it complex , 2010, Nature.

[26]  George Z. Gertner,et al.  Uncertainty and sensitivity analysis for models with correlated parameters , 2008, Reliab. Eng. Syst. Saf..

[27]  Alexander J. Henshaw,et al.  Polyscape: A GIS mapping framework providing efficient and spatially explicit landscape-scale valuation of multiple ecosystem services , 2013 .

[28]  Elinor Ostrom,et al.  Coupled Human and Natural Systems , 2007, Ambio.

[29]  Didier Dubois,et al.  Possibility Theory, Probability Theory and Multiple-Valued Logics: A Clarification , 2001, Annals of Mathematics and Artificial Intelligence.

[30]  Stefano Nativi,et al.  Environmental model access and interoperability: The GEO Model Web initiative , 2013, Environ. Model. Softw..

[31]  Jan Rotmans,et al.  Image: An Integrated Model to Assess the Greenhouse Effect , 1990 .

[32]  Keith C. Clarke,et al.  Testing Popular Visualization Techniques for Representing Model Uncertainty , 2003 .

[33]  Barry B. Hughes,et al.  The International Futures (IFs) Modeling Project , 1999 .

[34]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[35]  G. Daily,et al.  Modeling multiple ecosystem services, biodiversity conservation, commodity production, and tradeoffs at landscape scales , 2009 .

[36]  P. Gleick,et al.  Systems integration for global sustainability , 2015, Science.

[37]  Keith Beven,et al.  Communicating uncertainty in flood inundation mapping: a case study , 2015 .

[38]  Michael D. McKay,et al.  Latin hypercube sampling as a tool in uncertainty analysis of computer models , 1992, WSC '92.

[39]  D. Kirschner,et al.  A methodology for performing global uncertainty and sensitivity analysis in systems biology. , 2008, Journal of theoretical biology.

[40]  O. J. Vrieze,et al.  Metamodelling and experimental design: Case study of the greenhouse effect , 1990 .

[41]  Terje Aven,et al.  Some reflections on uncertainty analysis and management , 2010, Reliab. Eng. Syst. Saf..

[42]  William D. Nordhaus,et al.  A Regional Dynamic General-Equilibrium Model of Alternative Climate-Change Strategies , 1996 .

[43]  L. Corominas,et al.  Analysis of the uncertainty in the monetary valuation of ecosystem services--A case study at the river basin scale. , 2016, The Science of the total environment.

[44]  Roger D. Braddock,et al.  Sensitivity analysis of the IMAGE Greenhouse model , 1999, Environ. Model. Softw..

[45]  George J. Klir,et al.  Uncertainty Modeling and Analysis in Engineering and the Sciences (Hardcover) , 2006 .

[46]  E. Zio,et al.  A Combined Monte Carlo and Possibilistic Approach to Uncertainty Propagation in Event Tree Analysis , 2008, Risk analysis : an official publication of the Society for Risk Analysis.

[47]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[48]  Phan Hong Giang,et al.  Decision making under uncertainty comprising complete ignorance and probability , 2015, Int. J. Approx. Reason..

[49]  Enrico Zio,et al.  Some considerations on the treatment of uncertainties in risk assessment for practical decision making , 2011, Reliab. Eng. Syst. Saf..

[50]  J. A. Wardekker,et al.  Uncertainty communication in environmental assessments: views from the Dutch science-policy interface , 2008 .

[51]  D. Semmens,et al.  A GIS application for assessing, mapping, and quantifying the social values of ecosystem services , 2011 .

[52]  Yuqiong Liu,et al.  Linking science with environmental decision making: Experiences from an integrated modeling approach to supporting sustainable water resources management , 2008, Environ. Model. Softw..

[53]  Gerard B. M. Heuvelink,et al.  Developments in statistical approaches to spatial uncertainty and its propagation , 2002, Int. J. Geogr. Inf. Sci..

[54]  Rebecca A. Kelly,et al.  A formal framework for scenario development in support of environmental decision-making , 2009, Environ. Model. Softw..

[55]  Min Feng,et al.  Prototyping an online wetland ecosystem services model using open model sharing standards , 2011, Environ. Model. Softw..

[56]  Marta Schuhmacher,et al.  Sensitivity analysis of ecosystem service valuation in a Mediterranean watershed. , 2012, The Science of the total environment.

[57]  David Murray-Rust,et al.  Combining agent functional types, capitals and services to model land use dynamics , 2014, Environ. Model. Softw..

[58]  B. D. Vries,et al.  Perspectives on global change : the TARGETS approach , 1997 .

[59]  Maarten S. Krol,et al.  Identification and classification of uncertainties in the application of environmental models , 2010, Environ. Model. Softw..

[60]  J. R. Ravets,et al.  Post-Normal Science , 2006 .

[61]  Darius J. Semmens,et al.  A comparative assessment of decision-support tools for ecosystem services quantification and valuation , 2013 .

[62]  George J. Klir,et al.  Facets of Systems Science , 1991 .

[63]  William D. Nordhaus,et al.  Rolling the ‘DICE’: an optimal transition path for controlling greenhouse gases , 1993 .

[64]  D. Lange,et al.  Uncertainty propagation in FE modelling of a fire resistance test using fractional factorial design based model reduction and deterministic sampling , 2017 .

[65]  J. Ravetz,et al.  The post-normal science of precaution , 2004 .

[66]  David Dequech,et al.  Uncertainty: individuals, institutions and technology , 2004 .

[67]  Victoria Wibeck,et al.  Communicating Uncertainty: Models of Communication and the Role of Science in Assessing Progress towards Environmental Objectives , 2009 .

[68]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.

[69]  David W. Cash,et al.  Knowledge systems for sustainable development , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[70]  Dan Cornford,et al.  Managing uncertainty in integrated environmental modelling: The UncertWeb framework , 2013, Environ. Model. Softw..

[71]  A. Kiureghian,et al.  Aleatory or epistemic? Does it matter? , 2009 .

[72]  D. Meadows.  Dynamics of Growth in a Finite World , 1974 .

[73]  Jonathan Karnon,et al.  Model Parameter Estimation and Uncertainty: a Report of the Ispor-smdm Modeling Good Research Practices Task Force-6 Background to the Task Forcemodel-parameter-estimation-and- Uncertainty-analysis.asp). a Summary of These Articles Was Pre- Sented at a Plenary Session at the Ispor 16th Annual Intern , 2022 .

[74]  Tatiana Filatova,et al.  Chapter Four Complexity and Uncertainty: Rethinking the Modelling Activity , 2008 .

[75]  Gary W. Johnson,et al.  A Methodology for Adaptable and Robust Ecosystem Services Assessment , 2014, PloS one.

[76]  David G. Groves,et al.  A General, Analytic Method for Generating Robust Strategies and Narrative Scenarios , 2006, Manag. Sci..

[77]  G. Daily,et al.  Natural Capital: Theory and Practice of Mapping Ecosystem Services , 2011 .

[78]  Adrienne Grêt-Regamey,et al.  Review of decision support tools to operationalize the ecosystem services concept , 2017 .

[79]  Volker Grimm,et al.  Ecological models supporting environmental decision making: a strategy for the future. , 2010, Trends in ecology & evolution.

[80]  G. Klir.  Uncertainty and Information: Foundations of Generalized Information Theory , 2005 .

[81]  Warren E. Walker,et al.  Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support , 2003 .

[82]  M. J. Kolkman,et al.  Mental model mapping as a new tool to analyse the use of information in decision-making in integrated water management , 2005 .

[83]  J. Bolte,et al.  Policy Research Using Agent-Based Modeling to Assess Future Impacts of Urban Expansion into Farmlands and Forests , 2008 .

[84]  Maria E. Fernandez-Gimenez,et al.  Integration of local ecological knowledge and conventional science: A study of seven community-based forestry organizations in the USA , 2008 .

[85]  Vincent Marchau,et al.  Classifying and communicating uncertainties in model-based policy analysis , 2010 .

[86]  Olivier Jolliet,et al.  Analytical uncertainty propagation in life cycle inventory and impact assessment: application to an automobile front panel , 2010 .

[87]  M. V. Asselt,et al.  Uncertainty in perspective , 1996 .

[88]  Jan Rotmans,et al.  Uncertainty in Integrated Assessment Modelling: A Labyrinthic Path , 2001 .

[89]  Warren E. Walker,et al.  Adaptive policies, policy analysis, and policy-making , 2001, Eur. J. Oper. Res..

[90]  Jon C. Helton,et al.  An exploration of alternative approaches to the representation of uncertainty in model predictions , 2003, Reliab. Eng. Syst. Saf..

[91]  Benjamin P. Bryant,et al.  Uncertainty assessment in ecosystem services analyses: Seven challenges and practical responses , 2017 .

[92]  Jim W. Hall,et al.  Sensitivity analysis of environmental models: A systematic review with practical workflow , 2014, Environ. Model. Softw..

[93]  Didier Dubois,et al.  Hybrid approach for addressing uncertainty in risk assessments , 2003 .