Critical appraisal of assumptions in chains of model calculations used to project local climate impacts for adaptation decision support—the case of Baakse Beek

In order to enable anticipation and proactive adaptation, local decision makers increasingly seek detailed foresight about regional and local impacts of climate change. To this end, the Netherlands Models and Data-Centre implemented a pilot chain of sequentially linked models to project local climate impacts on hydrology, agriculture and nature under different national climate scenarios for a small region in the east of the Netherlands named Baakse Beek. The chain of models sequentially linked in that pilot includes a (future) weather generator and models of respectively subsurface hydrogeology, ground water stocks and flows, soil chemistry, vegetation development, crop yield and nature quality. These models typically have mismatching time step sizes and grid cell sizes. The linking of these models unavoidably involves the making of model assumptions that can hardly be validated, such as those needed to bridge the mismatches in spatial and temporal scales. Here we present and apply a method for the systematic critical appraisal of model assumptions that seeks to identify and characterize the weakest assumptions in a model chain. The critical appraisal of assumptions presented in this paper has been carried out ex-post. For the case of the climate impact model chain for Baakse Beek, the three most problematic assumptions were found to be: land use and land management kept constant over time; model linking of (daily) ground water model output to the (yearly) vegetation model around the root zone; and aggregation of daily output of the soil hydrology model into yearly input of a so called ‘mineralization reduction factor’ (calculated from annual average soil pH and daily soil hydrology) in the soil chemistry model. Overall, the method for critical appraisal of model assumptions presented and tested in this paper yields a rich qualitative insight in model uncertainty and model quality. It promotes reflectivity and learning in the modelling community, and leads to well informed recommendations for model improvement.

[1]  Jerome R. Ravetz,et al.  Exploring the quality of evidence for complex and contested policy decisions , 2008 .

[2]  Jeroen P. van der Sluijs,et al.  On the contribution of external cost calculations to energy system governance: the case of a potential large-scale nuclear accident , 2011 .

[3]  Arlen W. Harbaugh,et al.  MODFLOW-2000, The U.S. Geological Survey Modular Ground-Water Model - User Guide to Modularization Concepts and the Ground-Water Flow Process , 2000 .

[4]  Martijn Bouwknegt,et al.  Uncertainty of Population Risk Estimates for Pathogens Based on QMRA or Epidemiology: A Case Study of Campylobacter in the Netherlands , 2014, Risk analysis : an official publication of the Society for Risk Analysis.

[5]  P. V. Walsum,et al.  Quasi Steady‐State Simulation of the Unsaturated Zone in Groundwater Modeling of Lowland Regions , 2008 .

[6]  Jeroen P. van der Sluijs,et al.  What do I make of your Latinorum? Sensitivity auditing of mathematical modelling. , 2012, 1211.2668.

[7]  J. Sluijs,et al.  Modelling Climate Change Impacts for Adaptation Assessments , 2011 .

[8]  P. Kloprogge,et al.  A method for the analysis of assumptions in assessments , 2005 .

[9]  Jonathan G. Koomey,et al.  The risk of surprise in energy technology costs , 2007 .

[10]  J. A. Wardekker,et al.  Assumptions in quantitative analyses of health risks of overhead power lines , 2012 .

[11]  Jeroen P. van der Sluijs,et al.  Advice under uncertainty in the marine system , 2012 .

[12]  S. Funtowicz,et al.  Combining Quantitative and Qualitative Measures of Uncertainty in Model‐Based Environmental Assessment: The NUSAP System , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[13]  Giandomenico Majone,et al.  The Critical Appraisal of Scientific Inquiries with Policy Implications , 1985 .

[14]  Argyris Kanellopoulos,et al.  Climate change impact and adaptation research requires integrated assessment and farming systems analysis: a case study in the Netherlands , 2015 .

[15]  Arthur C. Petersen,et al.  A method for the analysis of assumptions in model-based environmental assessments , 2011, Environ. Model. Softw..

[16]  Jeroen P. van der Sluijs,et al.  Quality in environmental science for policy: Assessing uncertainty as a component of policy analysis , 2011 .

[17]  W. Werner,et al.  Indicator values of plants in Central Europe , 1991 .

[18]  M. B. Beck,et al.  On the problem of model validation for predictive exposure assessments , 1997 .

[19]  Iwan Supit,et al.  Influence of ecohydrologic feedbacks from simulated crop growth on integrated regional hydrologic simulations under climate scenarios , 2012 .

[20]  Marc Aerts,et al.  NUSAP: a method to evaluate the quality of assumptions in quantitative microbial risk assessment , 2010 .

[21]  Silvio Funtowicz,et al.  Application of a checklist for quality assistance in environmental modelling to an energy model , 2005 .

[22]  P. Bodegom,et al.  A probabilistic eco-hydrological model to predict the effects of climate change on natural vegetation at a regional scale , 2015, Landscape Ecology.