Sensitivity analysis for complex ecological models - A new approach

A strategy for global sensitivity analysis of a multi-parameter ecological model was developed and used for the hydrodynamic-ecological model (DYRESM-CAEDYM, DYnamic REservoir Simulation Model-Computational Aquatic Ecosystem Dynamics Model) applied to Lake Kinneret (Israel). Two different methods of sensitivity analysis, RPART (Recursive Partitioning And Regression Trees) and GLM (General Linear Model) were applied in order to screen a subset of significant parameters. All the parameters which were found significant by at least one of these methods were entered as input to a GBM (Generalized Boosted Modeling) analysis in order to provide a quantitative measure of the sensitivity of the model variables to these parameters. Although the GBM is a general and powerful machine learning algorithm, it has substantial computational costs in both storage requirements and CPU time. Employing the screening stage reduces this cost. The results of the analysis highlighted the role of particulate organic material in the lake ecosystem and its impact on the over all lake nutrient budget. The GBM analysis established, for example, that parameters such as particulate organic material diameter and density were particularly important to the model outcomes. The results were further explored by lumping together output variables that are associated with sub-components of the ecosystem. The variable lumping approach suggested that the phytoplankton group is most sensitive to parameters associated with the dominant phytoplankton group, dinoflagellates, and with nanoplankton (Chlorophyta), supporting the view of Lake Kinneret as a bottom-up system. The study demonstrates the effectiveness of such procedures for extracting useful information for model calibration and guiding further data collection.

[1]  D. Hamby A review of techniques for parameter sensitivity analysis of environmental models , 1994, Environmental monitoring and assessment.

[2]  Jon C. Helton,et al.  Latin Hypercube Sampling and the Propagation of Uncertainty in Analyses of Complex Systems , 2002 .

[3]  Tamar Zohary,et al.  Changes to the phytoplankton assemblage of Lake Kinneret after decades of a predictable, repetitive pattern , 2004 .

[4]  M. Gophen Seasonal Rotifer Dynamics in the Long-term (1969–2002) Record from Lake Kinneret (Israel) , 2005, Hydrobiologia.

[5]  David P. Hamilton,et al.  Modelling the effects of Po River discharge, internal nutrient cycling and hydrodynamics on biogeochemistry of the Northern Adriatic Sea , 2007 .

[6]  M. Straškraba,et al.  Theoretical reservoir ecology and its applications , 1999 .

[7]  A. Saltelli,et al.  A quantitative model-independent method for global sensitivity analysis of model output , 1999 .

[8]  A. Ford Modeling the Environment: An Introduction To System Dynamics Modeling Of Environmental Systems , 1999 .

[9]  Jon C. Helton,et al.  Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models , 2009, Reliab. Eng. Syst. Saf..

[10]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[11]  M. Gophen Seasonal rotifer dynamics in the long-term (1969-2002) record from Lake Kinneret (Israel) , 2005 .

[12]  T. Zohary,et al.  Microzooplankton dominate carbon flow and nutrient cycling in a warm subtropical freshwater lake , 2007 .

[13]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[14]  T. Berman,et al.  OCCURRENCE AND MICROBIAL DYNAMICS OF MACROSCOPIC ORGANIC AGGREGATES (LAKE SNOW) IN LAKE KINNERET, ISRAEL, IN FALL , 1998 .

[15]  T. Berman,et al.  Planktonic community production and respiration and the impact of bacteria on carbon cycling in the photic zone of Lake Kinneret , 2004 .

[16]  M. Altabet,et al.  Seasonally varying nitrogen isotope biogeochemistry of particulate organic matter in Lake Kinneret, Israel , 2009 .

[17]  Sandia Report,et al.  Survey of Sampling-Based Methods for Uncertainty and Sensitivity Analysis , 2006 .

[18]  I. Ostrovsky,et al.  Downward flux of organic matter and pigments in Lake Kinneret (Israel): relationships between phytoplankton and the material collected in sediment traps , 2008 .

[19]  Jörg Imberger,et al.  A DYNAMIC RESERVOIR SIMULATION MODEL - DYRESM: 5 , 1981 .

[20]  Bonnie K. Ray,et al.  Statistical methods for sensitivity and performance analysis in computer experiments , 1999, WSC '99.

[21]  Jon C. Helton,et al.  Survey of sampling-based methods for uncertainty and sensitivity analysis , 2006, Reliab. Eng. Syst. Saf..

[22]  Matthew R. Hipsey,et al.  Implementation of ecological modeling as an effective management and investigation tool: Lake Kinneret as a case study , 2009 .

[23]  David P. Hamilton,et al.  A numerical simulation of the role of zooplankton in C, N and P cycling in Lake Kinneret, Israel , 2006 .

[24]  J. Friedman Stochastic gradient boosting , 2002 .

[25]  T. Zohary,et al.  Effects of zooplankton grazing and nutrients on the bloom-forming, N2-fixing cyanobacterium Aphanizomenon in Lake Kinneret , 2001 .

[26]  Jon C. Helton,et al.  Sampling-based methods for uncertainty and sensitivity analysis. , 2000 .

[27]  Brad deYoung,et al.  Challenges of Modeling Ocean Basin Ecosystems , 2004, Science.

[28]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[29]  Carmen Bessa-Gomes,et al.  Modeling the impact of feeding stations on vulture scavenging service efficiency , 2009 .

[30]  Jon C. Helton,et al.  Multiple predictor smoothing methods for sensitivity analysis: Example results , 2008, Reliab. Eng. Syst. Saf..

[31]  Yosef Z. Yacobi,et al.  Primary production and phytoplankton in Lake Kinneret: A long‐term record (1972‐1993) , 1995 .

[32]  L. Stone,et al.  Seasonal dynamics of the Lake Kinneret food web:The importance of the microbial loop , 2000 .

[33]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[34]  T. Berman,et al.  Light utilization by phytoplankton in Lake Kinneret (Israel) , 1981 .

[35]  K.,et al.  Nonlinear sensitivity analysis of multiparameter model systems , 1977 .

[36]  D. Kirschner,et al.  A methodology for performing global uncertainty and sensitivity analysis in systems biology. , 2008, Journal of theoretical biology.

[37]  Peter C. Chu,et al.  On non-linear sensitivity of marine biological models to parameter variations , 2007 .

[38]  Craig Loehle,et al.  A hypothesis testing framework for evaluating ecosystem model performance , 1997 .

[39]  David P. Hamilton,et al.  Three-dimensional modelling of a Microcystis bloom event in the Swan River estuary, Western Australia , 2004 .

[40]  David P. Hamilton,et al.  Modelling the relative importance of internal and external nutrient loads on water column nutrient concentrations and phytoplankton biomass in a shallow polymictic lake , 2008 .

[41]  Dennis Trolle,et al.  Predicting the effects of reduced external nitrogen loading on the nitrogen dynamics and ecological state of deep Lake Ravn, Denmark, using the DYRESM–CAEDYM model , 2008 .

[42]  A. Gasith,et al.  Dinoflagellate bloom development and collapse in Lake Kinneret: a sediment trap study , 2003 .

[43]  H. Christopher Frey,et al.  Recommended Practice Regarding Selection, Application, and Interpretation of Sensitivity Analysis Methods Applied to Food Safety Process Risk Models , 2004 .

[44]  Gianpiero Cossarini,et al.  Global sensitivity analysis of a trophodynamic model of the Gulf of Trieste , 2008 .

[45]  John R Fieberg,et al.  Assessing uncertainty in ecological systems using global sensitivity analyses: a case example of simulated wolf reintroduction effects on elk , 2005 .

[46]  T. Green,et al.  Key Criteria and Selection of Sensitivity Analysis Methods Applied to Natural Resource Models , 2005 .

[47]  D. P. Hamilton,et al.  Numerical modelling and reservoir management: Applications of the DYRESM model , 1999 .

[48]  T. Zohary,et al.  Bloom dynamics and sedimentation of Peridinium gatunense in Lake Kinneret , 1998 .

[49]  Jason P. Antenucci,et al.  Simulating the thermal dynamics of Lake Kinneret , 2003 .

[50]  M. Stiller Origin of Sedimentation Components in Lake Kinneret Traced by their Isotopic Composition , 1976 .

[51]  Harvey M. Wagner,et al.  Global Sensitivity Analysis , 1995, Oper. Res..

[52]  J. R. Romero,et al.  One- and three-dimensional biogeochemical simulations of two differing reservoirs , 2004 .

[53]  A. Saltelli,et al.  The role of sensitivity analysis in ecological modelling , 2007 .

[54]  U. Pollingher,et al.  Aphanizomenon ovalisporum (Forti) in Lake Kinneret, Israel , 1998 .

[55]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[56]  Jon C. Helton,et al.  Multiple predictor smoothing methods for sensitivity analysis: Description of techniques , 2008, Reliab. Eng. Syst. Saf..

[57]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[58]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[59]  Xiaobo Zhou,et al.  Global Sensitivity Analysis , 2017, Encyclopedia of GIS.

[60]  Elsie M. Sunderland,et al.  Draft Guidance on the Development, Evaluation, and Application of Regulatory Environmental Models , 2003 .

[61]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[62]  Joseph A. C. Delaney Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[63]  Sabrina Gaba,et al.  Combined use of local and ANOVA-based global sensitivity analyses for the investigation of a stochastic dynamic model: Application to the case study of an individual-based model of a fish population , 2006 .

[64]  Marcela Brugnach Process level sensitivity analysis for complex ecological models , 2005 .

[65]  U. Pollingher Phytoplankton periodicity in a subtropical lake (Lake Kinneret, Israel) , 1984, Hydrobiologia.

[66]  Holger R. Maier,et al.  A comparison of sensitivity analysis techniques for complex models for environmental management , 2005 .

[67]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[68]  Allan S. Lessem,et al.  Improving ecological simulation through sensitivity analysis , 1979 .

[69]  N. Ray,et al.  Subjective uncertainties in habitat suitability maps , 2006 .

[70]  David P. Hamilton,et al.  A spatially resolved model of seasonal variations in phytoplankton and clam (Tapes philippinarum) biomass in Barbamarco Lagoon, Italy , 2008 .

[71]  Yohay Carmel,et al.  Incorporating output variance in local sensitivity analysis for stochastic models , 2008 .

[72]  P. Hamilton Transport Models for Inland and Coastal Waters , 1982 .

[73]  U. Pollingher The structure and dynamics of the phytoplankton assemblages in Lake Kinneret, Israel , 1981 .

[74]  M. Evans First international conference on toxic dinoflagellate blooms , 1975 .