Addressing the impact of environmental uncertainty in plankton model calibration with a dedicated software system: the Marine Model Optimization Testbed (MarMOT 1.1 alpha)

Abstract. A wide variety of different plankton system models have been coupled with ocean circulation models, with the aim of understanding and predicting aspects of environmental change. However, an ability to make reliable inferences about real-world processes from the model behaviour demands a quantitative understanding of model error that remains elusive. Assessment of coupled model output is inhibited by relatively limited observing system coverage of biogeochemical components. Any direct assessment of the plankton model is further inhibited by uncertainty in the physical state. Furthermore, comparative evaluation of plankton models on the basis of their design is inhibited by the sensitivity of their dynamics to many adjustable parameters. Parameter uncertainty has been widely addressed by calibrating models at data-rich ocean sites. However, relatively little attention has been given to quantifying uncertainty in the physical fields required by the plankton models at these sites, and tendencies in the biogeochemical properties due to the effects of horizontal processes are often neglected. Here we use model twin experiments, in which synthetic data are assimilated to estimate a system's known "true" parameters, to investigate the impact of error in a plankton model's environmental input data. The experiments are supported by a new software tool, the Marine Model Optimization Testbed, designed for rigorous analysis of plankton models in a multi-site 1-D framework. Simulated errors are derived from statistical characterizations of the mixed layer depth, the horizontal flux divergence tendencies of the biogeochemical tracers and the initial state. Plausible patterns of uncertainty in these data are shown to produce strong temporal and spatial variability in the expected simulation error variance over an annual cycle, indicating variation in the significance attributable to individual model-data differences. An inverse scheme using ensemble-based estimates of the simulation error variance to allow for this environment error performs well compared with weighting schemes used in previous calibration studies, giving improved estimates of the known parameters. The efficacy of the new scheme in real-world applications will depend on the quality of statistical characterizations of the input data. Practical approaches towards developing reliable characterizations are discussed.

[1]  Forman S. Acton,et al.  Numerical methods that work , 1970 .

[2]  T. R. Anderson,et al.  Medusa-1.0: a new intermediate complexity plankton ecosystem model for the global domain , 2010 .

[3]  T. Platt,et al.  Primary production by phytoplankton : analytic solutions for daily rates per unit area of water surface , 1990, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[4]  S. Levitus,et al.  World ocean atlas 2009 , 2010 .

[5]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[6]  Marjorie A. M. Friedrichs,et al.  Ecosystem model complexity versus physical forcing: Quantification of their relative impact with assimilated Arabian Sea data , 2006 .

[7]  A. Oschlies,et al.  An eddy‐permitting coupled physical‐biological model of the North Atlantic: 1. Sensitivity to advection numerics and mixed layer physics , 1999 .

[8]  Thomas R. Anderson,et al.  A spectrally averaged model of light penetration and photosynthesis , 1993 .

[9]  I. Charpentier,et al.  Can biogeochemical fluxes be recovered from nitrate and chlorophyll data? A case study assimilating data in the Northwestern Mediterranean Sea at the JGOFS-DYFAMED station , 2003 .

[10]  Russ Rew,et al.  NetCDF: an interface for scientific data access , 1990, IEEE Computer Graphics and Applications.

[11]  Thomas R. Anderson,et al.  Comparison of the emergent behavior of a complex ecosystem model in two ocean general circulation models , 2010 .

[12]  C. Stow,et al.  Skill Assessment for Coupled Biological/Physical Models of Marine Systems. , 2009, Journal of marine systems : journal of the European Association of Marine Sciences and Techniques.

[13]  James G. Richman,et al.  Data assimilation and a pelagic ecosystem model: parameterization using time series observations , 1998 .

[14]  Graham Savidge,et al.  Modeling the relative contributions of autotrophs and heterotrophs to carbon flow at a Lagrangian JGOFS station in the Northeast Atlantic: The importance of DOC , 1999 .

[15]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[16]  Corinne Le Quéré Reply to Horizons Article ‘Plankton functional type modelling: running before we can walk’ Anderson (2005): I. Abrupt changes in marine ecosystems? , 2006 .

[17]  Adrian P. Martin,et al.  Accounting for unresolved spatial variability in marine ecosystems using time lags , 2006 .

[18]  Andreas Oschlies,et al.  Simultaneous data-based optimization of a 1D-ecosystem model at three locations in the North Atlantic: Part I— Method and parameter estimates , 2003 .

[19]  Véronique Ducrocq,et al.  The Meso-NH Atmospheric Simulation System. Part I: adiabatic formulation and control simulations , 1997 .

[20]  T. R. Anderson,et al.  Control of primary production in the Arctic by nutrients and light: insights from a high resolution ocean general circulation model , 2010 .

[21]  Meric A. Srokosz,et al.  Assimilating satellite ocean-colour observations into oceanic ecosystem models , 2002, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[22]  Svetlana N. Losa,et al.  Weak constraint parameter estimation for a simple ocean ecosystem model: what can we learn about the model and data? , 2004 .

[23]  André Morel,et al.  Light and marine photosynthesis: a spectral model with geochemical and climatological implications , 1991 .

[24]  A. OHagan,et al.  Bayesian analysis of computer code outputs: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[25]  Thomas R. Anderson,et al.  Plankton functional type modelling : running before we can walk? , 2005 .

[26]  Mark R. Abbott,et al.  Configuring an ecosystem model using data from the Bermuda Atlantic Time Series (BATS) , 2001 .

[27]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[28]  Kalmanje Krishnakumar,et al.  Micro-Genetic Algorithms For Stationary And Non-Stationary Function Optimization , 1990, Other Conferences.

[29]  T. Kana,et al.  Dynamic model of phytoplankton growth and acclimation: responses of the balanced growth rate and the chlorophyll a:carbon ratio to light, nutrient-limitation and temperature , 1997 .

[30]  O. Bernard,et al.  A mechanistic modelling and data assimilation approach to estimate the carbon/chlorophyll and carbon/nitrogen ratios in a coupled hydrodynamical-biological model , 2004 .

[31]  G. Hurtt,et al.  A pelagic ecosystem model calibrated with BATS data , 1996 .

[32]  Grace Chang,et al.  Variability of the downwelling diffuse attenuation coefficient with consideration of inelastic scattering. , 2002, Applied optics.

[33]  Using satellite-derived backscattering coefficients in addition to chlorophyll data to constrain a simple marine biogeochemical model , 2009 .

[34]  D. Carroll Chemical laser modeling with genetic algorithms , 1996 .

[35]  Thomas R. Anderson,et al.  Parameter optimisation techniques and the problem of underdetermination in marine biogeochemical models , 2010 .

[36]  G. Evans,et al.  The Use of Optimization Techniques to Model Marine Ecosystem Dynamics at the JGOFS Station at 47 degrees N 20 degrees W [and Discussion] , 1995 .

[37]  M. E. Johnson,et al.  Minimax and maximin distance designs , 1990 .

[38]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[39]  Isabelle Dadou,et al.  Assimilation of surface data in a one-dimensional physical-biogeochemical model of the surface ocean. 2. Adjusting a simple trophic model to chlorophyll, temperature, nitrate, and pCO2 data , 1996 .

[40]  Christoph Völker,et al.  Modeling the speciation and biogeochemistry of iron at the Bermuda Atlantic Time‐series Study site , 2005 .

[41]  Peter G. Challenor,et al.  A Markov chain Monte Carlo method for estimation and assimilation into models , 1997 .

[42]  Meric A. Srokosz,et al.  Split-domain calibration of an ecosystem model using satellite ocean colour data , 2004 .

[43]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[44]  George C. Hurtt,et al.  A pelagic ecosystem model calibrated with BATS and OWSI data , 1999 .

[45]  I. Totterdell,et al.  Production and export in a global ocean ecosystem model , 2001 .

[46]  A. Morel Optical modeling of the upper ocean in relation to its biogenous matter content (case I waters) , 1988 .

[47]  Scott C. Doney,et al.  Assessment of skill and portability in regional marine biogeochemical models : Role of multiple planktonic groups , 2007 .

[48]  Michio J. Kishi,et al.  A data assimilation technique applied to estimate parameters for the NEMURO marine ecosystem model , 2004 .

[49]  A. Oschlies,et al.  An eddy‐permitting coupled physical‐biological model of the North Atlantic: 2. Ecosystem dynamics and comparison with satellite and JGOFS local studies data , 2000 .

[50]  Michael Dowd,et al.  A Bayesian approach to the ecosystem inverse problem , 2003 .

[51]  G. Evans,et al.  Defining misfit between biogeochemical models and data sets , 2003 .

[52]  Thomas R. Anderson,et al.  Development of a robust marine ecosystem model to predict the role of iron in biogeochemical cycles: A comparison of results for iron-replete and iron-limited areas, and the SOIREE iron-enrichment experiment , 2006 .

[53]  G. Evans,et al.  The role of local models and data sets in the Joint Global Ocean Flux Study , 1999 .

[54]  John S. Parslow,et al.  A model of annual plankton cycles , 2013 .

[55]  Thierry Penduff,et al.  Impact of partial steps and momentum advection schemes in a global ocean circulation model at eddy-permitting resolution , 2009 .

[56]  Richard J. Matear,et al.  Parameter optimization and analysis of ecosystem models using simulated annealing: a case study at Station P , 1995 .

[57]  Andreas Oschlies,et al.  Parameter estimates of a zero-dimensional ecosystem model applying the adjoint method , 2001 .

[58]  Jens Schröter,et al.  Testing a marine ecosystem model: Sensitivity analysis and parameter optimization , 2001 .

[59]  V. Garçon,et al.  Using JGOFS in situ and ocean color data to compare biogeochemical models and estimate their parameters in the subtropical North Atlantic Ocean , 2004 .

[60]  M. Friedrichs Assimilation of JGOFS EqPac and SeaWiFS data into a marine ecosystem model of the Central Equatorial Pacific Ocean , 2001 .

[61]  V. Echevin,et al.  Assimilation of surface data in a one-dimensional physical-biogeochemical model of the surface ocean , 1996 .