When do aquatic systems models provide useful predictions, what is changing, and what is next?

This article considers how aquatic systems modelling has changed since 1995 and how it must change in future if we are to continue to advance. A distinction is made between mechanistic and statistical models, and the relative merits of each are considered. The question of "when do aquatic systems models provide accurate and useful predictions?" is addressed, implying some guidelines for model development. It is proposed that, in general, ecological models only provide management-relevant predictions of the behaviour of real systems when there are strong physical (as opposed to chemical or ecological) drivers. Developments over the past 15 years have included changes in technology, changes in the modelling community and changes in the context in which modelling is conducted: the implications of each are briefly discussed. Current trends include increased uptake of best practice guidelines, increasing integration of models, operationalisation, data assimilation, development of improved tools for skill assessment, and application of models to new management questions and in new social contexts. Deeper merging of statistical and mechanistic modelling approaches through such techniques as Bayesian Melding, Bayesian Hierarchical Modelling and surrogate modelling is identified as a key emerging area. Finally, it is suggested that there is a need to systematically identify areas in which our current models are inadequate. We do not yet know for which categories of problems well-implemented aquatic systems models can (or cannot) be expected to accurately predict observational data and system behaviour. This can be addressed through better modelling and publishing practices. Recent changes have resulted from changes technology and the modelling community.Active topics include integration, uncertainty, operationalisation and data assimilation.Emerging approaches more deeply combine statistical and mechanistic thinking.Conditions in which models are likely to provide useful predictions are discussed.We need to honestly and transparently report both model successes and failures.

[1]  Sven Erik Jørgensen,et al.  State of the art of ecological modelling in limnology , 1995 .

[2]  Anthony J. Jakeman,et al.  Selecting among five common modelling approaches for integrated environmental assessment and management , 2013, Environ. Model. Softw..

[3]  Bert Blocken,et al.  Ten iterative steps for model development and evaluation applied to Computational Fluid Dynamics for Environmental Fluid Mechanics , 2012, Environ. Model. Softw..

[4]  Thomas R. Anderson,et al.  Parameter optimisation techniques and the problem of underdetermination in marine biogeochemical models , 2010 .

[5]  Marcos Mateus A process-oriented model of pelagic biogeochemistry for marine systems. Part I: Model description , 2012 .

[6]  M. Liermann,et al.  Using accessible watershed size to predict management parameters for Chinook salmon, Oncorhynchus tshawytscha, populations with little or no spawner-recruit data: a Bayesian hierarchical modelling approach , 2010 .

[7]  Luis Samaniego,et al.  Technical assessment and evaluation of environmental models and software: Letter to the Editor , 2011, Environ. Model. Softw..

[8]  James W. Jawitz,et al.  Does increased model complexity improve description of phosphorus dynamics in a large treatment wetland , 2012 .

[9]  Peter Franks,et al.  Planktonic ecosystem models: perplexing parameterizations and a failure to fail , 2009 .

[10]  M. Rivington,et al.  Raising the bar? - The challenges of evaluating the outcomes of environmental modelling and software , 2011, Environ. Model. Softw..

[11]  Grace S. Chiu,et al.  Statistical inference for food webs with emphasis on ecological networks via Bayesian melding , 2010 .

[12]  Anthony J. Jakeman,et al.  Ten iterative steps in development and evaluation of environmental models , 2006, Environ. Model. Softw..

[13]  C. Begg,et al.  Publication bias : a problem in interpreting medical data , 1988 .

[14]  Andrea Castelletti,et al.  Visualization-based multi-objective improvement of environmental decision-making using linearization of response surfaces , 2010, Environ. Model. Softw..

[15]  Trevor Platt,et al.  Mathematical formulation of the relationship between photosynthesis and light for phytoplankton , 1976 .

[16]  J. A. Wardekker,et al.  Uncertainty communication in environmental assessments: views from the Dutch science-policy interface , 2008 .

[17]  L. Håkanson,et al.  Modelling of radiocesium in lakes—on predictive power and lessons for the future , 1997 .

[18]  Nancy Knowlton,et al.  Climate change impacts on marine ecosystems. , 2012, Annual review of marine science.

[19]  Craig Leohle,et al.  Evaluation of theories and calculation tools in ecology , 1983 .

[20]  J. Kindle,et al.  Summary diagrams for coupled hydrodynamic-ecosystem model skill assessment , 2009 .

[21]  Joseph H. A. Guillaume,et al.  Characterising performance of environmental models , 2013, Environ. Model. Softw..

[22]  R. P. Silberstein,et al.  Hydrological models are so good, do we still need data? , 2006, Environ. Model. Softw..

[23]  N Oreskes,et al.  Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences , 1994, Science.

[24]  Sung-Mo Ahn,et al.  Three-dimensional hydrodynamic-eutrophication model (HEM-3D): application to Kwang-Yang Bay, Korea. , 2005, Marine environmental research.

[25]  P. Fairweather,et al.  Linking water-resource models to ecosystem-response models to guide water-resource planning – an example from the Murray–Darling Basin, Australia , 2011 .

[26]  Jeffrey L. Anderson,et al.  The Data Assimilation Research Testbed: A Community Facility , 2009 .

[27]  François Bousquet,et al.  Modelling with stakeholders , 2010, Environ. Model. Softw..

[28]  Michael R. Heath,et al.  Global sensitivity analysis of an end-to-end marine ecosystem model of the North Sea: factors affecting the biomass of fish and benthos , 2014 .

[29]  F. Rizwi,et al.  Development of operational data-assimilating water quality modelling system for South-East Tasmania , 2010, OCEANS'10 IEEE SYDNEY.

[30]  Martin K. van Ittersum,et al.  How, when, and for what reasons does land use modelling contribute to societal problem solving? , 2011, Environ. Model. Softw..

[31]  Barbara J. Robson,et al.  State of the art in modelling of phosphorus in aquatic systems: Review, criticisms and commentary , 2014, Environ. Model. Softw..

[32]  David P. Hamilton,et al.  Effects of local climate and hydrological conditions on the thermal regime of a reservoir at Tropic of Cancer, in southern China. , 2012, Water research.

[33]  AldrinMagne,et al.  A Bayesian modelling framework for the estimation of catch-at-age of commercially harvested fish species , 2012 .

[34]  Robert M. Argent,et al.  An overview of model integration for environmental applications--components, frameworks and semantics , 2004, Environ. Model. Softw..

[35]  L. D. Wright,et al.  Tests of bed roughness models using field data from the Middle Atlantic Bight , 1995 .

[36]  Luca Polimene,et al.  Linking physiology to ecology: towards a new generation of plankton models , 2011 .

[37]  Nicholas J. Car The eReefs Information Architecture , 2013 .

[38]  Lars Håkanson,et al.  On the principles and factors determining the predictive success of ecosystem models, with a focus on lake eutrophication models , 1999 .

[39]  J. Ioannidis Why Most Published Research Findings Are False , 2005, PLoS medicine.

[40]  M. Herzfeld,et al.  Modelling the physical oceanography of the D'Entrecasteaux Channel and the Huon Estuary, south-eastern Tasmania , 2010 .

[41]  Andrea Castelletti,et al.  Improved dynamic emulation modeling by time series clustering: the case study of Marina Reservoir, Singapore , 2012 .

[42]  Abdüsselam Altunkaynak,et al.  A comparative study of hydrodynamic model and expert system related models for prediction of total suspended solids concentrations in Apalachicola Bay , 2011 .

[43]  Éric Parent,et al.  Setting biological reference points for Atlantic salmon stocks: transfer of information from data-rich to sparse-data situations by Bayesian hierarchical modelling , 2003 .

[44]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[45]  B. Edmunds Cross- and Along-Shelf Exchange Processes on the Great Barrier Reef , 2011 .

[46]  C. Perrin,et al.  Does a large number of parameters enhance model performance? Comparative assessment of common catchment model structures on 429 catchments , 2001 .

[47]  B. Robson A systematic review of the treatment of phosphorus in biogeochemical and ecological models , 2013 .

[48]  Elizabeth B. Harper,et al.  Global sensitivity analysis for complex ecological models: a case study of riparian cottonwood population dynamics. , 2011, Ecological applications : a publication of the Ecological Society of America.

[49]  George B. Arhonditsis,et al.  Improving the representation of internal nutrient recycling with phosphorus mass balance models: A case study in the Bay of Quinte, Ontario, Canada , 2013 .

[50]  Kenneth H. Reckhow,et al.  Optimizing an estuarine water quality monitoring program through an entropy‐based hierarchical spatiotemporal Bayesian framework , 2013 .

[51]  Judea Pearl,et al.  Fusion, Propagation, and Structuring in Belief Networks , 1986, Artif. Intell..

[52]  S. W. Chung,et al.  Modelling the propagation of turbid density inflows into a stratified lake: Daecheong Reservoir, Korea , 2009, Environ. Model. Softw..

[53]  J. Sheng,et al.  Process study of circulation in the Pearl River Estuary and adjacent coastal waters in the wet season using a triply-nested circulation model , 2011 .

[54]  C. Stow,et al.  Skill Assessment for Coupled Biological/Physical Models of Marine Systems. , 2009, Journal of marine systems : journal of the European Association of Marine Sciences and Techniques.

[55]  Christopher K. Wikle,et al.  Science-based parameterizations for dynamical spatiotemporal models , 2012 .

[56]  Mark E. Baird,et al.  Limits to prediction in a size-resolved pelagic ecosystem model , 2010 .

[57]  Daniel R. Lynch,et al.  Resolution issues in numerical models of oceanic and coastal circulation , 2007 .

[58]  George B. Arhonditsis,et al.  A revaluation of lake-phosphorus loading models using a Bayesian hierarchical framework , 2009, Ecological Research.

[59]  Barbara J. Robson,et al.  Incorporating a generalised additive model of river nutrient concentrations into a mechanistic receiving water model , 2013 .

[60]  Laurence Carvalho,et al.  Cyanobacterial blooms: statistical models describing risk factors for national-scale lake assessment and lake management. , 2011, The Science of the total environment.

[61]  Andrea Castelletti,et al.  A general framework for Dynamic Emulation Modelling in environmental problems , 2012, Environ. Model. Softw..

[62]  David P. Hamilton,et al.  Summer flow event induces a cyanobacterial bloom in a seasonal Western Australian estuary , 2003 .

[63]  Rafael Rumí,et al.  Bayesian networks in environmental modelling , 2011, Environ. Model. Softw..

[64]  A. Chorin Numerical solution of the Navier-Stokes equations , 1968 .

[65]  Suraje Dessai,et al.  Predicting, deciding, learning: can one evaluate the ‘success’ of national climate scenarios? , 2008 .

[66]  Kevin J. Flynn,et al.  Castles built on sand : dysfunctionality in plankton models and the inadequacy of dialogue between biologists and modellers , 2005 .

[67]  Robert E. Davis,et al.  Statistics for the evaluation and comparison of models , 1985 .

[68]  Antoine Guisan,et al.  Predictive habitat distribution models in ecology , 2000 .

[69]  M. Herzfeld,et al.  Applied coastal biogeochemical modelling to quantify the environmental impact of fish farm nutrients and inform managers , 2010 .

[70]  N. M. J. Crout,et al.  Is my model too complex? Evaluating model formulation using model reduction , 2009, Environ. Model. Softw..

[71]  Bryan A. Tolson,et al.  Review of surrogate modeling in water resources , 2012 .

[72]  M. A. Aziz-Alaoui,et al.  Analysis of the dynamics of a realistic ecological model , 2002 .

[73]  I. Suthers,et al.  Increasing model structural complexity inhibits the growth of initial condition errors , 2010 .

[74]  David P. Hamilton,et al.  Ten steps applied to development and evaluation of process-based biogeochemical models of estuaries , 2008, Environ. Model. Softw..

[75]  C. K. Minns The potential future impact of climate warming and other human activities on the productive capacity of Canada's lake fisheries: a meta-model , 2009 .

[76]  Mary C. Hill,et al.  Integrated environmental modeling: A vision and roadmap for the future , 2013, Environ. Model. Softw..

[77]  Lawrence Buja,et al.  The computational future for climate and Earth system models: on the path to petaflop and beyond , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[78]  Elizabeth A. Fulton,et al.  Mortality and predation in ecosystem models: is it important how these are expressed? , 2003 .

[79]  Vittorio E. Brando,et al.  Satellite data assimilation and estimation of a 3D coastal sediment transport model using error-subspace emulators , 2013, Environ. Model. Softw..

[80]  Anthony O'Hagan,et al.  Probabilistic uncertainty specification: Overview, elaboration techniques and their application to a mechanistic model of carbon flux , 2012, Environ. Model. Softw..

[81]  P. Ralph,et al.  A dynamic model of the cellular carbon to chlorophyll ratio applied to a batch culture and a continental shelf ecosystem , 2013 .

[82]  Peter R. Oke,et al.  BLUElink> Development of Operational Oceanography and Servicing in Australia , 2007, J. Res. Pract. Inf. Technol..

[83]  Eddy Campbell,et al.  Sequential data assimilation in fine-resolution models using error-subspace emulators: Theory and preliminary evaluation , 2012 .

[84]  Robert G. Wagner,et al.  Process versus empirical models: which approach for forest ecosystem management? , 1996 .

[85]  Anton H. Westveld,et al.  Physical Statistics or Statistical Physics? A Brief Overview of Bayesian Melding , 2013 .

[86]  Ben R. Hodges,et al.  A hydrostatic/non-hydrostatic grid-switching strategy for computing high-frequency, high wave number motions embedded in geophysical flows , 2009, Environ. Model. Softw..

[87]  Marjorie A. M. Friedrichs,et al.  Ecosystem model complexity versus physical forcing: Quantification of their relative impact with assimilated Arabian Sea data , 2006 .

[88]  Barbara A. Adams-Vanharn,et al.  Evaluation of the current state of mechanistic aquatic biogeochemical modeling: citation analysis and future perspectives. , 2006, Environmental science & technology.

[89]  P. Reichert,et al.  Biogeochemical model of Lake Zürich : sensitivity, identifiability and uncertainty analysis , 2001 .

[90]  P. Radtke,et al.  A Bayesian strategy for combining predictions from empirical and process-based models , 2006 .

[91]  K. Walker,et al.  A Ramsar wetland in crisis – the Coorong, Lower Lakes and Murray Mouth, Australia , 2011 .

[92]  Taiping Wang,et al.  Hypoxia in a Coastal Embayment of the Chesapeake Bay: A Model Diagnostic Study of Oxygen Dynamics , 2008 .

[93]  Alexey A. Voinov,et al.  'Integronsters', integral and integrated modeling , 2013, Environ. Model. Softw..

[94]  Peter C. Young,et al.  Data-based mechanistic modelling of environmental, ecological, economic and engineering systems. , 1998 .

[95]  Phillip S. Levin,et al.  Bringing stakeholders, scientists, and managers together through an integrated ecosystem assessment process , 2010 .

[96]  Marcin Kulawiak,et al.  Interactive visualization of marine pollution monitoring and forecasting data via a Web-based GIS , 2010, Comput. Geosci..

[97]  Bayesian hierarchical modelling of maturity-at-length for rock lobsters, Jasus edwardsii, off Victoria, Australia , 2006 .

[98]  David P. Hamilton,et al.  A community-based framework for aquatic ecosystem models , 2011, Hydrobiologia.

[99]  N. Plant,et al.  The effect of bathymetric filtering on nearshore process model results , 2009 .

[100]  Andreas Schiller,et al.  Monitoring, Predicting, and Managing One of the Seven Natural Wonders of the World , 2014 .

[101]  Matthias Heymann,et al.  Understanding and misunderstanding computer simulation: The case of atmospheric and climate science—An introduction , 2010 .

[102]  James E. Cloern,et al.  Patterns and Scales of Phytoplankton Variability in Estuarine–Coastal Ecosystems , 2010 .

[103]  H. Maier,et al.  Temperature stratification in the lower River Murray, Australia: implication for cyanobacterial bloom development , 1997 .