Dealing with uncertainty in ecosystem models: The paradox of use for living marine resource management

Abstract To better manage living marine resources (LMRs), it has become clear that ecosystem-based fisheries management (EBFM) is a desired approach. To do EBFM, one of the key tools will be to use ecosystem models. To fully use ecosystem models and have their outputs adopted, there is an increasingly recognized need to address uncertainty associated with such modeling activities. Here we characterize uncertainty as applied to ecosystem models into six major factors, including: natural variability; observation error; inadequate communication among scientists, decision-makers and stakeholders; the structural complexity of the model(s) used; outcome uncertainty; and unclear management objectives. We then describe best practices to address each of these uncertainties as they particularly apply to ecosystem models being used in a LMR management context. We also present case studies to highlight examples of how these best practices have been implemented. Although we acknowledge that this work was compiled by ecosystem modelers in an LMR management context primarily for other ecosystem modelers, the principles and practices described herein are also germane for managers, stakeholders and other natural resource management communities. We conclude by emphasizing not only the need to address uncertainty in ecosystem models, but also the feasibility and benefits of doing so.

[1]  J. Link,et al.  The importance of including predation in fish population models: Implications for biological reference points , 2011 .

[2]  Herman A. Karl,et al.  A Dialogue, Not a Diatribe: Effective Integration of Science and Policy through Joint Fact Finding , 2007 .

[3]  P. A. Larkin Concepts and issues in marine ecosystem management , 1996, Reviews in Fish Biology and Fisheries.

[4]  J. W. Hedgpeth,et al.  Models and muddles , 1977, Helgoländer wissenschaftliche Meeresuntersuchungen.

[5]  Konstantinos I. Stergiou,et al.  Overfishing, tropicalization of fish stocks, uncertainty and ecosystem management: resharpening Ockham's razor , 2002 .

[6]  Jake C. Rice,et al.  A Framework for Reducing Implementation Uncertainty in Fisheries Management , 1996 .

[7]  Edward A. Codling,et al.  On scientists’ discomfort in fisheries advisory science: the example of simulation-based fisheries management-strategy evaluations , 2010 .

[8]  John C. Field,et al.  Considering ecosystem-based fisheries management in the California Current , 2006 .

[9]  D. Doak,et al.  Book Review: Quantitative Conservation biology: Theory and Practice of Population Viability analysis , 2004, Landscape Ecology.

[10]  John Cotter,et al.  Choosing survey time series for populations as part of an ecosystem approach to fishery management , 2009 .

[11]  Vincent R. Gray Climate Change 2007: The Physical Science Basis Summary for Policymakers , 2007 .

[12]  Wendy Watson-Wright,et al.  The Promise of an Ecosystem Approach: Lessons from the Past – Hopes for the Future , 2009 .

[13]  Helen M. Regan,et al.  ROBUST DECISION‐MAKING UNDER SEVERE UNCERTAINTY FOR CONSERVATION MANAGEMENT , 2005 .

[14]  Robert M. Jones,et al.  FishSmart: An Innovative Role for Science in Stakeholder- Centered Approaches to Fisheries Management , 2010 .

[15]  Timothy E. Essington,et al.  Evaluating the sensitivity of a trophic mass- balance model (Ecopath) to imprecise data inputs , 2007 .

[16]  Noëlle Yochum,et al.  Utilizing Fishermen Knowledge and Expertise: Keys to Success for Collaborative Fisheries Research , 2011 .

[17]  Peter Fox,et al.  Changing the Equation on Scientific Data Visualization , 2011, Science.

[18]  Beatriz A. Roel,et al.  Management procedures in a fishery based on highly variable stocks and with conflicting objectives: experiences in the South African pelagic fishery , 1998, Reviews in Fish Biology and Fisheries.

[19]  Corinne Le Quéré,et al.  Climate Change 2013: The Physical Science Basis , 2013 .

[20]  Ivan Valiela,et al.  Nitrogen loading from watersheds to estuaries: Verification of the Waquoit Bay Nitrogen Loading Model , 2000 .

[21]  Jason S. Link,et al.  Ecological Considerations in Fisheries Management: When Does it Matter? , 2002 .

[22]  Robin Cook,et al.  Estimating uncertainty in fish stock assessment and forecasting , 2001 .

[23]  J. Link Translating ecosystem indicators into decision criteria , 2005 .

[24]  Emmanuel Raufflet Berkes, F., and C. Folke, editors. 1998. Linking Social and Ecological Systems: Management Practices and Social Mechanisms for Building Resilience. Cambridge University Press, New York. , 2000 .

[25]  G. A. Bradshaw,et al.  Uncertainty as Information: Narrowing the Science-policy Gap , 2000 .

[26]  Yue Li,et al.  Application of spatial visualization for probabilistic hurricanes risk assessment to build environment , 2008, 2008 Winter Simulation Conference.

[27]  Richard T. Conant,et al.  BEST PRACTICES IN PREDICTION FOR DECISION‐MAKING: LESSONS FROM THE ATMOSPHERIC AND EARTH SCIENCES , 2003 .

[28]  David R. Anderson,et al.  Model Selection and Multimodel Inference , 2003 .

[29]  A. E. Punt,et al.  The effects of future consumption by the Cape fur seal on catches and catch rates of the Cape hakes. 4. Modelling the biological interaction between Cape fur seals Arctocephalus pusillus pusillus and the Cape hakes Merluccius capensis and M. paradoxus , 1995 .

[30]  Olivier Klepper,et al.  Multivariate aspects of model uncertainty analysis: tools for sensitivity analysis and calibration , 1997 .

[31]  David Vose,et al.  Quantitative Risk Analysis: A Guide to Monte Carlo Simulation Modelling , 1996 .

[32]  Mark E. Borsuk,et al.  A Bayesian network of eutrophication models for synthesis, prediction, and uncertainty analysis , 2004 .

[33]  Hal Caswell,et al.  HARBOR PORPOISE AND FISHERIES: AN UNCERTAINTY ANALYSIS OF INCIDENTAL MORTALITY , 1998 .

[34]  Jens Schröter,et al.  Testing a marine ecosystem model: Sensitivity analysis and parameter optimization , 2001 .

[35]  R. Hilborn,et al.  The Ecological Detective: Confronting Models with Data , 1997 .

[36]  André E. Punt,et al.  Design of operational management strategies for achieving fishery ecosystem objectives , 2000 .

[37]  Igor Linkov,et al.  Model Uncertainty and Choices Made by Modelers: Lessons Learned from the International Atomic Energy Agency Model Intercomparisons † , 2003, Risk analysis : an official publication of the Society for Risk Analysis.

[38]  R. O'Boyle,et al.  Observations on the implementation of ecosystem-based management : Experiences on canada's east and west coasts , 2006 .

[39]  Robert T. Clemen,et al.  Making Hard Decisions: An Introduction to Decision Analysis , 1997 .

[40]  Anthony Charles,et al.  Living with uncertainty in fisheries: analytical methods, management priorities and the Canadian groundfishery experience , 1998 .

[41]  Carl J. Walters,et al.  Ecopath with Ecosim: methods, capabilities and limitations , 2004 .

[42]  James G. Richman,et al.  Data assimilation and a pelagic ecosystem model: parameterization using time series observations , 1998 .

[43]  Jason S. Link,et al.  The Trophic Ecology of Atlantic Cod: Insights from Tri-monthly, Localized Scales of Sampling , 2007 .

[44]  E. K. Pikitch,et al.  Ecosystem-Based Fishery Management , 2004, Science.

[45]  André E. Punt,et al.  MULTISPECIES AND SINGLE‐SPECIES MODELS OF FISH POPULATION DYNAMICS: COMPARING PARAMETER ESTIMATES , 2008 .

[46]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[47]  Anthony D. M. Smith,et al.  Implementing effective fisheries-management systems – management strategy evaluation and the Australian partnership approach , 1999 .

[48]  R. Hilborn Defining success in fisheries and conflicts in objectives , 2007 .

[49]  Kerim Aydin,et al.  Report of the National Ecosystem Modeling Workshop (NEMoW) , 2008 .

[50]  Steven A. Murawski,et al.  Ten Commandments for Ecosystem-Based Fisheries Scientists , 2007 .

[51]  Simeon L. Hill,et al.  A compilation of parameters for ecosystem dynamics models of the Scotia Sea-Antarctic Peninsula region , 2007 .

[52]  J. F. Caddy,et al.  An overview of recent global experience with recovery plans for depleted marine resources and suggested guidelines for recovery planning , 2004, Reviews in Fish Biology and Fisheries.

[53]  Isaac C. Kaplan,et al.  Ecosystem-Based Management of What? An Emerging Approach for Balancing Conflicting Objectives in Marine Resource Management , 2009 .

[54]  Brian J. Rothschild,et al.  The Future of Fisheries Science in North America , 2009 .

[55]  Lawrence B. Slobodkin,et al.  A Critique for Ecology , 1991 .

[56]  P. Turchin Complex Population Dynamics: A Theoretical/Empirical Synthesis , 2013 .

[57]  M. Reed Stakeholder participation for environmental management: A literature review , 2008 .

[58]  Kevin Stokes,et al.  Coping with uncertainty in ecological advice: lessons from fisheries , 2003 .

[59]  Randall M. Peterman,et al.  Possible solutions to some challenges facing fisheries scientists and managers , 2004 .

[60]  P. Degnbol Indicators as a means of communicating knowledge , 2005 .

[61]  Carl J. Walters,et al.  Adaptive Management of Renewable Resources , 1986 .

[62]  Lars Håkanson Optimal size of predictive models , 1995 .

[63]  Helen M. Regan,et al.  A TAXONOMY AND TREATMENT OF UNCERTAINTY FOR ECOLOGY AND CONSERVATION BIOLOGY , 2002 .

[64]  C. Walters,et al.  Quantitative fisheries stock assessment: Choice, dynamics and uncertainty , 2004, Reviews in Fish Biology and Fisheries.

[65]  Jean-Marc Fromentin,et al.  Ecosystem oceanography for global change in fisheries. , 2008, Trends in ecology & evolution.

[66]  Jeremy S. Collie,et al.  Are multispecies models an improvement on single-species models for measuring fishing impacts on marine ecosystems? , 2000 .

[67]  André E. Punt,et al.  Experience in implementing harvest strategies in Australia's south-eastern fisheries , 2008 .

[68]  H. Chernoff,et al.  Elementary Decision Theory. , 1988 .

[69]  J. F. Caddy,et al.  Uncertainty in bio-economic reference points and indicators of marine fisheries , 2000 .

[70]  Murdoch K. McAllister,et al.  Experimental Design in the Management of Fisheries: A Review , 1992 .

[71]  Carrie A. Holt,et al.  Missing the target: uncertainties in achieving management goals in fisheries on Fraser River, British Columbia, sockeye salmon (Oncorhynchus nerka) , 2006 .

[72]  Lincoln E. Moses,et al.  Elementary Decision Theory , 1959 .

[73]  Brad deYoung,et al.  Challenges of Modeling Ocean Basin Ecosystems , 2004, Science.

[74]  R. I. C. C. Francis,et al.  "Risk" in fisheries management: a review , 1997 .

[75]  Serge M. Garcia,et al.  Viability theory for an ecosystem approach to fisheries , 2005 .

[76]  S. Ferson,et al.  Different methods are needed to propagate ignorance and variability , 1996 .

[77]  Murdoch K. McAllister,et al.  Accounting for structural uncertainty to facilitate precautionary fishery management: illustration with Namibian orange roughy , 2002 .

[78]  Ray Hilborn,et al.  Living with Uncertainty in Resource Management , 1987 .

[79]  John Turner,et al.  Model uncertainty in the ecosystem approach to fisheries , 2007 .

[80]  Julia L. Blanchard,et al.  CONSEQUENCES OF ALTERNATIVE FUNCTIONAL RESPONSE FORMULATIONS IN MODELS EXPLORING WHALE-FISHERY INTERACTIONS , 2003 .

[81]  E. Fulton,et al.  Effect of complexity on marine ecosystem models , 2003 .

[82]  Jason S. Link,et al.  Models of predation and fishing mortality in aquatic ecosystems , 2000 .

[83]  R. Pielke,et al.  Prediction : science, decision making, and the future of nature , 2000 .

[84]  Steven J. D. Martell,et al.  Fisheries Ecology and Management , 2004 .

[85]  Franklin B. Schwing,et al.  Corrigendum: An ecosystem-based hypothesis for climatic effects on surplus production in California sardine (Sardinops sagax) and environmentally dependent surplus production models , 2009 .

[86]  Robert H. Peters,et al.  The role of prediction in limnology1 , 1986 .

[87]  Lawrence A. Twisdale,et al.  SIMULATION OF HURRICANE RISK IN THE U.S. USING EMPIRICAL TRACK MODEL , 2000 .

[88]  J. Elsner,et al.  Prediction Models for Annual U.S. Hurricane Counts , 2006 .

[89]  S. Garcia The ecosystem approach to fisheries : issues, terminology, principles, institutional foundations, implementation and outlook , 2003 .

[90]  Randall M. Peterman,et al.  Evaluation of performance of alternative management models of Pacific salmon (Oncorhynchus spp.) in the presence of climatic change and outcome uncertainty using Monte Carlo simulations , 2009 .

[91]  Karin A. Forney,et al.  Environmental Models of Cetacean Abundance: Reducing Uncertainty in Population Trends , 2000 .

[92]  André E. Punt,et al.  Evaluation of threshold management strategies for groundfish off the U.S. West Coast , 2008 .

[93]  Marc Mangel,et al.  Commentary: accounting for uncertainty in marine reserve design , 2005 .

[94]  P. Levin,et al.  Integrated Ecosystem Assessments: Developing the Scientific Basis for Ecosystem-Based Management of the Ocean , 2009, PLoS biology.

[95]  André E. Punt,et al.  Developing management procedures that are robust to uncertainty: lessons from the International Whaling Commission , 2007 .

[96]  Paul J. Somerfield,et al.  A multivariate approach to model skill assessment , 2009 .

[97]  John Sabo,et al.  Morris, W. F., and D. F. Doak. 2003. Quantitative Conservation Biology: Theory and Practice of Population Viability Analysis. Sinauer Associates, Sunderland, Massachusetts, USA , 2003 .

[98]  Stephen R. Carpenter,et al.  UNCERTAINTY AND THE MANAGEMENT OF MULTISTATE ECOSYSTEMS: AN APPARENTLY RATIONAL ROUTE TO COLLAPSE , 2003 .

[99]  Éva E Plagányi,et al.  Models for an ecosystem approach to fisheries , 2007 .

[100]  Judith L. Anderson Embracing Uncertainty: The Interface of Bayesian Statistics and Cognitive Psychology , 1998 .

[101]  William N. Venables,et al.  Management strategies for short lived species: The case of Australia's Northern Prawn Fishery 1. Accounting for multiple species, spatial structure and implementation uncertainty when evaluating risk , 2006 .

[102]  Doug S Butterworth,et al.  Why a management procedure approach? Some positives and negatives , 2007 .

[103]  James H. Brown,et al.  The Report of the Ecological Society of America Committee on the Scientific Basis for Ecosystem Management , 1996 .

[104]  Holger R. Maier,et al.  Future research challenges for incorporation of uncertainty in environmental and ecological decision-making , 2008 .

[105]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[106]  H. L. Miller,et al.  Climate Change 2007: The Physical Science Basis , 2007 .

[107]  Sven Erik Jørgensen,et al.  Ecosystems emerging: toward an ecology of complex systems in a complex future , 1992 .

[108]  Milo D Adkison,et al.  Drawbacks of complex models in frequentist and Bayesian approaches to natural-resource management. , 2009, Ecological applications : a publication of the Ecological Society of America.

[109]  Jason S. Link,et al.  Value-added sampling for fishery independent surveys: Don’t stop after you’re done counting and measuring , 2008 .

[110]  Frederick J. Swanson,et al.  OVERVIEW OF THE USE OF NATURAL VARIABILITY CONCEPTS IN MANAGING ECOLOGICAL SYSTEMS , 1999 .

[111]  M. Burgman Risks and Decisions for Conservation and Environmental Management: Experts, stakeholders and elicitation , 2005 .

[112]  J. Ianelli,et al.  Designing tools to evaluate fishery management strategies: can the scientific community deliver? , 2007 .

[113]  James D. Watkins,et al.  AN OCEAN BLUEPRINT FOR THE 21ST CENTURY: THE WORK OF THE U.S. COMMISSION ON OCEAN POLICY , 2004 .

[114]  Robert Costanza Visions of Alternative (Unpredictable) Futures and Their Use in Policy Analysis , 2000 .

[115]  K. Mikalsen,et al.  Participatory practices in fisheries across Europe: Making stakeholders more responsible , 2008 .

[116]  Craig Loehle,et al.  A hypothesis testing framework for evaluating ecosystem model performance , 1997 .

[117]  Doug S Butterworth,et al.  A critical look at the potential of Ecopath with ecosim to assist in practical fisheries management , 2004 .

[118]  S. Carpenter,et al.  ESTIMATING COMMUNITY STABILITY AND ECOLOGICAL INTERACTIONS FROM TIME‐SERIES DATA , 2003 .

[119]  P. Mace a new role for MSY in single-species and ecosystem approaches to fisheries stock assessment and management , 2001 .

[120]  C. Stow,et al.  Skill Assessment for Coupled Biological/Physical Models of Marine Systems. , 2009, Journal of marine systems : journal of the European Association of Marine Sciences and Techniques.

[121]  M. Sinclair,et al.  21 Governance for Responsible Fisheries: an Ecosystem Approach , 2003 .

[122]  Jason S. Link,et al.  Ecosystem-Based Fisheries Management: Confronting Tradeoffs , 2010 .

[123]  Tim D. Smith Scaling Fisheries: The Science of Measuring the Effects of Fishing, 1855-1955 , 1994, Polar Record.

[124]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[125]  Alistair J. Hobday,et al.  Importance of trophic information, simplification and aggregation error in ecosystem models , 2008 .

[126]  G. Bianchi,et al.  The ecosystem approach to fisheries , 2008 .