From ad-hoc modelling to strategic infrastructure: A manifesto for model management

Abstract Models are playing an increasingly prominent role in watershed management, and environmental management more generally. To successfully utilize model-based tools for governing water resources, modelling timelines must match decision making timelines, and modelling costs must fall within budget constraints. Clarity on management options for modelling processes, and effective strategies, are likey to improve outcomes. This paper provides a first conceptualisation of model management and lays out its scope. We define management of numerical models (MNM) as governance, operational support, and administration of modelling, and argue that it is a universal activity that is crucial but often overlooked in organizations that rely on modelling. The paper lays out the leverage points available to a model manager, based on a review of model management practices in several fields, highlights lessons learned, and opportunities for further improvement as model management becomes a mainstream concern in both research and practice.

[1]  Henrik Madsen,et al.  Data assimilation framework: Linking an open data assimilation library (OpenDA) to a widely adopted model interface (OpenMI) , 2014, Environ. Model. Softw..

[2]  Soroosh Sorooshian,et al.  Challenges of operational river forecasting , 2014 .

[3]  Jens Christian Refsgaard,et al.  Modelling guidelinesterminology and guiding principles , 2004 .

[4]  M. B. Beck,et al.  GRAND CHALLENGES OF THE FUTURE FOR ENVIRONMENTAL MODELING , 2008 .

[5]  I. A. Chaikovsky,et al.  Terminology for model credibility , 1979 .

[6]  Henry Mintzberg,et al.  Of strategies, deliberate and emergent , 1985, Strategic Management Journal.

[7]  Gunnar Abrahamson,et al.  Terminology for model credibility , 1980 .

[8]  Robin Gregory,et al.  Structured Decision Making: A Practical Guide to Environmental Management Choices , 2012 .

[9]  Christopher J. Duffy,et al.  Open science in practice: Learning integrated modeling of coupled surface‐subsurface flow processes from scratch , 2016 .

[10]  Igor Linkov,et al.  Model Uncertainty and Choices Made by Modelers: Lessons Learned from the International Atomic Energy Agency Model Intercomparisons † , 2003, Risk analysis : an official publication of the Society for Risk Analysis.

[11]  Igor Linkov,et al.  Multi-criteria decision analysis in environmental sciences: ten years of applications and trends. , 2011, The Science of the total environment.

[12]  V. Ducrocq,et al.  Hydrometeorological multi-model ensemble simulations of the 4 November 2011 flash flood event in Genoa, Italy, in the framework of the DRIHM Project , 2014 .

[13]  Yu Zhang,et al.  From concept to practice to policy: modeling coupled natural and human systems in lake catchments , 2018 .

[14]  Vincent Marchau,et al.  Decision Making under Deep Uncertainty: From Theory to Practice , 2019 .

[15]  Jennifer Badham,et al.  Effective modeling for Integrated Water Resource Management: A guide to contextual practices by phases and steps and future opportunities , 2019, Environ. Model. Softw..

[16]  D. C. Black,et al.  Towards best practice implementation and application of models for analysis of water resources management scenarios , 2014, Environ. Model. Softw..

[17]  Thomas Berger,et al.  Quantifying the economic importance of irrigation water reuse in a Chilean watershed using an integrated agent‐based model , 2015 .

[18]  Jeffrey J. McDonnell,et al.  On the dialog between experimentalist and modeler in catchment hydrology: Use of soft data for multicriteria model calibration , 2002 .

[19]  K. R. Douglas-Mankin,et al.  Evaluating, interpreting, and communicating performance of hydrologic/water quality models considering intended use: A review and recommendations , 2014, Environ. Model. Softw..

[20]  Andrew Kusiak,et al.  End-to-End Cyberinfrastructure for Decision-Making Support in Watershed Management , 2013 .

[21]  Suzanne A. Pierce,et al.  Modelling with stakeholders e Next generation , 2015 .

[22]  M. L. Kavvas,et al.  Coupling HEC-HMS with Atmospheric Models for Prediction of Watershed Runoff , 2002 .

[23]  Paul Davison,et al.  Splicing recharge and groundwater flow models in the Environment Agency National Groundwater Modelling System , 2016, Special Publications.

[24]  Mary C. Hill,et al.  Integrated environmental modeling: A vision and roadmap for the future , 2013, Environ. Model. Softw..

[25]  K. J. Seymour,et al.  How to get your model results used: a guide to stakeholder engagement , 2012 .

[26]  Claudia Pahl-Wostl,et al.  Participative and Stakeholder-Based Policy Design, Evaluation and Modeling Processes , 2002 .

[27]  Raimo P. Hämäläinen,et al.  Portfolio decision analysis methods in environmental decision making , 2017, Environ. Model. Softw..

[28]  Richard J. Williams,et al.  A model selection protocol to support the use of models for water management , 2007 .

[29]  Tuomas J. Lahtinen,et al.  Why pay attention to paths in the practice of environmental modelling? , 2017, Environ. Model. Softw..

[30]  L. Shawn Matott,et al.  Evaluating uncertainty in integrated environmental models: A review of concepts and tools , 2009 .

[31]  Jaap Schellekens,et al.  The Delft-FEWS flow forecasting system , 2013, Environ. Model. Softw..

[32]  Denis Havlik,et al.  Chapter Seven Integrated Modelling Frameworks for Environmental Assessment and Decision Support , 2008 .

[33]  Benjamin B. Mirus,et al.  Assessing the detail needed to capture rainfall‐runoff dynamics with physics‐based hydrologic response simulation , 2011 .

[34]  Suzanne A. Pierce,et al.  Toward the Geoscience Paper of the Future: Best practices for documenting and sharing research from data to software to provenance , 2016 .

[35]  Praveen Kumar,et al.  Typology of hydrologic predictability , 2011 .

[36]  Joseph H. A. Guillaume,et al.  A framework for characterising and evaluating the effectiveness of environmental modelling , 2019, Environ. Model. Softw..

[37]  Christopher Hutton,et al.  Most computational hydrology is not reproducible, so is it really science? , 2016, Water Resources Research.

[38]  R. Grant.  Toward a Knowledge-Based Theory of the Firm,” Strategic Management Journal (17), pp. , 1996 .

[39]  Thorsten R. Arnold,et al.  Procedural knowledge for integrated modelling: Towards the Modelling Playground , 2013, Environ. Model. Softw..

[40]  François Bousquet,et al.  Modelling with stakeholders , 2010, Environ. Model. Softw..

[41]  Thorsten Arnold,et al.  Modelling for reproducibility, transparency, and continuous learning: Revisiting Jakeman’s 10 steps , 2016 .

[42]  Riyanti Djalante,et al.  Adaptive governance and managing resilience to natural hazards , 2011 .

[43]  Willem J. de Lange,et al.  An operational, multi-scale, multi-model system for consensus-based, integrated water management and policy analysis: The Netherlands Hydrological Instrument , 2014, Environ. Model. Softw..

[44]  Robert M. Argent,et al.  A new approach to water quality modelling and environmental decision support systems , 2009, Environ. Model. Softw..

[45]  Ralf Thorsten Arnold,et al.  A screening method for making the source water event-based approach operational , 2015 .

[46]  Jeffery S. Horsburgh,et al.  A relational model for environmental and water resources data , 2008 .

[47]  Anthony M. Castronova,et al.  Modeling water resource systems using a service-oriented computing paradigm , 2011, Environ. Model. Softw..

[48]  David J. Schwab,et al.  The Operational Implementation of a Great Lakes Wave Forecasting System at NOAA/NCEP* , 2014 .

[49]  Joseph H. A. Guillaume,et al.  Realizing modelling outcomes: A synthesis of success factors and their use in a retrospective analysis of 15 Australian water resource projects , 2017, Environ. Model. Softw..

[50]  Jens Christian Refsgaard,et al.  Groundwater Modeling in Integrated Water Resources Management—Visions for 2020 , 2010, Ground water.

[51]  David G. Tarboton,et al.  An overview of current applications, challenges, and future trends in distributed process-based models in hydrology , 2016 .

[52]  M. C. Jensen,et al.  Specific and General Knowledge and Organizational Structure , 1995 .

[53]  Enrique R. Vivoni,et al.  Real-world hydrologic assessment of a fully-distributed hydrological model in a parallel computing environment , 2011 .

[54]  R. Freeze,et al.  Blueprint for a physically-based, digitally-simulated hydrologic response model , 1969 .

[55]  Seong Jin Noh,et al.  Advancing data assimilation in operational hydrologic forecasting: progresses, challenges, and emerging opportunities , 2012 .

[56]  Anthony J. Jakeman,et al.  Ten iterative steps in development and evaluation of environmental models , 2006, Environ. Model. Softw..

[57]  Simon Stisen,et al.  Stakeholder driven update and improvement of a national water resources model , 2013, Environ. Model. Softw..

[58]  M. Hare,et al.  Forms of Participatory Modelling and its Potential for Widespread Adoption in the Water Sector , 2011 .

[59]  Eelco van Beek,et al.  Collaborative modelling or participatory modelling? A framework for water resources management , 2017, Environ. Model. Softw..

[60]  M. Hipsey,et al.  “Panta Rhei—Everything Flows”: Change in hydrology and society—The IAHS Scientific Decade 2013–2022 , 2013 .

[61]  Joseph H. A. Guillaume,et al.  Characterising performance of environmental models , 2013, Environ. Model. Softw..

[62]  S. Esterby.  American Society for Testing and Materials , 2006 .

[63]  J. B. Gregersen,et al.  OpenMI: Open modelling interface , 2007 .

[64]  Joseph H. A. Guillaume,et al.  Toward best practice framing of uncertainty in scientific publications: A review of Water Resources Research abstracts , 2017 .

[65]  Raimo P. Hämäläinen,et al.  Behavioural issues in environmental modelling - The missing perspective , 2015, Environmental Modelling & Software.

[66]  John Doherty,et al.  Approaches to Highly Parameterized Inversion: A Guide to Using PEST for Model-Parameter and Predictive-Uncertainty Analysis , 2014 .

[67]  Andrea Emilio Rizzoli,et al.  Modelling with knowledge: A review of emerging semantic approaches to environmental modelling , 2009, Environ. Model. Softw..

[68]  Peter A. Vanrolleghem,et al.  Uncertainty in the environmental modelling process - A framework and guidance , 2007, Environ. Model. Softw..

[69]  Stefan Stieglitz,et al.  Do Researchers Dream of Research Data Management? , 2018, HICSS.

[70]  Mohamed M. Morsy,et al.  Integrating scientific cyberinfrastructures to improve reproducibility in computational hydrology: Example for HydroShare and GeoTrust , 2018, Environ. Model. Softw..

[71]  Raimo P. Hämäläinen,et al.  On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems , 2013, Eur. J. Oper. Res..

[72]  M. Hare,et al.  Exploring the Gap Between Water Managers and Researchers: Difficulties of Model-Based Tools to Support Practical Water Management , 2007 .

[73]  Christopher J. Duffy,et al.  Visualization workflows for level-12 HUC scales: Towards an expert system for watershed analysis in a distributed computing environment , 2016, Environ. Model. Softw..