Selecting among five common modelling approaches for integrated environmental assessment and management

The design and implementation of effective environmental policies need to be informed by a holistic understanding of the system processes (biophysical, social and economic), their complex interactions, and how they respond to various changes. Models, integrating different system processes into a unified framework, are seen as useful tools to help analyse alternatives with stakeholders, assess their outcomes, and communicate results in a transparent way. This paper reviews five common approaches or model types that have the capacity to integrate knowledge by developing models that can accommodate multiple issues, values, scales and uncertainty considerations, as well as facilitate stakeholder engagement. The approaches considered are: systems dynamics, Bayesian networks, coupled component models, agent-based models and knowledge-based models (also referred to as expert systems). We start by discussing several considerations in model development, such as the purpose of model building, the availability of qualitative versus quantitative data for model specification, the level of spatio-temporal detail required, and treatment of uncertainty. These considerations and a review of applications are then used to develop a framework that aims to assist modellers and model users in the choice of an appropriate modelling approach for their integrated assessment applications and that enables more effective learning in interdisciplinary settings. We review five common integrated modelling approaches.Model choice considers purpose, data type, scale and uncertainty treatment.We present a guiding framework for selecting the most appropriate approach.

[1]  Michael Matthies,et al.  System analysis of water quality management for the Elbe river basin , 2006, Environ. Model. Softw..

[2]  Billy J. Barfield,et al.  Design Hydrology and Sedimentology for Small Catchments , 1994 .

[3]  Hedwig van Delden,et al.  Using the GEONAMICA® software environment for integrated dynamic spatial modelling , 2008 .

[4]  Alexis Drogoul,et al.  When Agents Emerge from Agents: Introducing Multi-scale Viewpoints in Multi-agent Simulations , 1998, MABS.

[5]  F. Bousqueta,et al.  Multi-agent simulations and ecosystem management : a review , 2004 .

[6]  Oswald J. Schmitz,et al.  Combining field experiments and individual‐based modeling to identify the dynamically relevant organizational scale in a field system , 2000 .

[7]  Simon Peck,et al.  Group Model Building: Facilitating Team Learning Using System Dynamics , 1996, J. Oper. Res. Soc..

[8]  David N. Ford,et al.  Expert knowledge elicitation to improve formal and mental models , 1998 .

[9]  Jules Pretty,et al.  Participatory learning for sustainable agriculture , 1995 .

[10]  Edward H. Shortliffe,et al.  From certainty factors to belief networks , 1992, Artif. Intell. Medicine.

[11]  William L. Bland,et al.  Toward integrated assessment in agriculture , 1999 .

[12]  Anthony J. Jakeman,et al.  An integrated modelling toolbox for water resources assessment and management in highland catchments: Sensitivity analysis and testing , 2006 .

[13]  Sara S. Metcalf,et al.  Sharing the floodplain: Mediated modeling for environmental management , 2010, Environ. Model. Softw..

[14]  Carlo Giupponi,et al.  Sustainable management of water resources : an integrated approach , 2006 .

[15]  Jeroen P. van der Sluijs,et al.  A framework for dealing with uncertainty due to model structure error , 2004 .

[16]  Joseph H. A. Guillaume,et al.  Characterising performance of environmental models , 2013, Environ. Model. Softw..

[17]  Diego O. Ferraro,et al.  Fuzzy knowledge-based model for soil condition assessment in Argentinean cropping systems , 2009, Environ. Model. Softw..

[18]  Anne van der Veen,et al.  Land market mechanisms for preservation of space for coastal ecosystems: An agent-based analysis , 2011, Environ. Model. Softw..

[19]  Tracey J. Regan,et al.  Capturing expert knowledge for threatened species assessments: a case study using NatureServe conservation status ranks , 2004 .

[20]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[21]  Annukka Lehikoinen,et al.  Optimizing the recovery efficiency of Finnish oil combating vessels in the Gulf of Finland using Bayesian Networks. , 2013, Environmental science & technology.

[22]  Alexey A. Voinov,et al.  StellaR: A software to translate Stella models into R open-source environment , 2012, Environ. Model. Softw..

[23]  Holger R. Maier,et al.  Future research challenges for incorporation of uncertainty in environmental and ecological decision-making , 2008 .

[24]  Graciela Metternicht,et al.  Assessing temporal and spatial changes of salinity using fuzzy logic, remote sensing and GIS. Foundations of an expert system , 2001 .

[25]  Tony Prato,et al.  Modeling ecological impacts of landscape change , 2005, Environ. Model. Softw..

[26]  Paul L. Freedman,et al.  Models quantify the total maximum daily load process , 2004 .

[27]  Dean Tjosvold,et al.  Book review : Group model building : facilitating team learning using system dynamics , 1998 .

[28]  M. Vanclooster,et al.  Metamodelling: Theory, concepts and application to nitrate leaching modelling , 2006 .

[29]  Michael Monticino,et al.  Coupled human and natural systems: A multi-agent-based approach , 2007, Environ. Model. Softw..

[30]  C. Mullon,et al.  An environmental modelling approach : the use of multi-agent simulations , 1988 .

[31]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[32]  Sakari Kuikka,et al.  Evaluation of reaching the targets of the water framework directive in the Gulf of Finland. , 2012, Environmental science & technology.

[33]  Hedwig van Delden,et al.  Integration of multi-scale dynamic spatial models of socio-economic and physical processes for river basin management , 2007, Environ. Model. Softw..

[34]  Rafael Rumí,et al.  Bayesian networks in environmental modelling , 2011, Environ. Model. Softw..

[35]  Ralf Seppelt,et al.  "It was an artefact not the result": A note on systems dynamic model development tools , 2005, Environ. Model. Softw..

[36]  Sakari Kuikka,et al.  Learning Bayesian decision analysis by doing: lessons from environmental and natural resources management , 1999 .

[37]  J. M. Fernández,et al.  The dynamics of water scarcity on irrigated landscapes: Mazarrón and Aguilas in south-eastern Spain , 2004 .

[38]  M. Hare,et al.  Forms of Participatory Modelling and its Potential for Widespread Adoption in the Water Sector , 2011 .

[39]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[40]  Anthony Jakeman Environmental modelling, software and decision support : state of the art and new perspectives , 2008 .

[41]  Anthony J. Jakeman,et al.  A Bayesian decision network approach for salinity management in the Little River Catchment, NSW , 2003 .

[42]  James T. Peterson,et al.  Evaluation of potential effects of federal land management alternatives on trends of salmonids and their habitats in the interior Columbia River basin , 2001 .

[43]  John W. Sutherland,et al.  Normative predicates of next-generation management support systems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[44]  R. Muetzelfeldt Declarative modelling in the ecological and environmental sciences , 2007 .

[45]  Rodrigo Ramos-Jiliberto,et al.  Resource-consumer models and the biomass conversion principle , 2005, Environ. Model. Softw..

[46]  Thomas D. Crocker,et al.  On the joint determination of biological and economic systems , 2002 .

[47]  Sujay V. Kumar,et al.  The NASA-Goddard Multi-scale Modeling Framework-Land Information System: Global land/atmosphere interaction with resolved convection , 2013, Environ. Model. Softw..

[48]  Alexey A. Voinov,et al.  Model integration and the role of data , 2010, Environ. Model. Softw..

[49]  Ignasi Rodríguez-Roda,et al.  Exploring the ecological status of human altered streams through Generative Topographic Mapping , 2007, Environ. Model. Softw..

[50]  Graham K. Rand,et al.  Quantitative Applications in the Social Sciences , 1983 .

[51]  Tim Oxley,et al.  Integrated modelling and decision-support tools: a Mediterranean example , 2004, Environ. Model. Softw..

[52]  Lorenz M. Hilty,et al.  The relevance of information and communication technologies for environmental sustainability - A prospective simulation study , 2006, Environ. Model. Softw..

[53]  John D. Sterman,et al.  System Dynamics: Systems Thinking and Modeling for a Complex World , 2002 .

[54]  A F Lukasheh,et al.  Review of Expert System (ES), Geographic Information System (GIS), Decision Support System (DSS), and their applications in landfill design and management , 2001, Waste management & research : the journal of the International Solid Wastes and Public Cleansing Association, ISWA.

[55]  Mary C. Hill,et al.  Integrated environmental modeling: A vision and roadmap for the future , 2013, Environ. Model. Softw..

[56]  Alfonso Dominguez,et al.  Bayesian networks in planning a large aquifer in Eastern Mancha, Spain , 2007, Environ. Model. Softw..

[57]  Holger R. Maier,et al.  A generic framework for regression regionalization in ungauged catchments , 2012, Environ. Model. Softw..

[58]  S. Moss,et al.  Agent-based integrated assessment modelling: the example of climate change , 2001 .

[59]  Anthony J. Jakeman,et al.  An integrated modelling toolbox for water resources assessment and management in highland catchments: Model description , 2006 .

[60]  Alan Bundy,et al.  The use of prolog for improving the rigour and accessibility of ecological modelling , 1989 .

[61]  Alan Charles Incorporating Soft Variables Into System Dynamics Models : A Suggested Method and Basis for Ongoing Research , 2003 .

[62]  Thomas Maxwell,et al.  Patuxent landscape model: integrated ecological economic modeling of a wathershed , 1999, Environ. Model. Softw..

[63]  Lei Gao,et al.  Ranking management strategies with complex outcomes: An AHP-fuzzy evaluation of recreational fishing using an integrated agent-based model of a coral reef ecosystem , 2012, Environ. Model. Softw..

[64]  George P. Richardson,et al.  Group Model-Building 'Scripts' as a Collaborative Planning Tool , 2012 .

[65]  Kevin B. Korb,et al.  Parameterisation and evaluation of a Bayesian network for use in an ecological risk assessment , 2007, Environ. Model. Softw..

[66]  Anthony J. Jakeman,et al.  A Bayesian decision network approach for assessing the ecological impacts of salinity management , 2005, Math. Comput. Simul..

[67]  Alexey A. Voinov,et al.  'Integronsters', integral and integrated modeling , 2013, Environ. Model. Softw..

[68]  David C.-L. Lam,et al.  Regional analysis of watershed acidification using the expert systems approach , 1988 .

[69]  Raffaele Giordano,et al.  A fuzzy GIS-based system to integrate local and technical knowledge in soil salinity monitoring , 2012, Environ. Model. Softw..

[70]  Laurence Smith,et al.  The role of expert opinion in environmental modelling , 2012, Environ. Model. Softw..

[71]  Hassan Qudrat-Ullah,et al.  System Dynamics Based Learning Environments , 2008 .

[72]  Anthony J. Jakeman,et al.  An integrated approach to linking economic valuation and catchment modelling , 2011, Environ. Model. Softw..

[73]  Andrew Jones,et al.  Management flight simulators to support climate negotiations , 2013, Environ. Model. Softw..

[74]  Axel Bronstert,et al.  The Semi-Arid Integrated Model (SIM), a Regional Integrated Model Assessing Water Availability, Vulnerability of Ecosystems and Society in NE-Brazil , 2001 .

[75]  Juan I. Ramos,et al.  Landscape analysis and simulation shell (Lass) , 2006, Environ. Model. Softw..

[76]  Dagmar Haase,et al.  Actors and factors in land-use simulation: The challenge of urban shrinkage , 2012, Environ. Model. Softw..

[77]  Scott E. Page,et al.  Agent-Based Models , 2014, Encyclopedia of GIS.

[78]  Patrick Hostert,et al.  Uncovering land-use dynamics driven by human decision-making - A combined model approach using cellular automata and system dynamics , 2012, Environ. Model. Softw..

[79]  Erik Wierstra,et al.  Validity of CVM related to the type of environmental good; an empirical test , 2001 .

[80]  Stephen H. Schneider,et al.  Integrated assessment modeling of global climate change: Transparent rational tool for policy making or opaque screen hiding value‐laden assumptions? , 1997 .

[81]  Mark E. Borsuk,et al.  Does high forecast uncertainty preclude effective decision support? , 2005, Environ. Model. Softw..

[82]  Finn Verner Jensen,et al.  Public participation modelling using Bayesian networks in management of groundwater contamination , 2007, Environ. Model. Softw..

[83]  Claudia Pahl-Wostl,et al.  Information, public empowerment, and the management of urban watersheds , 2005, Environ. Model. Softw..

[84]  Dragan A. Savic,et al.  An evolutionary Bayesian belief network methodology for optimum management of groundwater contamination , 2009, Environ. Model. Softw..

[85]  Claudia Pahl-Wostl,et al.  Participative and Stakeholder-Based Policy Design, Evaluation and Modeling Processes , 2002 .

[86]  Ocean Data Assimilation, Initialization, and Predictions of ENSO with a Coupled GCM , 1999 .

[87]  Stuart Hamilton,et al.  Multi-model integration in a decision support system: a technical user interface approach for watershed and lake management scenarios , 2004, Environ. Model. Softw..

[88]  Christophe Le Page,et al.  Participatory Agent-Based Simulation for Renewable Resource Management: The Role of the Cormas Simulation Platform to Nurture a Community of Practice , 2012, J. Artif. Soc. Soc. Simul..

[89]  Erik Mostert,et al.  Participation for Sustainable Water Management , 2006 .

[90]  O. Varis,et al.  Chapter 10 Belief networks: Generating the feared dislocations , 2002 .

[91]  Thomas Berger,et al.  An agent-based simulation model of human-environment interactions in agricultural systems , 2011, Environ. Model. Softw..

[92]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[93]  Adrian C. Newton,et al.  Use of a Bayesian network for Red Listing under uncertainty , 2010, Environ. Model. Softw..

[94]  T. Söderqvist,et al.  Ecological-economic analysis of wetlands; scientific integration for management and policy , 2000 .

[95]  Rüdiger Schaldach,et al.  Coupled simulation of regional land use change and soil carbon sequestration: A case study for the state of Hesse in Germany , 2006, Environ. Model. Softw..

[96]  M Brugnach,et al.  More is not always better: coping with ambiguity in natural resources management. , 2011, Journal of environmental management.

[97]  M. Janssen Complexity and Ecosystem Management: The Theory and Practice of Multi-Agent Systems , 2003 .

[98]  David Nash,et al.  Using Monte-Carlo simulations and Bayesian Networks to quantify and demonstrate the impact of fertiliser best management practices , 2011, Environ. Model. Softw..

[100]  T. Peterson,et al.  Quantitative modeling of coupled natural/human systems: simulation of societal constraints on environmental action drawing on Luhmann's social theory , 2002 .

[101]  Finn Verner Jensen,et al.  Introduction to Bayesian Networks , 2008, Innovations in Bayesian Networks.

[102]  Geoff Coyle,et al.  Qualitative and quantitative modelling in system dynamics: some research questions , 2000 .

[103]  Päivi Elisabet Haapasaari,et al.  Baltic herring fisheries management: stakeholder views to frame the problem , 2012 .

[104]  Holger R. Maier,et al.  Management Option Rank Equivalence (MORE) - A new method of sensitivity analysis for decision-making , 2010, Environ. Model. Softw..

[105]  Shin-Cheng Yeh,et al.  Simulation of soil erosion and nutrient impact using an integrated system dynamics model in a watershed in Taiwan , 2006, Environ. Model. Softw..

[106]  P. Haapasaari,et al.  Incorporating stakeholders' knowledge to stock assessment: Central Baltic herring , 2013 .

[107]  Carl Mitchell,et al.  Adaptive modelling for adaptive water quality management in the Great Barrier Reef region, Australia , 2010, Environ. Model. Softw..

[108]  P J Bacon,et al.  Belief network models of land manager decisions and land use change. , 2002, Journal of environmental management.

[109]  David Butler,et al.  An evolutionary Bayesian belief network methodology for participatory decision making under uncertainty: an application to groundwater management. , 2012, Integrated environmental assessment and management.

[110]  M. Hare,et al.  Further towards a taxonomy of agent-based simulation models in environmental management , 2004, Math. Comput. Simul..

[111]  Sandra Johnson,et al.  Bayesian networks in environmental and resource management , 2012, Integrated environmental assessment and management.

[112]  J. Sterman Business Dynamics , 2000 .

[113]  A. Drogoul,et al.  Multi-Agent Simulation as a Tool for Modeling Societies: Application to Social Differentiation in Ant Colonies , 1992, MAAMAW.

[114]  Kemachandra Ranatunga,et al.  GROWEST PLUS: A tool for rapid assessment of seasonal growth for environmental planning and assessment , 2007, Environ. Model. Softw..

[115]  Ian P. Prosser,et al.  Modelling sediment delivery ratio over the Murray Darling Basin , 2006, Environ. Model. Softw..

[116]  Andrea Castelletti,et al.  Emulation techniques for the reduction and sensitivity analysis of complex environmental models , 2012, Environ. Model. Softw..

[117]  Heikki Lehtonen,et al.  Combining dynamic economic analysis and environmental impact modelling: Addressing uncertainty and complexity of agricultural development , 2007, Environ. Model. Softw..

[118]  Hélène Mathian,et al.  SIMPOP: A Multiagent System for the Study of Urbanism , 1997 .

[119]  William G. Booty,et al.  A decision support system for environmental effects monitoring , 2009, Environ. Model. Softw..

[120]  Yaman Barlas,et al.  Formal aspects of model validity and validation in system dynamics , 1996 .

[121]  Steffen Bayer,et al.  Business dynamics: Systems thinking and modeling for a complex world , 2004 .

[122]  Brendan A. Wintle,et al.  The Use of Bayesian Model Averaging to Better Represent Uncertainty in Ecological Models , 2003 .

[123]  M. B. Beck,et al.  Modelling Change in Environmental Systems , 1995 .

[124]  Jukka Corander,et al.  Experiences in Bayesian inference in Baltic salmon management , 2014 .

[125]  Brett A. Bryan,et al.  Science to improve regional environmental investment decisions , 2011, Environ. Model. Softw..

[126]  Serena H. Chen,et al.  Good practice in Bayesian network modelling , 2012, Environ. Model. Softw..

[127]  George P. Richardson,et al.  Group model building: problem structuring, policy simulation and decision support , 2007, J. Oper. Res. Soc..

[128]  Stefano Marsili-Libelli,et al.  Fuzzy prediction of the algal blooms in the Orbetello lagoon , 2004, Environ. Model. Softw..

[129]  Gregory R. Olsen,et al.  An Ontology for Engineering Mathematics , 1994, KR.

[130]  S. Kuikka,et al.  Modeling environmentally driven uncertainties in Baltic cod (Gadus morhua) management by Bayesian influence diagrams , 1999 .

[131]  Marco A. Janssen,et al.  An adaptive agent model for analysing co-evolution of management and policies in a complex rangeland system , 2000 .

[132]  R. McAllistera,et al.  Australian Rangelands as Complex Adaptive Systems : A Conceptual Model and Preliminary Results , 2003 .

[133]  A. Kaufmann,et al.  Modelling Self-Organization Processes in Socio- Economic and Ecological Systems for Supporting the Adaptive Management of Forests , 2004 .

[134]  Kenneth H. Reckhow,et al.  Bayesian Approaches in Ecological Analysis and Modeling , 2002 .

[135]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[136]  Saso Dzeroski,et al.  Automated discovery of a model for dinoflagellate dynamics , 2011, Environ. Model. Softw..

[137]  Mark E. Borsuk,et al.  A Bayesian network of eutrophication models for synthesis, prediction, and uncertainty analysis , 2004 .

[138]  Gerrit Hoogenboom,et al.  A web-based fuzzy expert system for frost warnings in horticultural crops , 2012, Environ. Model. Softw..

[139]  David M. Rocke,et al.  A knowledge-based model of watershed assessment for sediment , 2004, Environ. Model. Softw..

[140]  Yuqiong Liu,et al.  Linking science with environmental decision making: Experiences from an integrated modeling approach to supporting sustainable water resources management , 2008, Environ. Model. Softw..

[141]  J. Shukla,et al.  Seasonal Prediction over North America with a Regional Model Nested in a Global Model , 2000 .

[142]  Hedwig van Delden,et al.  Integrated assessment of agricultural policies with dynamic land use change modelling , 2010 .

[143]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[144]  Jun Bi,et al.  An adaptive agent-based modeling approach for analyzing the influence of transaction costs on emissions trading markets , 2011, Environ. Model. Softw..

[145]  Russell Richards,et al.  Bayesian belief modeling of climate change impacts for informing regional adaptation options , 2013, Environ. Model. Softw..

[146]  Ian P. Prosser,et al.  Modelling and testing spatially distributed sediment budgets to relate erosion processes to sediment yields , 2009, Environ. Model. Softw..

[147]  Clair Gough,et al.  Integrated Assessment: an emerging methodology for complex issues , 1998 .

[148]  Mark E. Borsuk,et al.  Assessing the decline of brown trout (Salmo trutta) in Swiss rivers using a Bayesian probability network , 2006 .

[149]  Mike Kirkby,et al.  Towards a modelling framework for integrated assessment in arid and semi-arid regions , 2009 .

[150]  Peter Struss,et al.  Intelligent Environmental Decision Support Systems , 2008 .

[151]  Marc C. Kennedy,et al.  A Bayesian sensitivity analysis applied to an Agent-based model of bird population response to landscape change , 2013, Environ. Model. Softw..

[152]  Reimund P. Rötter,et al.  Integration of Systems Network (SysNet) tools for regional land use scenario analysis in Asia , 2005, Environ. Model. Softw..

[153]  Anthony J. Jakeman,et al.  Model development for integrated assessment of water allocation options , 2004 .

[154]  Richard Forsyth The expert systems phenomenon , 1989 .

[155]  Anthony J. Jakeman,et al.  A Bayesian network approach for assessing the sustainability of coastal lakes in New South Wales, Australia , 2007, Environ. Model. Softw..

[156]  Hedwig van Delden,et al.  Xplorah, A multi-scale integrated land use model , 2008 .

[157]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[158]  Daniel G. Brown,et al.  Empirical characterisation of agent behaviours in socio-ecological systems , 2011, Environ. Model. Softw..

[159]  William K. Lauenroth,et al.  Models in Ecosystem Science , 2003, Models in Ecosystem Science.

[160]  Graeme McFerren,et al.  Fuzzy expert systems and GIS for cholera health risk prediction in southern Africa , 2007, Environ. Model. Softw..

[161]  Wendy S. Merritt,et al.  Using Bayesian Networks to complement conventional analyses to explore landholder management of native vegetation , 2011, Environ. Model. Softw..

[162]  Matthias Ruth,et al.  Using Dynamic Modeling to Scope Environmental Problems and Build Consensus , 1998, Environmental management.

[163]  Dimitris A. Karras,et al.  Fault tree analysis and fuzzy expert systems: Early warning and emergency response of landfill operations , 2009, Environ. Model. Softw..

[164]  Muhammad Akbar,et al.  A fully automated and integrated multi-scale forecasting scheme for emergency preparedness , 2013, Environ. Model. Softw..

[165]  Giovanni Ravazzani,et al.  Macroscopic cellular automata for groundwater modelling: A first approach , 2011, Environ. Model. Softw..

[166]  François Bousquet,et al.  Agent-based simulations of interactions between duck population, farming decisions and leasing of hunting rights in the Camargue (Southern France) , 2003 .

[167]  Stefano Alvisi,et al.  Fuzzy Neural Networks for water level and discharge forecasting , 2010 .

[168]  Y. Barlas Multiple tests for validation of system dynamics type of simulation models , 1989 .

[169]  Sophie Bastin,et al.  Model of the Regional Coupled Earth system (MORCE): Application to process and climate studies in vulnerable regions , 2012, Environ. Model. Softw..

[170]  Yang-Chi Chang,et al.  A system dynamic based DSS for sustainable coral reef management in Kenting coastal zone, Taiwan , 2008 .

[171]  Integration of biological, economic and sociological knowledge by Bayesian belief networks: the interdisciplinary evaluation of potential Baltic salmon management plan , 2010 .

[172]  Electra Kalaugher,et al.  An integrated biophysical and socio-economic framework for analysis of climate change adaptation strategies: The case of a New Zealand dairy farming system , 2013, Environ. Model. Softw..

[173]  J. Bromley,et al.  The use of Hugin® to develop Bayesian networks as an aid to integrated water resource planning , 2005, Environ. Model. Softw..

[174]  A. Jakeman,et al.  Complexity and Integrated Resources Management , 2004 .

[175]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[176]  Carlos Miguel Herrero-Jimenez An expert system for the identification of environmental impact based on a geographic information system , 2012, Expert Syst. Appl..

[177]  Andrea Castelletti,et al.  Putting humans in the loop: Social computing for Water Resources Management , 2012, Environ. Model. Softw..

[178]  John P. Norton,et al.  To what extent, and how, might uncertainty be defined? Comments engendered by "Defining uncertainty: a conceptual basis for uncertainty management in model-based decision support": Walker et al., Integrated Assessment 4: 1, 2003 , 2006 .

[179]  Christophe Le Page,et al.  Agent based simulation of a small catchment water management in northern Thailand: Description of the CATCHSCAPE model , 2003 .

[180]  Alexey Voinov,et al.  Spatial Simulation Using the SME , 2004 .

[181]  François Bousquet,et al.  Role-playing games for opening the black box of multi-agent systems: method and lessons of its application to Senegal River Valley irrigated systems , 2001, J. Artif. Soc. Soc. Simul..

[182]  M. V. D. Belt,et al.  Mediated Modeling: A System Dynamics Approach To Environmental Consensus Building , 2004 .

[183]  Claudio Carnevale,et al.  An integrated assessment tool to define effective air quality policies at regional scale , 2012, Environ. Model. Softw..

[184]  Ulises Cortés,et al.  Supporting decision making in urban wastewater systems using a knowledge-based approach , 2011, Environ. Model. Softw..

[185]  Andreas Lindén,et al.  Using the negative binomial distribution to model overdispersion in ecological count data. , 2011, Ecology.

[186]  Anthony J. Jakeman,et al.  A methodology for the design and development of integrated models for policy support , 2011, Environ. Model. Softw..

[187]  S. Kuikka,et al.  A Bayesian network for analyzing biological acute and long-term impacts of an oil spill in the Gulf of Finland. , 2011, Marine pollution bulletin.

[188]  Thomas Berger,et al.  Agent-based spatial models applied to agriculture: A simulation tool , 2001 .

[189]  David C. Lane,et al.  Rerum cognoscere causas: Part I — How do the ideas of system dynamics relate to traditional social theories and the voluntarism/determinism debate? , 2001 .

[190]  Anthony J. Jakeman,et al.  Integrated assessment and modelling: features, principles and examples for catchment management , 2003, Environ. Model. Softw..

[191]  Dmitriĭ Olegovich Logofet,et al.  Stability of Biological Communities , 1983 .

[192]  Philippe Faverdin,et al.  RECORD: an open platform to build, evaluate and simulate integrated models of farming and agro-ecosystems. , 2012 .

[193]  Robbie Price,et al.  Choosing Regional Futures: Challenges and choices in building integrated models to support long‐term regional planning in New Zealand* , 2008 .

[194]  Richard S. Sojda,et al.  Empirical evaluation of decision support systems: Needs, definitions, potential methods, and an example pertaining to waterfowl management , 2007, Environ. Model. Softw..

[195]  Luis F. Luna-Reyes,et al.  Collecting and analyzing qualitative data for system dynamics: methods and models , 2003 .

[196]  Holger R. Maier,et al.  Uncertainty in Environmental Decision Making: Issues, Challenges and Future Directions , 2008 .

[197]  Christian Mullon,et al.  Integrated modelling of the ecosystem of the Niger river inland delta in Mali , 2003 .

[198]  Andrea Castelletti,et al.  Bayesian Networks and participatory modelling in water resource management , 2007, Environ. Model. Softw..

[199]  Abraham Kandel,et al.  Fuzzy Expert Systems , 1991 .

[200]  Maja Schlüter,et al.  Application of a GIS-based simulation tool to illustrate implications of uncertainties for water management in the Amudarya river delta , 2007, Environ. Model. Softw..

[201]  Anthony J. Jakeman,et al.  Artificial Intelligence techniques: An introduction to their use for modelling environmental systems , 2008, Math. Comput. Simul..

[202]  Jerry Nedelman,et al.  Book review: “Bayesian Data Analysis,” Second Edition by A. Gelman, J.B. Carlin, H.S. Stern, and D.B. Rubin Chapman & Hall/CRC, 2004 , 2005, Comput. Stat..

[203]  Ezio Todini,et al.  Role and treatment of uncertainty in real‐time flood forecasting , 2004 .

[204]  Stefano Alvisi,et al.  Fuzzy neural networks for water level and discharge forecasting with uncertainty , 2010, Environ. Model. Softw..

[205]  Günther Fischer,et al.  Model based analysis of future land-use development in China , 2001 .

[206]  R. van der Veeren,et al.  Integrated economic-ecological analysis and evaluation of management strategies on nutrient abatement in the Rhine basin. , 2002, Journal of environmental management.

[207]  Timothy A. Kohler,et al.  Dynamics in human and primate societies: agent-based modeling of social and spatial processes , 2000 .

[208]  Rogelio Oliva,et al.  The greater whole: Towards a synthesis of system dynamics and soft systems methodology , 1998, Eur. J. Oper. Res..

[209]  Barry Richmond,et al.  Systems thinking: critical thinking skills for the 1990s and beyond , 1993 .

[210]  Donald A. Waterman,et al.  A Guide to Expert Systems , 1986 .

[211]  Mukand S. Babel,et al.  Evaluation of annualized agricultural nonpoint source model for a watershed in the Siwalik Hills of Nepal , 2006, Environ. Model. Softw..

[212]  J. Rotmans Methods for IA: The challenges and opportunities ahead , 1998 .

[213]  Päivi Elisabet Haapasaari,et al.  Integration of biological, economic, and sociological knowledge by Bayesian belief networks: the interdisciplinary evaluation of potential management plans for Baltic salmon , 2011 .

[214]  B. Münier,et al.  Combined ecological and economic modelling in agricultural land use scenarios , 2004 .

[215]  Alexey A. Voinov,et al.  Effectiveness of a participatory modeling effort to identify and advance community water resource goals in St. Albans, Vermont , 2010, Environ. Model. Softw..

[216]  J. P. Norton,et al.  Sensitivity and structure assessment of a software tool to gauge the ecological impact of flow scenarios , 2006 .

[217]  Christos Makropoulos,et al.  A hybrid artificial intelligence modelling framework for the simulation of the complete, socio-technical, urban water system , 2012 .

[218]  Blaz Zupan,et al.  proDEX - A DSS tool for environmental decision-making , 2006, Environ. Model. Softw..

[219]  Grant Hamilton,et al.  An approximate Bayesian computation approach for estimating parameters of complex environmental processes in a cellular automata , 2012, Environ. Model. Softw..

[220]  Jacques-André Landry,et al.  A decision support system to assist the sustainable management of navigation activities in the St. Lawrence River Estuary, Canada , 2011, Environ. Model. Softw..

[221]  Flavie Cernesson,et al.  Concepts and methods for analysing the role of Information and Communication tools (IC-tools) in Social Learning processes for River Basin Management , 2007, Environ. Model. Softw..

[222]  John Bromley,et al.  Integrated water resources management of overexploited hydrogeological systems using Object-Oriented Bayesian Networks , 2010, Environ. Model. Softw..

[223]  Y. Barlas,et al.  Environmental sustainability in an agricultural development project: a system dynamics approach. , 2002, Journal of environmental management.

[224]  François Bousquet,et al.  Modelling with stakeholders , 2010, Environ. Model. Softw..

[225]  Naeem,et al.  Ecosystems and Human Well-Being: Biodiversity Synthesis , 2005 .

[226]  Jie Shi,et al.  Multi-objective modelling and decision support using a Bayesian network approximation to a non-point source pollution model , 2007, Environ. Model. Softw..

[227]  Jarno Vanhatalo,et al.  Species distribution modeling with Gaussian processes : A case study with the youngest stages of sea spawning whitefish (Coregonus lavaretus L. s.l.) larvae , 2012 .

[228]  Marco A. Janssen,et al.  An exploratory integrated model to assess management of lake eutrophication , 2001 .

[229]  Giorgos Mountrakis,et al.  An integrated monitoring/modeling framework for assessing human-nature interactions in urbanizing watersheds: Wappinger and Onondaga Creek watersheds, New York, USA , 2012, Environ. Model. Softw..

[230]  Nigel Gilbert,et al.  Agent Based Modelling , 2014 .

[231]  John Sherington,et al.  Participatory research methods—Implementation, effectiveness and institutional context , 1997 .

[232]  Silke Bauer,et al.  What decision rules might pink-footed geese use to depart on migration? An individual-based model , 2009 .

[233]  C. Pahl-Wostl,et al.  The implications of complexity for integrated resources management , 2007, Environ. Model. Softw..

[234]  Roland W. Scholz,et al.  Feedback loops and types of adaptation in the modelling of land-use decisions in an agent-based simulation , 2012, Environ. Model. Softw..

[235]  Henriëtte S. Otter,et al.  Land Use Changes in Regional Economic Theory , 2001 .

[236]  Paul Krause,et al.  Bayesian Networks for the management of greenhouse gas emissions in the British agricultural sector , 2012, Environ. Model. Softw..

[237]  Jin Teng,et al.  An integrated modelling framework for regulated river systems , 2013, Environ. Model. Softw..

[238]  Hans Jørgen Henriksen,et al.  Use of Bayesian belief networks for dealing with ambiguity in integrated groundwater management , 2012, Integrated environmental assessment and management.

[239]  Soon-Thiam Khu,et al.  An integrated model for water management in a rapidly urbanizing catchment , 2011, Environ. Model. Softw..

[240]  Olivier Barreteau,et al.  Multi-agent systems and role games : collective learning processes for ecosystem management , 2002 .

[241]  M. Rivington,et al.  An integrated assessment approach to conduct analyses of climate change impacts on whole-farm systems , 2007, Environ. Model. Softw..

[242]  J. Lansing,et al.  Emergent Properties of Balinese Water Temple Networks: Coadaptation on a Rugged Fitness Landscape , 1993 .