Modelling with stakeholders e Next generation

This paper updates and builds on 'Modelling with Stakeholders' Voinov and Bousquet, 2010 which demonstrated the importance of, and demand for, stakeholder participation in resource and environmental modelling. This position paper returns to the concepts of that publication and reviews the progress made since 2010. A new development is the wide introduction and acceptance of social media and web applications, which dramatically changes the context and scale of stakeholder interactions and participation. Technology advances make it easier to incorporate information in interactive formats via visualization and games to augment participatory experiences. Citizens as stakeholders are increasingly demanding to be engaged in planning decisions that affect them and their communities, at scales from local to global. How people interact with and access models and data is rapidly evolving. In turn, this requires changes in how models are built, packaged, and disseminated: citizens are less in awe of experts and external authorities, and they are increasingly aware of their own capabilities to provide inputs to planning processes, including models. The continued acceleration of environmental degradation and natural resource depletion accompanies these societal changes, even as there is a growing acceptance of the need to transition to alternative, possibly very different, life styles. Substantive transitions cannot occur without significant changes in human behaviour and perceptions. The important and diverse roles that models can play in guiding human behaviour, and in disseminating and increasing societal knowledge, are a feature of stakeholder processes today. Display Omitted Participatory modelling has become mainstream in resource and environmental management.We review recent contributions to participatory environmental modelling to identify the tools, methods and processes applied.Global internet connectivity, social media and crowdsourcing create opportunities for participatory modelling.We suggest structured mechanisms to examine and account for human biases and beliefs in participatory modelling.Advanced visualization tools, gaming, and virtual environments improve communication with stakeholders.

[1]  P. Kirschner,et al.  Computer models as social learning tools in participatory integrated assessment , 2011 .

[2]  Jean-Christophe Gaillard,et al.  Integrating knowledge and actions in disaster risk reduction: the contribution of participatory mapping , 2012 .

[3]  S. Sheppard,et al.  Utilizing Participatory Scenario-Based Approaches to Design Proactive Responses to Climate Change in the Face of Uncertainties , 2011 .

[4]  M. Rivington,et al.  Raising the bar? - The challenges of evaluating the outcomes of environmental modelling and software , 2011, Environ. Model. Softw..

[5]  François Bousquet,et al.  Modelling with stakeholders within a development project , 2010, Environ. Model. Softw..

[6]  Bertrand De Longueville,et al.  "OMG, from here, I can see the flames!": a use case of mining location based social networks to acquire spatio-temporal data on forest fires , 2009, LBSN '09.

[7]  Kerrie L. Mengersen,et al.  A software tool for elicitation of expert knowledge about species richness or similar counts , 2012, Environ. Model. Softw..

[8]  Anthony J. Jakeman,et al.  Selecting among five common modelling approaches for integrated environmental assessment and management , 2013, Environ. Model. Softw..

[9]  Neil Collier,et al.  Scenario modelling to support industry strategic planning and decision making , 2014, Environ. Model. Softw..

[10]  Daniel J. Simons,et al.  The Invisible Gorilla: And Other Ways Our Intuitions Deceive Us , 2010 .

[11]  M. Edelstein.  Citizen Science: A Study of People, Expertise and Sustainable Development , 1998 .

[12]  Laura Uusitalo,et al.  An overview of methods to evaluate uncertainty of deterministic models in decision support , 2015, Environ. Model. Softw..

[13]  F. Heylighen,et al.  Cultural Evolution and Memetics , 2008 .

[14]  Wendy D. Welsh.  Water balance modelling in Bowen, Queensland, and the ten iterative steps in model development and evaluation , 2008, Environ. Model. Softw..

[15]  A. Hama,et al.  The Invisible Gorilla: And Other Ways Our Intuitions Deceive Us , 2010 .

[16]  Carl D. Shapiro,et al.  Adaptive management: The U.S. Department of the Interior technical guide , 2009 .

[17]  Sondoss Elsawah,et al.  A methodology for eliciting, representing, and analysing stakeholder knowledge for decision making on complex socio-ecological systems: from cognitive maps to agent-based models. , 2015, Journal of environmental management.

[18]  Petr Cizek,et al.  The ethics of Google Earth: crossing thresholds from spatial data to landscape visualisation. , 2009, Journal of environmental management.

[19]  Jean-Pierre Jessel,et al.  Origins of Serious Games , 2011, Serious Games and Edutainment Applications.

[20]  Alexey A. Voinov,et al.  Effectiveness of a participatory modeling effort to identify and advance community water resource goals in St. Albans, Vermont , 2010, Environ. Model. Softw..

[21]  Michael Batty,et al.  Virtual Environments Begin to Embrace Process‐based Geographic Analysis , 2015, Trans. GIS.

[22]  François Bousquet,et al.  Modelling with stakeholders , 2010, Environ. Model. Softw..

[23]  Russell Richards,et al.  A participatory approach for system conceptualization and analysis applied to coastal management in Egypt , 2014, Environ. Model. Softw..

[24]  A. Maslow.  A Theory of Human Motivation , 1943 .

[25]  O Anthony,et al.  Probabilistic uncertainty speci cation : Overview , elaboration techniques and their application to a mechanistic model of carbon ux , 2011 .

[26]  B. Bryan,et al.  Mapping community values for natural capital and ecosystem services , 2009 .

[27]  Gary P. Kofinas,et al.  Ten Heuristics for Interdisciplinary Modeling Projects , 2002, Ecosystems.

[28]  Nuno Videira,et al.  A participatory modelling approach to support integrated sustainability assessment processes , 2010 .

[29]  E. Clark.  Strategies for Communicating. , 1978 .

[30]  David W. Cash,et al.  Knowledge systems for sustainable development , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Archon Fung,et al.  Six Models for the Internet + Politics , 2013 .

[32]  Todd M. Swannack,et al.  Strategies for communicating systems models , 2014, Environ. Model. Softw..

[33]  Verena Rieser,et al.  Agent-based modelling of land use dynamics and residential quality of life for future scenarios , 2013, Environ. Model. Softw..

[34]  Jerome R. Ravetz,et al.  The emergence of post-normal science , 1993 .

[35]  Candie C. Wilderman,et al.  Public Participation in Scientific Research: a Framework for Deliberate Design , 2012 .

[36]  Julia C. Lo,et al.  Integrated, ecosystem-based Marine Spatial Planning: Design and results of a game-based, quasi-experiment , 2013 .

[37]  T. Lynam,et al.  A review of tools for incorporating community knowledge, preferences, and values into decision making in natural resources management , 2007 .

[38]  H. Simon.  Bounded Rationality and Organizational Learning , 1991 .

[39]  Joseph Prestwich,et al.  Geological Society of London , 2009, Nature.

[40]  Patrick M. Reed,et al.  Identifying parametric controls and dependencies in integrated assessment models using global sensitivity analysis , 2014, Environ. Model. Softw..

[41]  Christophe Le Page,et al.  Spatial representations are not neutral: Lessons from a participatory agent-based modelling process in a land-use conflict , 2013, Environ. Model. Softw..

[42]  Thorsten R. Arnold,et al.  Procedural knowledge for integrated modelling: Towards the Modelling Playground , 2013, Environ. Model. Softw..

[43]  Ioan Fazey,et al.  Integrating local and scientific knowledge for environmental management. , 2010, Journal of environmental management.

[44]  Guillaume Martin,et al.  Forage rummy: A game to support the participatory design of adapted livestock systems , 2011, Environ. Model. Softw..

[45]  Robert Muetzelfeldt,et al.  The Simile visual modelling environment , 2003 .

[46]  Christophe Le Page,et al.  Role-Playing Games, Models and Negotiation Processes , 2003 .

[47]  Henk Ritzema,et al.  Using participatory modelling to compensate for data scarcity in environmental planning: A case study from India , 2010, Environ. Model. Softw..

[48]  Dan Cornford,et al.  Managing uncertainty in integrated environmental modelling: The UncertWeb framework , 2013, Environ. Model. Softw..

[49]  Mark E. Borsuk,et al.  Bridging uncertain and ambiguous knowledge with imprecise probabilities , 2012, Environ. Model. Softw..

[50]  Christopher Pettit,et al.  Identifying strengths and weaknesses of landscape visualisation for effective communication of future alternatives , 2011 .

[51]  Corrine Noel Knapp,et al.  Using Participatory Workshops to Integrate State-and-Transition Models Created With Local Knowledge and Ecological Data , 2011 .

[52]  Johann Feichter,et al.  Climate Change and Policy , 2011 .

[53]  A. Adla,et al.  A Proposal of Toolkit for GDSS Facilitators , 2011 .

[54]  F. Fischer.  Citizens, Experts, and the Environment: The Politics of Local Knowledge , 2000 .

[55]  Diederik Jacques,et al.  Multimodel Simulation of Water Flow in a Field Soil Using Pedotransfer Functions , 2009 .

[56]  Carlo Giupponi,et al.  Integrated assessment of sea-level rise adaptation strategies using a Bayesian decision network approach , 2013, Environ. Model. Softw..

[57]  Ann-Margaret Esnard,et al.  An integrated multi-criteria scenario evaluation web tool for participatory land-use planning in urbanized areas: The Ecosystem Portfolio Model , 2013, Environ. Model. Softw..

[58]  Andrea Castelletti,et al.  A general framework for Dynamic Emulation Modelling in environmental problems , 2012, Environ. Model. Softw..

[59]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[60]  Alassane Bah,et al.  A bottom-up participatory modelling process for a multi-level agreement on environmental uncertainty management in West Africa , 2013 .

[61]  L. Mermet,et al.  Strategic Environmental Management Analysis: Addressing the Blind Spots of Collaborative Approaches , 2011 .

[62]  Joaquín Izquierdo,et al.  Joint stakeholder decision-making on the management of the Silao-Romita aquifer using AHP , 2014, Environ. Model. Softw..

[63]  Nicole Kranz,et al.  Cultural Factors as Co-Determinants of Participation in River Basin Management , 2007 .

[64]  Keith E. Stanovich,et al.  A framework for critical thinking, rational thinking, and intelligence. , 2010 .

[65]  Roman Seidl,et al.  A functional-dynamic reflection on participatory processes in modeling projects , 2015, Ambio.

[66]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[67]  Christopher A. Lepczyk,et al.  Local‐Scale Dynamics and Local Drivers of Bushmeat Trade , 2014, Conservation biology : the journal of the Society for Conservation Biology.

[68]  Malgorzata Hanzl,et al.  Information technology as a tool for public participation in urban planning: a review of experiments and potentials , 2007 .

[69]  Trevor Page,et al.  Eliciting fuzzy distributions from experts for ranking conceptual risk model components , 2012, Environ. Model. Softw..

[70]  S. Arnstein,et al.  Ladder of Citizen Participation , 2020 .

[71]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[72]  Dennis A. Rondinelli,et al.  Development Projects as Policy Experiments: An Adaptive Approach to Development Administration , 1985 .

[73]  Electra Kalaugher,et al.  An integrated biophysical and socio-economic framework for analysis of climate change adaptation strategies: The case of a New Zealand dairy farming system , 2013, Environ. Model. Softw..

[74]  Gregory A Petsko.  The wisdom, and madness, of crowds , 2008, Genome Biology.

[75]  Raimo P. Hämäläinen,et al.  Web-Based Decision Support: Creating a Culture of Applying Multi-criteria Decision Analysis and Web-Supported Participation in Environmental Decision Making , 2010 .

[76]  E. Gaddis,et al.  Lessons for successful participatory watershed modeling: A perspective from modeling practitioners , 2008 .

[77]  Phillip Taru,et al.  A participatory approach in GIS data collection for flood risk management, Muzarabani district, Zimbabwe , 2015, Arabian Journal of Geosciences.

[78]  H. Simon,et al.  Invariants of human behavior. , 1990, Annual review of psychology.

[79]  Mark E. Koltko-Rivera.  Rediscovering the Later Version of Maslow's Hierarchy of Needs: Self-Transcendence and Opportunities for Theory, Research, and Unification , 2006 .

[80]  A. Hama.  Predictably Irrational: The Hidden Forces That Shape Our Decisions , 2010 .

[81]  M. Reynolds,et al.  Critical systems heuristics , 2010 .

[82]  Raimo P. Hämäläinen,et al.  Participatory multicriteria decision analysis with Web-HIPRE: a case of lake regulation policy , 2004, Environ. Model. Softw..

[83]  Yun Chen,et al.  The spatial framework for weight sensitivity analysis in AHP-based multi-criteria decision making , 2013, Environ. Model. Softw..

[84]  A. Agrawal.  Dismantling the Divide Between Indigenous and Scientific Knowledge , 1995 .

[85]  C. Ulrich,et al.  The added value of participatory modelling in fisheries management – what has been learnt? , 2012 .

[86]  E. Bonari,et al.  Mapping local spatial knowledge in the assessment of agricultural systems: A case study on the provision of agricultural services , 2013 .

[87]  Raffaele Giordano,et al.  A fuzzy GIS-based system to integrate local and technical knowledge in soil salinity monitoring , 2012, Environ. Model. Softw..

[88]  Laurence Smith,et al.  The role of expert opinion in environmental modelling , 2012, Environ. Model. Softw..

[89]  Shih-Chung Kang,et al.  Development of a 3D virtual environment for improving public participation: Case study - The Yuansantze Flood Diversion Works Project , 2011, Adv. Eng. Informatics.

[90]  L. G. White,et al.  Approaches to Land Use Policy , 1979 .

[91]  Louise Sauvé,et al.  Games, Simulations, and Simulation Games for Learning: Definitions and Distinctions , 2011 .

[92]  A. Hoekstra,et al.  An Empirical Analysis of Stakeholders’ Influence on Policy Development: the Role of Uncertainty Handling , 2011 .

[93]  Wolfgang Britz,et al.  Simulating the viability of water institutions under volatile rainfall conditions - The case of the Lake Naivasha Basin , 2016, Environ. Model. Softw..

[94]  Keith E. Stanovich,et al.  The Robot's Rebellion: Finding Meaning in the Age of Darwin , 2004 .

[95]  Ronald Fagin,et al.  Belief, Awareness, and Limited Reasoning. , 1987, Artif. Intell..

[96]  Jerome K. Vanclay,et al.  Stakeholder engagement in social learning to resolve controversies over land-use change to plantation forestry , 2011 .

[97]  T. Edwin Chow,et al.  The consensus of local stakeholders and outside experts in suitability modeling for future camp development , 2010 .

[98]  Karen Anderson,et al.  Visualising Sea-Level Rise at a Coastal Heritage Site: Participatory Process and Creative Communication , 2014 .

[99]  Carl Mitcham,et al.  Jacques Ellul and the Technological Society , 1971 .

[100]  Elizabeth A. Fulton,et al.  A multi-model approach to engaging stakeholder and modellers in complex environmental problems , 2015 .

[101]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[102]  J. Silvertown.  A new dawn for citizen science. , 2009, Trends in ecology & evolution.

[103]  Raimo P. Hämäläinen,et al.  Behavioural issues in environmental modelling - The missing perspective , 2015, Environmental Modelling & Software.

[104]  RobinsonStewart,et al.  Conceptual modeling for simulation-based serious gaming , 2012, DSS 2012.

[105]  Ralf Wieland,et al.  Environmental impact assessment based on dynamic fuzzy simulation , 2014, Environ. Model. Softw..

[106]  Simon Stisen,et al.  Stakeholder driven update and improvement of a national water resources model , 2013, Environ. Model. Softw..

[107]  Piotr Jankowski,et al.  GIS-Supported Collaborative Decision Making: Results of an Experiment , 2001 .

[108]  S. Post.  Christmas Bird Count , 2009 .

[109]  Jelle Hurkens,et al.  A generic Integrated Spatial Decision Support System for urban and regional planning , 2011 .

[110]  Shanghong Zhang,et al.  A real-time interactive simulation framework for watershed decision making using numerical models and virtual environment , 2013 .

[111]  Joseph H. A. Guillaume,et al.  Integrated assessment and modelling: Overview and synthesis of salient dimensions , 2015, Environ. Model. Softw..

[112]  Jason Papathanasiou,et al.  Design of a data-driven environmental decision support system and testing of stakeholder data-collection , 2014, Environ. Model. Softw..

[113]  David P. Hamilton,et al.  Ten steps applied to development and evaluation of process-based biogeochemical models of estuaries , 2008, Environ. Model. Softw..

[114]  Cathy S. Greenblat,et al.  Designing Games and Simulations: An Illustrated Handbook , 1987 .

[115]  Aat Barendregt,et al.  Evaluating the Role of Participation in Modeling Studies for Environmental Planning , 2011 .

[116]  C. Folke,et al.  REDISCOVERY OF TRADITIONAL ECOLOGICAL KNOWLEDGE AS ADAPTIVE MANAGEMENT , 2000 .

[117]  Ortwin Renn,et al.  Can Participatory Modelling Support Social Learning in Marine Fisheries? Reflections from the Invest in Fish South West Project , 2011 .

[118]  Francisco Escobar,et al.  Participatory land use modelling, pathways to an integrated approach , 2014, Environ. Model. Softw..

[119]  J. Creighton.  The Public Participation Handbook: Making Better Decisions Through Citizen Involvement , 2005 .

[120]  Andreas Neef,et al.  Building on qualitative datasets and participatory processes to simulate land use change in a mountain watershed of Northwest Vietnam , 2011, Environ. Model. Softw..

[121]  Anne M. Larson,et al.  Democratic decentralisation through a natural resource lens , 2005 .

[122]  Marie-Odile Cordier,et al.  A generic framework for scenario exercises using models applied to water-resource management , 2012, Environ. Model. Softw..

[123]  Peter Reichert,et al.  Constructing, evaluating and visualizing value and utility functions for decision support , 2013, Environ. Model. Softw..

[124]  William C. Clarka,et al.  Boundary Work for Sustainable Development : Natural Resource , 2011 .

[125]  Philippe Lecomte,et al.  Integrated participatory modelling of actual farms to support policy making on sustainable intensification , 2011 .

[126]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[127]  M. Haklay.  Citizen Science and Volunteered Geographic Information: Overview and Typology of Participation , 2013 .

[128]  R. Lewontin.  ‘The Selfish Gene’ , 1977, Nature.

[129]  John Bromley,et al.  Supporting decision making under uncertainty: Development of a participatory integrated model for water management in the middle Guadiana river basin , 2013, Environ. Model. Softw..

[130]  Michael Hoffmann,et al.  Understanding Ill-Structured Engineering Ethics Problems Through a Collaborative Learning and Argument Visualization Approach , 2014, Sci. Eng. Ethics.

[131]  Michael Winter,et al.  Valuing local knowledge as a source of expert data: Farmer engagement and the design of decision support systems , 2012, Environ. Model. Softw..

[132]  Sophia B. Liu,et al.  USGS iCoast -- did the coast change?: designing a crisis crowdsourcing App to validate coastal change models , 2014, CSCW Companion '14.

[133]  Craig A. Aumann,et al.  Constructing model credibility in the context of policy appraisal , 2011, Environ. Model. Softw..

[134]  F. Chapin,et al.  A safe operating space for humanity , 2009, Nature.

[135]  E. Diener,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Needs and Subjective Well-Being Around the World , 2011 .

[136]  Ron Janssen,et al.  Effectiveness of collaborative map-based decision support tools: Results of an experiment , 2013, Environ. Model. Softw..

[137]  Alec Foster,et al.  Volunteered geographic information, urban forests, & environmental justice , 2015, Comput. Environ. Urban Syst..

[138]  Andrea Castelletti,et al.  Putting humans in the loop: Social computing for Water Resources Management , 2012, Environ. Model. Softw..

[139]  Carlo Giupponi,et al.  Innovative approaches to integrated global change modelling , 2013, Environ. Model. Softw..

[140]  J. Cohn.  Citizen Science: Can Volunteers Do Real Research? , 2008 .

[141]  J. Greene.  Stakeholder participation in evaluation design: Is it worth the effort? , 1987 .

[142]  A. Marshall,et al.  Mapping socio-economic scenarios of land cover change: a GIS method to enable ecosystem service modelling. , 2011, Journal of environmental management.

[143]  Serena H. Chen,et al.  Good practice in Bayesian network modelling , 2012, Environ. Model. Softw..

[144]  Jeremy E. Oakley,et al.  A web-based tool for eliciting probability distributions from experts , 2014, Environ. Model. Softw..

[145]  P. Glynn.  Integrated Environmental Modelling: human decisions, human challenges , 2015, Special Publications.

[146]  Carl Mitcham,et al.  Jacques Ellul and the techonological society in the 21st century , 2013 .

[147]  Ian D. Bishop,et al.  Spatial model steering, an exploratory approach to uncertainty awareness in land use allocation , 2013, Environ. Model. Softw..

[148]  Nathan Yau,et al.  Visualize This: The FlowingData Guide to Design, Visualization, and Statistics , 2011 .

[149]  Christopher J. A. Macleod,et al.  Modellers' roles in structuring integrative research projects , 2013, Environ. Model. Softw..

[150]  C. Folke,et al.  Trust-building, Knowledge Generation and Organizational Innovations: The Role of a Bridging Organization for Adaptive Comanagement of a Wetland Landscape around Kristianstad, Sweden , 2006 .

[151]  Ulrik W. Nash,et al.  The Curious Anomaly of Skewed Judgment Distributions and Systematic Error in the Wisdom of Crowds , 2014, PloS one.

[152]  Jean-Louis Fusillier,et al.  Coping with Urban & Agriculture Water Demand Uncertainty in Water Management Plan Design: the Interest of Participatory Scenario Analysis , 2014, Water Resources Management.

[153]  M. Reed.  Stakeholder participation for environmental management: A literature review , 2008 .

[154]  Christine E. Dunn,et al.  Geo-information tools for participatory spatial planning: Fulfilling the criteria for ‘good’ governance? , 2012 .

[155]  K. Blackstock,et al.  Linking process to outcomes — Internal and external criteria for a stakeholder involvement in River Basin Management Planning , 2012 .

[156]  Kevin Crowston,et al.  Citizen science system assemblages: understanding the technologies that support crowdsourced science , 2012, iConference '12.

[157]  Alexander Y. Sun.  Enabling collaborative decision-making in watershed management using cloud-computing services , 2013, Environ. Model. Softw..

[158]  Francis Gassert,et al.  Biophysical, Socioeconomic, and Geopolitical Vulnerabilities to Hydropower Development on the Nu River, China , 2013 .

[159]  Lawrence S. Sugiyama.  Evolutionary psychology: The new science of the mind , 2001 .

[160]  George Ritzer,et al.  The Technological Society: Social Theory, McDonaldization and the Prosumer , 2013 .

[161]  Michael K. McCall,et al.  Participatory Action Research and Disaster Risk , 2011 .

[162]  P. Fayers,et al.  The Visual Display of Quantitative Information , 1990 .

[163]  Anthony O'Hagan,et al.  Probabilistic uncertainty specification: Overview, elaboration techniques and their application to a mechanistic model of carbon flux , 2012, Environ. Model. Softw..

[164]  Sophia B. Liu,et al.  Crisis Crowdsourcing Framework: Designing Strategic Configurations of Crowdsourcing for the Emergency Management Domain , 2014, Computer Supported Cooperative Work (CSCW).

[165]  Alassane Bah,et al.  A Participatory Modeling Process to Capture Indigenous Ways of Adaptability to Uncertainty: Outputs From an Experiment in West , 2013 .

[166]  Gerardine DeSanctis,et al.  A foundation for the study of group decision support systems , 1987 .

[167]  W. Clark,et al.  Boundary work for sustainable development: Natural resource management at the Consultative Group on International Agricultural Research (CGIAR) , 2011, Proceedings of the National Academy of Sciences.

[168]  John McKinnon,et al.  Ways of seeing environmental change: Participatory research engagement in Yunnan, China, with ethnic minority Hani participants , 2010 .

[169]  Pebesma Edzer,et al.  Managing uncertainty in integrated environmental modelling frameworks: The UncertWeb framework , 2012 .

[170]  D. Kahan.  Why we are poles apart on climate change , 2012, Nature.

[171]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[172]  Steven A. Gray,et al.  Differences in farmer and expert beliefs and the perceived impacts of conservation agriculture , 2014 .

[173]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[174]  Oz Sahin,et al.  Paradigm shift to enhanced water supply planning through augmented grids, scarcity pricing and adaptive factory water: A system dynamics approach , 2016, Environ. Model. Softw..

[175]  George P. Richardson,et al.  Group Model-Building 'Scripts' as a Collaborative Planning Tool , 2012 .

[176]  A. Perrillat-Collomb,et al.  Participatory 3-dimension mapping: A tool for encouraging multi-caste collaboration to climate change adaptation and disaster risk reduction , 2013 .

[177]  R. Craig,et al.  Designing Administrative Law for Adaptive Management , 2014 .

[178]  Steffen Fritz,et al.  Geo-Wiki: An online platform for improving global land cover , 2012, Environ. Model. Softw..

[179]  Judith Tsouvalis,et al.  Building 'participation' upon critique: The Loweswater Care Project, Cumbria, UK , 2012, Environ. Model. Softw..

[180]  Reinout Heijungs,et al.  Methods for uncertainty propagation in life cycle assessment , 2014, Environ. Model. Softw..

[181]  Javier Martinez,et al.  Shifting Boundaries of Volunteered Geographic Information Systems and Modalities: Learning from PGIS , 2015 .

[182]  Marie-Joëlle Rochet,et al.  Qualitative modelling and indicators of exploited ecosystems , 2009 .

[183]  Pierre D. Glynn,et al.  W(h)ither the Oracle? Cognitive biases and other human challenges of integrated environmental modeling , 2014 .

[184]  Jeffrey D. Walker,et al.  A client-side web application for interactive environmental simulation modeling , 2014, Environ. Model. Softw..

[185]  R. Costanza,et al.  Watershed management and the Web , 1999 .

[186]  Jane Hunter,et al.  Providing online access to hydrological model simulations through interactive geospatial animations , 2013, Environ. Model. Softw..

[187]  Piotr Jankowski,et al.  Towards Participatory Geographic Information Systems for community-based environmental decision making. , 2009, Journal of environmental management.

[188]  B. Cooke,et al.  Participation: the New Tyranny? , 2001 .

[189]  Linda J. Cox,et al.  Mental Modeler: A Fuzzy-Logic Cognitive Mapping Modeling Tool for Adaptive Environmental Management , 2013, 2013 46th Hawaii International Conference on System Sciences.

[190]  C. Robinson,et al.  Boundary work: engaging knowledge systems in co-management of feral animals on indigenous lands. , 2012 .

[191]  Anthony J. Jakeman,et al.  Ten iterative steps in development and evaluation of environmental models , 2006, Environ. Model. Softw..

[192]  Kurt C. Stange,et al.  Boundary Objects for Participatory Group Model Building of Agent-Based Models , 2015, 2015 48th Hawaii International Conference on System Sciences.

[193]  Robert M. Argent,et al.  Components of Adaptive Management , 2009 .

[194]  Fernando González-Ladrón-de-Guevara,et al.  Towards an integrated crowdsourcing definition , 2012, J. Inf. Sci..

[195]  J.R.A. Giles,et al.  About this title ‐ Integrated Environmental Modelling to Solve Real World Problems: Methods, Vision and Challenges , 2017, Special Publications.

[196]  Nuno Videira,et al.  Scoping river basin management issues with participatory modelling: The Baixo Guadiana experience , 2009 .

[197]  Ya Li,et al.  Soft OR in China: A critical report , 2014, Eur. J. Oper. Res..

[198]  Frank O. Ostermann,et al.  Digital Earth from vision to practice: making sense of citizen-generated content , 2012, Int. J. Digit. Earth.

[199]  Ashley Noel Cobb,et al.  Climate change scenario planning: A model for the integration of science and management in environmental decision-making , 2012, Environ. Model. Softw..

[200]  Anna Wesselink,et al.  Comparing the role of boundary organizations in the governance of climate change in three EU member states AUTHORS' COPY , 2014 .

[201]  Elise Pelzer,et al.  A participatory approach to design spatial scenarios of cropping systems and assess their effects on phoma stem canker management at a regional scale , 2013, Environ. Model. Softw..

[202]  Samaneh Shokravi,et al.  Values in socio-environmental modelling: Persuasion for action or excuse for inaction , 2014, Environ. Model. Softw..

[203]  Dan Clark,et al.  Modeling the integration of stakeholder knowledge in social–ecological decision-making: Benefits and limitations to knowledge diversity , 2012 .

[204]  L. Ross,et al.  Perseverance of Social Theories: The Role of Explanation in the Persistence of Discredited Information , 1980 .

[205]  Stefano Nativi,et al.  Environmental model access and interoperability: The GEO Model Web initiative , 2013, Environ. Model. Softw..

[206]  Lisa Scholten,et al.  Combining expert knowledge and local data for improved service life modeling of water supply networks , 2013, Environ. Model. Softw..

[207]  Daniela M. Romano,et al.  An Analysis of Usage of Different Types of Visualisation Media within a Collaborative Planning Workshop Environment , 2013 .

[208]  Craig A. Anderson,et al.  Abstract and concrete data in the perseverance of social theories: When weak data lead to unshakeable beliefs☆ , 1983 .

[209]  Javier Nogueras-Iso,et al.  Spatial Data Infrastructures for environmental e-government services: The case of water abstractions authorisations , 2013, Environ. Model. Softw..

[210]  Rianne Bijlsma,et al.  Implementing Participatory Water Management: Recent Advances in Theory, Practice, and Evaluation , 2010 .

[211]  K. Stanovich.  Rationality and the Reflective Mind , 2010 .