Transparency and Reproducibility in Participatory Systems Modelling: the Case of Fuzzy Cognitive Mapping

By aggregating semi‐quantitative mind maps from multiple agents, fuzzy cognitive mapping (FCM) allows developing an integrated, cross‐sectoral understanding of complex systems. However, and especially for FCM based on individual interviews, the map‐building process presents potential pitfalls. These are mainly related to the different understandings of the interviewees about the FCM semantics as well as the biases of the analyst during the elicitation and treatment of data. This paper introduces a set of good practice measures to increase transparency and reproducibility of map‐building processes in order to improve credibility of results from FCM applications. The case study used to illustrate the proposed good practices assesses heatwave impacts and adaptation options in an urban environment. Agents from different urban sectors were interviewed to obtain individual cognitive maps. Using this set of data, we suggest good practices to collect, digitalize, interpret, pre‐process and aggregate the individual maps in a traceable and coherent way. © 2018 The Authors Systems Research and Behavioral Science published by International Federation for Systems Research and John Wiley & Sons Ltd

[1]  Sandhya Samarasinghe,et al.  A novel semi-quantitative Fuzzy Cognitive Map model for complex systems for addressing challenging participatory real life problems , 2016, Appl. Soft Comput..

[2]  Elpiniki I. Papageorgiou,et al.  A cognitive map framework to support integrated environmental assessment , 2016, Environ. Model. Softw..

[3]  F. Escobar,et al.  The territorial dynamics of fast-growing regions: Unsustainable land use change and future policy challenges in Madrid, Spain , 2011 .

[4]  R. Nuzzo.  How scientists fool themselves – and how they can stop , 2015, Nature.

[5]  Soung Hie Kim,et al.  Fuzzy cognitive maps considering time relationships , 1995, Int. J. Hum. Comput. Stud..

[6]  Uygar Özesmi,et al.  Ecological models based on people’s knowledge: a multi-step fuzzy cognitive mapping approach , 2004 .

[7]  Steven A. Gray,et al.  Fuzzy Cognitive Maps as Representations of Mental Models and Group Beliefs , 2014, Fuzzy Cognitive Maps for Applied Sciences and Engineering.

[8]  Kasper Kok,et al.  Fuzzy Cognitive Maps for futures studies—A methodological assessment of concepts and methods , 2014 .

[9]  Kasper Kok,et al.  The potential of Fuzzy Cognitive Maps for semi-quantitative scenario development, with an example from Brazil , 2009 .

[10]  Rebecca Jordan,et al.  Using fuzzy cognitive mapping as a participatory approach to analyze change, preferred states, and perceived resilience of social-ecological systems , 2015 .

[11]  Saul Perlmutter,et al.  Blind analysis: Hide results to seek the truth , 2015, Nature.

[12]  João Paulo Carvalho,et al.  On the semantics and the use of fuzzy cognitive maps and dynamic cognitive maps in social sciences , 2013, Fuzzy Sets Syst..

[13]  Pim Martens,et al.  Transdisciplinary research in sustainability science: practice, principles, and challenges , 2012, Sustainability Science.

[14]  Marta Olazabal,et al.  Use of fuzzy cognitive maps to study urban resilience and transformation , 2016 .

[15]  Adrienn Buruzs,et al.  Using Fuzzy Cognitive Maps approach to identify integrated waste management system characteristics , 2014, 2014 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom).

[16]  A. Dafoe.  Science Deserves Better: The Imperative to Share Complete Replication Files , 2014 .

[17]  K. Langfield-Smith.  EXPLORING THE NEED FOR A SHARED COGNITIVE MAP , 1992 .

[18]  Jonathan F. Russell,et al.  If a job is worth doing, it is worth doing twice , 2013, Nature.

[19]  Benjamin F. Hobbs,et al.  FUZZY COGNITIVE MAPPING AS A TOOL TO DEFINE MANAGEMENT OBJECTIVES FOR COMPLEX ECOSYSTEMS , 2002 .

[20]  Frédéric M. Vanwindekens,et al.  Development of a broadened cognitive mapping approach for analysing systems of practices in social-ecological systems , 2013 .

[21]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[22]  Martin van Maarseveen,et al.  A structured participatory method to support policy option analysis in a social-ecological system. , 2017, Journal of environmental management.

[23]  Antonie J. Jetter,et al.  Elicitation — Extracting Knowledge from Experts , 2006 .

[24]  Brian A. Nosek,et al.  Promoting Transparency in Social Science Research , 2014, Science.

[25]  Ian P. Holman,et al.  European participatory scenario development: strengthening the link between stories and models , 2015, Climatic Change.

[26]  P. Sainsbury,et al.  Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[27]  Alexandra S. Penn,et al.  Participatory Development and Analysis of a Fuzzy Cognitive Map of the Establishment of a Bio-Based Economy in the Humber Region , 2013, PloS one.

[28]  François Bousquet,et al.  Modelling with stakeholders , 2010, Environ. Model. Softw..

[29]  Marc B. Neumann,et al.  Emergence of new knowledge for climate change adaptation , 2018 .

[30]  Diana Reckien,et al.  Weather extremes and street life in India—Implications of Fuzzy Cognitive Mapping as a new tool for semi-quantitative impact assessment and ranking of adaptation measures , 2014 .

[31]  Jose L. Salmeron,et al.  A Review of Fuzzy Cognitive Maps Research During the Last Decade , 2013, IEEE Transactions on Fuzzy Systems.

[32]  M. Reed.  Stakeholder participation for environmental management: A literature review , 2008 .

[33]  József Mezei,et al.  Aggregating expert knowledge for the measurement of systemic risk , 2016, Decis. Support Syst..