Assessing improvements in socio-ecological system governance using mixed methods and the quality governance framework and its diagnostic capacity tool

We face extreme and unprecedented socio-ecological systems (SES) governance challenges given advances in technology, global biophysical change, human behavior, and our abilities to seek resilience through policy decisions. The associated demands to rapidly adapt and shift our trajectories for improved SES outcomes provide a great impetus for humans to improve upon complex SES governance quality. Building on theories derived from polycentric, participatory, network-based practices, structured deliberative decision processes, and capacities that align with resilient systems thinking, a Quality Governance Framework (QGF) and Diagnostic Capacity Tool (DCT) were developed to diagnose SES governance quality that could improve outcomes for a cleanup and redevelopment program in Michigan. The QGF and its DCT were found to be reliable and valid. Using a subset of the DCT measurements and other respondent data, this research uses a mixed methods approach to further test and validate the QGF and DCT. The cleanup program was in its third year of transitioning from a more hierarchical form of governance to one that is more participatory. The results indicate further convergence in ratings between previously disparate practitioner populations and increases in the perceptions of improved governance quality and resilient SES outcomes. Respondents’ open-ended feedback and program metrics correlate with the DCT findings and provide further validity for the QGF and competencies associated with quality governance measured with the DCT. This research contributes to the growing body of empirical evidence that can assess governance quality and illuminates how governance quality can be diagnosed to treat and improve SES outcomes.

[1]  J. Seehra.  Employee Engagement Survey , 2015 .

[2]  E. Sharp,et al.  Can NRM agencies rely on capable and effective staff to build trust in the agency? , 2014 .

[3]  J. B. Rosener,et al.  Citizen Participation: Can We Measure Its Effectiveness? , 1978 .

[4]  Marten Scheffer,et al.  Resilience thinking: integrating resilience, adaptability and transformability , 2010 .

[5]  Bryan W. Husted,et al.  Organizations and the Sustainability Mosaic , 2007 .

[6]  Claudia Pahl-Wostl,et al.  The capacity of water governance to deal with the climate change adaptation challenge: Using fuzzy set Qualitative Comparative Analysis to distinguish between polycentric, fragmented and centralized regimes , 2014 .

[7]  Paul A. Sabatier,et al.  To Trust an Adversary: Integrating Rational and Psychological Models of Collaborative Policymaking , 2005, American Political Science Review.

[8]  James H. Lambert,et al.  Comparative, collaborative, and integrative risk governance for emerging technologies , 2018, Environment Systems and Decisions.

[9]  Claudia Pahl-Wostl,et al.  The Growing Importance of Social Learning in Water Resources Management and Sustainability Science , 2008 .

[10]  Thomas Oberlechner.  Psychology of Judgment and Decision-Making , 2006 .

[11]  Joseph Arvai,et al.  Teaching Students to Make Better Decisions About the Environment: Lessons From the Decision Sciences , 2004 .

[12]  Petra Wächter.  Thinking in systems – a primer , 2011 .

[13]  M. Montes.  UNITED NATIONS ECONOMIC AND SOCIAL COMMISSION FOR ASIA AND THE PACIFIC Regional High-Level Workshop on "Strengthening the Response to the Global Financial Crisis in Asia-Pacific: The Role of Monetary, Fiscal and External Debt Policies" , 2009 .

[14]  Lauren Keller Johnson,et al.  Systems Thinking Basics: From Concepts to Causal Loops , 1997 .

[15]  U. Wilensky,et al.  Complex Systems in Education: Scientific and Educational Importance and Implications for the Learning Sciences , 2006 .

[16]  Hiroki Sayama,et al.  Introduction to the Modeling and Analysis of Complex Systems , 2015 .

[17]  Tara L. Teel,et al.  Why social values cannot be changed for the sake of conservation , 2017, Conservation biology : the journal of the Society for Conservation Biology.

[18]  Rajneesh Narula,et al.  A novel approach to national technological accumulation and absorptive capacity: aggregating Cohen and Levinthal , 2002 .

[19]  A. Weil,et al.  Diffusion of Innovation , 2020, The International Encyclopedia of Media Psychology.

[20]  R. Gregory,et al.  Deconstructing adaptive management: criteria for applications to environmental management. , 2006, Ecological applications : a publication of the Ecological Society of America.

[21]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[22]  Anthony J. Jakeman,et al.  Selecting among five common modelling approaches for integrated environmental assessment and management , 2013, Environ. Model. Softw..

[23]  M. Morris.  Understanding Risk - Informing Decisions in a Democratic Society , 1997 .

[24]  H. Simon,et al.  Studying Scientific Discovery by Computer Simulation , 1983, Science.

[25]  H. Fineberg,et al.  Understanding Risk: Informing Decisions in a Democratic Society , 1996 .

[26]  Earl R. Babbie,et al.  The practice of social research , 1969 .

[27]  C. Pahl-Wostl,et al.  Research, part of a Special Feature on A Framework for Analyzing, Comparing, and Diagnosing Social-Ecological Systems Comparison of Frameworks for Analyzing Social-ecological Systems , 2013 .

[28]  J. H. Davis,et al.  An Integrative Model Of Organizational Trust , 1995 .

[29]  Moti Frank,et al.  A framework for benchmarking competency assessment models , 2013, Syst. Eng..

[30]  Tanya Heikkila,et al.  Bringing polycentric systems into focus for environmental governance , 2018, Environmental Policy and Governance.

[31]  Daniel A. Levinthal,et al.  Innovation and Learning: The Two Faces of R&D , 1989 .

[32]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[33]  E. Ostrom.  A General Framework for Analyzing Sustainability of Social-Ecological Systems , 2009, Science.

[34]  Hayley Stevenson,et al.  Global democracy and earth system governance , 2011 .

[35]  Timothy D. Baird,et al.  Trust ecology and the resilience of natural resource management institutions , 2015 .

[36]  L. Giddings.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 2d ed , 2005 .

[37]  Daniel A. Levinthal,et al.  ABSORPTIVE CAPACITY: A NEW PERSPECTIVE ON LEARNING AND INNOVATION , 1990 .

[38]  E. Ostrom,et al.  Insight, part of a Special Feature on A Framework for Analyzing, Comparing, and Diagnosing Social-Ecological Systems Social-ecological system framework: initial changes and continuing challenges , 2014 .

[39]  Miguel P Caldas,et al.  Research design: qualitative, quantitative, and mixed methods approaches , 2003 .

[40]  M. Steen-Adams,et al.  Research, part of a Special Feature on Exploring Feedbacks in Coupled Human and Natural Systems (CHANS) Historical framework to explain long-term coupled human and natural system feedbacks: application to a multiple-ownership forest landscape in the northern Great Lakes region, USA , 2015 .

[41]  S. Koger,et al.  Beyond the roots of human inaction: Fostering collective effort toward ecosystem conservation , 2017, Science.

[42]  Robin Gregory,et al.  Exploring a structured decision approach as a means of fostering participatory space policy making at NASA , 2002 .

[43]  B. Rubenstein-Montano,et al.  A systems thinking framework for knowledge management , 2001, Decis. Support Syst..

[44]  Claudia Pahl-Wostl,et al.  Adaptive Water Governance: Assessing the Institutional Prescriptions of Adaptive (Co-)Management from a Governance Perspective and Defining a Research Agenda , 2009 .

[45]  I. Sahin.  Detailed Review of Rogers' Diffusion of Innovations Theory and Educational Technology-Related Studies Based on Rogers' Theory. , 2006 .

[46]  Jay W. Forrester,et al.  Learning through System Dynamics as Preparation for the 21st Century , 2016 .

[47]  J. Sterman,et al.  Systems thinking and organizational learning: Acting locally and thinking globally in the organization of the future , 1992 .

[48]  Ortwin Renn,et al.  Public participation in decision making: A three-step procedure , 1993, Policy Sciences.

[49]  E. Ostrom.  Understanding Institutional Diversity , 2005 .

[50]  David Salt,et al.  Resilience Thinking : Sustaining Ecosystems and People in a Changing World , 2017 .

[51]  Igor Linkov,et al.  A decision analytic model to guide early‐stage government regulatory action: Applications for synthetic biology , 2018 .

[52]  C. Anthony Di Benedetto,et al.  Diffusion of Innovation , 2015 .

[53]  J. Kotter.  Leading change: why transformation efforts fail , 2009, IEEE Engineering Management Review.

[54]  E. Ostrom.  Institutional Rational Choice , 2019, Theories of the Policy Process.

[55]  Tom R. Tyler,et al.  Procedural Fairness and Compliance with the Law , 1997 .

[56]  Patricia A. McKay,et al.  Development and testing a diagnostic capacity tool for improving socio-ecological system governance , 2017, Environment Systems and Decisions.

[57]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .