Towards a complexity-aware theory of change for participatory research programs working within agricultural innovation systems

Abstract Agricultural innovation systems (AIS) are increasingly recognized as complex adaptive systems in which interventions cannot be expected to create predictable, linear impacts. Nevertheless, the logic models and theory of change (ToC) used by standard-setting international agricultural research agencies and donors assume that agricultural research will create impact through a predictable linear adoption pathway which largely ignores the complexity dynamics of AIS, and which misses important alternate pathways through which agricultural research can improve system performance and generate sustainable development impact. Despite a growing body of literature calling for more dynamic, flexible and “complexity-aware” approaches to monitoring and evaluation, few concrete examples exist of ToC that takes complexity dynamics within AIS into account, or provide guidance on how such theories could be developed. This paper addresses this gap by presenting an example of how an empirically-grounded, complexity-aware ToC can be developed and what such a model might look like in the context of a particular type of program intervention. Two detailed case studies are presented from an agricultural research program which was explicitly seeking to work in a “complexity-aware” way within aquatic agricultural systems in Zambia and the Philippines. Through an analysis of the outcomes of these interventions, the pathways through which they began to produce impacts, and the causal factors at play, we derive a “complexity-aware” ToC to model how the cases worked. This middle-range model, as well as an overarching model that we derive from it, offer an alternate narrative of how development change can be produced in agricultural systems, one which aligns with insights from complexity science and which, we argue, more closely represents the ways in which many research for development interventions work in practice. The nested ToC offers a starting point for asking a different set of evaluation and research questions which may be more relevant to participatory research efforts working from within a complexity-aware, agricultural innovation systems perspective.

[1]  Michael X Cohen,et al.  Harnessing Complexity: Organizational Implications of a Scientific Frontier , 2000 .

[2]  C. Leeuwis,et al.  INNOVATION PLATFORMS: EXPERIENCES WITH THEIR INSTITUTIONAL EMBEDDING IN AGRICULTURAL RESEARCH FOR DEVELOPMENT , 2015, Experimental Agriculture.

[3]  Stéphane Lemarié,et al.  How does public agricultural research impact society? A characterization of various patterns , 2015 .

[4]  J. Ekboir,et al.  The art and science of innovation systems inquiry: Applications to Sub-Saharan African agriculture , 2009 .

[5]  H. Bradbury,et al.  Handbook of action research : participative inquiry and practice , 2001 .

[6]  S. Ayele,et al.  Enhancing innovation in livestock value chains through networks: Lessons from fodder innovation case studies in developing countries , 2012 .

[7]  Ray Pawson,et al.  The Science of Evaluation: A Realist Manifesto , 2013 .

[8]  D. Kossou,et al.  Five Years After; the Impact of a Participatory Technology Development Programme as Perceived by Smallholder Farmers in Benin and Ghana , 2013 .

[9]  S. Vellema,et al.  The Triviality of Measuring Ultimate Outcomes: Acknowledging the Span of Direct Influence , 2014 .

[10]  B. Williams Adaptive management of natural resources--framework and issues. , 2011, Journal of environmental management.

[11]  Javier M. Ekboir,et al.  Why impact analysis should not be used for research evaluation and what the alternatives are , 2003 .

[12]  Marie-Elena Ellis Wellspring of knowledge , 2003 .

[13]  C. Leeuwis,et al.  Adaptive management in agricultural innovation systems: The interactions between innovation networks and their environment , 2010 .

[14]  R. Chambers,et al.  Towards a learning paradigm: new professionalism and institutions for agriculture , 1993 .

[15]  Dana G. Dalrymple,et al.  International agricultural research as a global public good: concepts, the CGIAR experience and policy issues , 2008 .

[16]  Boru Douthwaite,et al.  Learning selection revisited: How can agricultural researchers make a difference? , 2010 .

[17]  C. Weiss How Can Theory-Based Evaluation Make Greater Headway? , 1997 .

[18]  Patricia J. Rogers,et al.  Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions , 2008 .

[19]  Delia Grace,et al.  Linking international agricultural research knowledge with action for sustainable development , 2009, Proceedings of the National Academy of Sciences.

[20]  Stephen Biggs,et al.  A multiple source of innovation model of agricultural research and technology promotion. , 1990 .

[21]  Nicholas E. Korres,et al.  Cultivars to face climate change effects on crops and weeds: a review , 2016, Agronomy for Sustainable Development.

[22]  Michael Quinn Patton,et al.  Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use , 2010 .

[23]  Philippe Larédo,et al.  ASIRPA: A comprehensive theory-based approach to assessing the societal impacts of a research organization , 2015 .

[24]  John H. Miller,et al.  Complex adaptive systems - an introduction to computational models of social life , 2009, Princeton studies in complexity.

[25]  V. R. Sulaiman,et al.  Adaptive collaborative approaches in natural resource governance : rethinking participation, learning and innovation , 2012 .

[26]  T. Veldkamp,et al.  Considering change: Evaluating four years of participatory experimentation with farmers in Tigray (Ethiopia) highlighting both functional and human–social aspects , 2016 .

[27]  Elske van de Fliert,et al.  Impact pathway evaluation: an approach for achieving and attributing impact in complex systems , 2003 .

[28]  Derek Byerlee,et al.  The impacts of CGIAR research: A review of recent evidence , 2010 .

[29]  Laurens Klerkx,et al.  Towards dynamic research configurations: A framework for reflection on the contribution of research to policy and innovation processes , 2014 .

[30]  Laurens Klerkx,et al.  Evolution of systems approaches to agricultural innovation: concepts, analysis and interventions , 2012 .

[31]  Johanna Orvokki Mustelin,et al.  Strategies for improving adaptation practice in developing countries , 2014 .

[32]  R. Yin Case Study Research: Design and Methods , 1984 .

[33]  N. Uphoff,et al.  Demonstrated Benefits from Social Capital: The Productivity of Farmer Organizations in Gal Oya, Sri Lanka , 2000 .

[34]  Nicoletta Stame,et al.  Theory-Based Evaluation and Types of Complexity , 2004 .

[35]  Jeffrey Sayer,et al.  Integrated Natural Resources Management: Linking Productivity, the Environment and Development , 2003 .

[36]  Laurens Klerkx,et al.  Systemic perspectives on scaling agricultural innovations. A review , 2016, Agronomy for Sustainable Development.

[37]  Boru Douthwaite,et al.  Outcome Evidencing , 2017 .

[38]  Cees Leeuwis,et al.  Enhancing the Reflexivity of System Innovation Projects With System Analyses , 2010 .

[39]  N. Röling,et al.  Pathway for agricultural science impact in West Africa: lessons from the Convergence of Sciences programme , 2007 .

[40]  John Mayne,et al.  Useful Theory of Change Models , 2015 .

[41]  W. Orlikowski,et al.  An Improvisational Model of Change Management: The Case of Groupware Technologies , 1996 .

[42]  James Sumberg,et al.  Agricultural research in the face of diversity, local knowledge and the participation imperative: theoretical considerations , 2003 .

[43]  Niels Röling,et al.  Triggering regime change: A comparative analysis of the performance of innovation platforms that attempted to change the institutional context for nine agricultural domains in West Africa , 2016, Agricultural Systems.

[44]  Cees Leeuwis,et al.  The need for reflexive evaluation approaches in development cooperation , 2015 .

[45]  Andrew Hall,et al.  From measuring impact to learning institutional lessons: an innovation systems perspective on improving the management of international agricultural research , 2003 .

[46]  B. Douthwaite,et al.  Participatory Action Research in the CGIAR Research Program on Aquatic Agricultural Systems. , 2013 .