From measuring impact to learning institutional lessons: an innovation systems perspective on improving the management of international agricultural research

This paper argues that impact assessment research has not made more of a difference because the measurement of the economic impact has poor diagnostic power. In particular it fails to provide research managers with critical institutional lessons concerning ways of improving research and innovation as a process. Our contention is that the linear input–output assumptions of economic assessment need to be complemented by an analytical framework that recognises systems of reflexive, learning interactions and their location in, and relationship with, their institutional context. The innovation systems framework is proposed as an approach where institutional learning is explicit. Three case studies of recent developments in international agricultural research are presented to illustrate these points. We conclude by suggesting that the innovation systems framework has much to offer research managers wishing to monitor and learn new ways of addressing goals such as poverty alleviation. The greatest challenge however, is that such holistic learning frameworks must contend for legitimacy if they are to complement the dominant paradigm of economic assessment.

[1]  Robin Grimble,et al.  Stakeholder methodologies in natural resource management: a review of principles, contexts, experiences and opportunities , 1997 .

[2]  E. Clay,et al.  The dryland research project at indore (1974–80) — an institutional innovation in rural technology transfer , 1987 .

[3]  P. Pardey,et al.  Research returns redux: a meta-analysis of the returns to agricultural R&D , 2000 .

[4]  Douglas Horton,et al.  Disciplinary roots and branches of evaluation: Some lessons from agricultural research , 1998 .

[5]  Stephen Biggs,et al.  Beyond methodologies: Coalition-building for participatory technology development , 1998 .

[6]  Andrew Hall,et al.  Coping with change, complexity and diversity in agriculture — the case of rhizobium inoculants in Thailand , 1995 .

[7]  Stephen Biggs,et al.  An actor-oriented approach for strengthening research and development capabilities in natural resource systems , 1999 .

[8]  A. Hall,et al.  Application of the innovation systems framework in North-South research , 2002 .

[9]  Douglas Horton,et al.  Building capacity in planning, monitoring and evaluation: Lessons from the field , 1999 .

[10]  N. Clark Innovation Systems, Institutional Change And The New Knowledge Market: Implications For Third World Agricultural Development , 2002 .

[11]  R. Evenson,et al.  Research and Productivity in Asian Agriculture , 1991 .

[12]  Ronald Mackay,et al.  Evaluating capacity development in planning, monitoring, and evaluation: a case from agricultural research. , 2000 .

[13]  Beatriz Ruivo ‘Phases’ or ‘paradigms’ of science policy? , 1994 .

[14]  E. Monyo,et al.  Impact from Investments in Crop Breeding: the Case of Okashana 1 in Namibia , 1999 .

[15]  R. Raina Patronage and Evaluation in the Indian Council of Agricultural Research , 1999 .

[16]  Peter M. Allen,et al.  Evolutionary dynamics and sustainable development: a systems approach. , 1995 .

[17]  V. R. Sulaiman,et al.  Public-private sector interaction in the Indian agricultural research system: an innovation systems perspective on institutional reform. , 2002 .

[18]  John Farrington,et al.  Development as Process: Concepts and Methods for Working With Complexity , 1998 .

[19]  M. Bantilan,et al.  Improved Cultivars of Pearl Millet in Tamil Nadu: Adoption, Impact , and Returns to Research Investment , 2000 .

[20]  Rome,et al.  IMPACT ASSESSMENT OF AGRICULTURAL RESEARCH: CONTEXT AND STATE OF THE ART , 2000 .

[21]  Max Elden,et al.  Social Theory for Action: How Individuals and Organizations Learn to Change , 1992 .

[22]  V. R. Sulaiman,et al.  An innovation systems perspective on the restructuring of agricultural extension: evidence from India. , 2003 .

[23]  Robert E. Rhoades,et al.  Farmer-back-to-farmer: A model for generating acceptable agricultural technology , 1982 .

[24]  S. Biggs Generating agricultural technology: Triticale for the Himalayan Hills , 1982 .

[25]  A. Hall,et al.  New agendas for agricultural research in developing countries: Policy analysis and institutional implications , 2000 .

[26]  B. Beattie Science Under Scarcity: Principles and Practice for Agricultural Research Evaluation and Priority Setting , 1995 .

[27]  New seeds and poor people , 1989 .

[28]  Andrew Hall,et al.  Research as Capacity Building: The Case of an NGO Facilitated Post-Harvest Innovation System for the Himalayan Hills , 2003 .

[29]  S. Winter,et al.  An evolutionary theory of economic change , 1983 .

[30]  Paul Richards,et al.  Indigenous Agricultural Revolution. Ecology and Food Production in West Africa , 1986 .

[31]  Z. Griliches Research Costs and Social Returns: Hybrid Corn and Related Innovations , 1958, Journal of Political Economy.

[32]  V. R. Sulaiman,et al.  Institutional Learning in Technical Projects: Horticulture Technology R&D Systems in India , 2002 .

[33]  V. Ruttan,et al.  Impact Assessment Studies Conducted in the CGIAR , 1970-1999 : An Annotated Bibliography , 2001 .

[34]  Basil Edward Cracknell,et al.  Evaluating Development Aid: Issues, Problems and Solutions , 2000 .

[35]  S. Biggs Farming systems research and rural poverty: Relationships between context and content☆ , 1995 .

[36]  A. Yapi,et al.  Assessment of the Economic Impact of Sorghum Variety S 35 in Chad , 1999 .

[37]  D. North Institutions, Institutional Change and Economic Performance: Economic performance , 1990 .

[38]  John Farrington,et al.  Nests, nodes and niches: A system for process monitoring, information exchange and decision making for multiple stakeholders , 1998 .

[39]  Andrew Hall,et al.  Why Research Partnerships Really Matter: Innovation Theory, Institutional Arrangements and Implications for Developing New Technology for the Poor , 2001 .

[40]  Gavin J. Wright An evolutionary theory of economic change , 1982 .

[41]  S. Biggs Planning Rural Technologies in the Context of Social Structures and Reward Systems , 1978 .

[42]  B. Lundvall,et al.  National systems of production, innovation and competence building , 2002 .

[43]  Stephen Biggs,et al.  A multiple source of innovation model of agricultural research and technology promotion. , 1990 .

[44]  Stephen Biggs,et al.  Stakeholders, science and decision making for poverty-focused rural mechanization research and development , 1997 .

[45]  A. Yapi,et al.  Analysis of the economic impact of sorghum and millet research in Mali. , 2000 .

[46]  N. Clark,et al.  INSTITUTIONAL LEARNING THROUGH TECHNICAL PROJECTS: HORTICULTURE TECHNOLOGY R&D SYSTEMS IN INDIA , 2001 .

[47]  Mywish K. Maredia,et al.  Ex Post Evaluation of Economic Impacts of Agricultural Research Programs: a Tour of Good Practice , 2000 .

[48]  David A. Lewis Partnership as process: building an institutional ethnography of an inter-agency aquaculture project in Bangladesh , 1999 .

[49]  P. K. Joshi,et al.  Impact Assessment of Crop and Resource Management Technology A Case of Groundnut Production Technology , 1998 .

[50]  C. Edquist,et al.  Institutions and Organizations in Systems of Innovation , 2013 .

[51]  B. P. Ghildyal,et al.  Agricultural research for resource-poor farmers: The farmer-first-and-last model , 1985 .

[52]  S. Rajeswari Agricultural research effort: Conceptual clarity and measurement , 1995 .

[53]  R. Stacey,et al.  Governance and cooperative networks: An adaptive systems perspective , 1997 .

[54]  K. Mehra Indian system of innovation in biotechnology — a case study of cardamom , 2001 .

[55]  Esben Sloth Andersen,et al.  Editorial: Special Issue on Innovation Systems , 2002 .

[56]  D. Horton Planning, Implementing, and Evaluating Capacity Development 1 , 2002 .

[57]  Edwin Levy,et al.  Rice science and development politics: research strategies and IRRI's technologies confront Asian diversity (1950-1980. , 1992 .

[58]  S. Biggs,et al.  Sources of innovation in agricultural technology , 1981 .

[59]  Douglas Horton Evaluation in developing countries: An introduction , 1999 .

[60]  R. Anderson The origins of the International Rice Research Institute , 1991 .