Multidimensional assessment of technology and innovation programs: the impact evaluation of INCAGRO-Peru

This article presents a methodological proposal and an empirical validation for the assessment of ST&I programs, particularly for choosing indicators and metrics from a multidimensional perspective. Its key feature is the construction of indicators designed to apprehend the wide array of characteristics displayed by the many different types of innovation program. Thus it combines deductive procedures (decomposition of goals) and inductive procedures (discussion with the players involved) with evaluation results and impacts in specific dimensions linked to the nature of a given program. We illustrate the approach using a World Bank Program called INCAGRO. The proposed method is a contribution to systematizing the definition of indicators and metrics for the assessment of ST&I programs. It helps define ‘what should be evaluated’ in a given program. Many different (unforeseen) results and impacts can emerge simultaneously with the main subject of the program. Thus multidimensional issues and multiple actors should be considered in the impact evaluation process. Copyright , Beech Tree Publishing.

[1]  David Roessner,et al.  Quantitative and qualitative methods and measures in the evaluation of research , 2000 .

[2]  Beth C. Weitzman,et al.  Integrating a Comparison Group Design into a Theory of Change Evaluation: The Case of the Urban Health Initiative: , 2002 .

[3]  Nathan Rosenberg,et al.  Inside the Black Box: Technology and Economics , 1984 .

[4]  Nathan Rosenberg,et al.  An Overview of Innovation , 2009 .

[5]  Paul Davidson,et al.  Reality and Economic Theory , 1996 .

[6]  Richard R. Nelson,et al.  Institutions supporting technical change in the United States , 1988 .

[7]  Barry Bozeman,et al.  “Knowledge Value Alliances”: An Alternative to the R&D Project Focus in Evaluation , 2001 .

[8]  Julian M. Alston,et al.  A meta-analysis of rates of return to agricultural R&D : ex pede Herculem? , 2000 .

[9]  A. Adrian,et al.  Producers' perceptions and attitudes toward precision agriculture technologies , 2005 .

[10]  Sylvain Payraudeau,et al.  Environmental impact assessment for a farming region: a review of methods , 2005 .

[11]  Michael Grüninger,et al.  Introduction , 2002, CACM.

[12]  Göran Broman,et al.  Sustainability Constraints as System Boundaries , 2011 .

[13]  M. Ittersum,et al.  Assessing farm innovations and responses to policies: A review of bio-economic farm models , 2007 .

[14]  Y. Kislev,et al.  Research and productivity in wheat in Israel , 1978 .

[15]  Jacques Wery,et al.  Model-based assessment of technological innovation in banana cropping systems contextualized by farm types in Guadeloupe , 2009 .

[16]  Alberto González García,et al.  A comprehensive assessment of multifunctional agricultural land-use systems in Spain using a multi-dimensional evaluative model , 2007 .

[17]  Patricia J. Rogers,et al.  Causal models in program theory evaluation , 2000 .

[18]  Andrew Hall,et al.  From measuring impact to learning institutional lessons: an innovation systems perspective on improving the management of international agricultural research , 2003 .