Innovation Policy Evaluation – Challenges and Roads Ahead

The innovation literature has established that successful innovation processes are often based upon collabo-ration and networks. The innovation system thinking emphasizes networks but also their supporting informal institutions, learning processes, and the relations between actors in the system. Despite the importance of networks, evaluation studies have been sparse regarding investigating effects of these as well as on the broader criteria to evaluate the innovation networks and functioning of the system. This paper discusses what are such criteria for evaluating innovation policies that rely on enhancing system connectivity and repair sys-tem failures? By way of illustration, and as a mean to be specific on these criteria, the paper discusses the possible rationale for governments to support business angel networks (BAN) and what criteria to apply when evaluating such networks. It is found that applying traditional evaluation criteria for assessing BANs may provide only a partial picture. The broader benefits of an angel network include both direct and indirect effects. In a case of the Danish Business Angel Network it is illustrated that it was closed down because of lack of understanding of the im-portant effects that go beyond the immediate effectiveness. Other evaluation perspectives, that include also effects at a system level, would probably have resulted in a different decision. Implications for innovation policy evaluation are derived.

[1]  R. Harrison,et al.  Business Angel Networks and the Development of the Informal Venture Capital Market in the U.K.: Is There Still a Role for the Public Sector , 1997 .

[2]  E. Uyarra,et al.  Reconceptualising the 'policy mix' for innovation , 2011 .

[3]  Financing small firms , 1996 .

[4]  Pat Ricia,et al.  Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions , 2008 .

[5]  Maureen McKelvey,et al.  Innovation and Employment: Process Versus Product Innovation , 2001 .

[6]  C. Mason,et al.  Strategies for Expanding the Informal Venture Capital Market , 1993 .

[7]  Rudy Aernoudt,et al.  Executive forum: Public support for the business angel market in Europe – a critical review , 2007 .

[8]  Gordon Murray,et al.  Venture Capital and Government Policy , 2007 .

[9]  Karen E. Wilson,et al.  Financing High-Growth Firms: The Role of Angel Investors , 2011 .

[10]  G. Dosi,et al.  Technical Change and Economic Theory , 1989 .

[11]  Jörg Sydow,et al.  Network Development by Means of Network Evaluation? Explorative Insights from a Case in the Financial Services Industry , 2004 .

[12]  Luke Georghiou,et al.  What Difference Does it Make? Additionality in the Public Support of R&D in Large Firms , 2014 .

[13]  R. Harding Plugging the knowledge gap: An international comparison of the role for policy in the venture capital market , 2002 .

[14]  M. Hart,et al.  Developing a framework to evaluate business networks: the case of Ireland's industry-led network initiative , 2009 .

[15]  Assessment of Government Funding of Business Angel Networks in Flanders , 2010 .

[16]  Jennifer Caroline Greene,et al.  The SAGE Handbook of Evaluation , 2006 .

[17]  Geoff Whittam,et al.  Business angel syndicates: an exploratory study of gatekeepers , 2010 .

[18]  C. Mason,et al.  Informal Sources of Venture Finance , 2006 .

[19]  L. Georghiou,et al.  Equilibrium and Evolutionary Foundations of Technology Policy , 1998 .

[20]  Helena Lenihan,et al.  Enterprise policy evaluation: is there a 'new' way of doing it? , 2011, Evaluation and program planning.

[21]  Richard T. Harrison,et al.  Public policy and the development of the informal venture capital market: UK experience and lessons for Europe , 2003 .

[22]  Bengt-Åke Lundvall,et al.  National Systems of Innovation: towards a theory of innovation and interactive learning London: Pint , 1995 .

[23]  Charles Edquist,et al.  Collaboration in Product Innovation in the East Gothia Regional System of Innovation , 2000 .

[24]  C. Schmiedeberg Evaluation of Cluster Policy: A Methodological Overview , 2010 .

[25]  R. Aernoudt Executive forum: Seven ways to stimulate business angels' investments , 2005 .

[26]  Burt Perrin,et al.  How to — and How Not to — Evaluate Innovation , 2002 .

[27]  B. Lundvall Product Innovation and User-Producer Interaction , 1985 .

[28]  Evert Vedung,et al.  Purposes and criteria in network governance evaluation: How far does standard evaluation vocabulary takes us? , 2012 .

[29]  Richard T. Harrison,et al.  Closing the regional equity capital gap: The role of informal venture capital , 1995 .

[30]  M. Russo,et al.  Cooperation Networks and Innovation , 2009 .

[31]  J. Fagerberg,et al.  The Oxford handbook of innovation , 2006 .

[32]  The Promotion of Entrepreneurship in the Audio-Visual Media (esp. TV) : Final Report for the European Commission, Enterprise and Industry Directorate-General , 2007 .

[33]  J. Sohl The Organization of the Informal Venture Capital Market , 2007 .

[34]  Erik Arnold,et al.  Evaluating research and innovation policy: a systems world needs systems evaluations , 2004 .

[35]  Xavier Tinguely,et al.  The Nature of the Innovation Process and the New Geography of Innovation , 2013 .

[36]  C. Mason Public Policy Support for the Informal Venture Capital Market in Europe , 2009 .

[37]  Rudy Aernoudt,et al.  Business Angels: Should they fly on their own wings? , 1999 .

[38]  J. Christensen Venture capital - filters, hubs and catalysts for entrepreneurs? , 2008 .

[39]  R. Harrison,et al.  The Role of Trust in the Informal Investor's Investment Decision: An Exploratory Analysis , 1997 .

[40]  J. Edler,et al.  The Use of Behavioural Additionality in Innovation Policy-Making , 2011 .

[41]  J. Edler,et al.  The practice of evaluation in innovation policy in Europe: A statistical analysis , 2011 .

[42]  Benoit Leleux,et al.  Public versus private venture capital: seeding or crowding out? A pan-European analysis , 2003 .

[43]  Cees Leeuwis,et al.  Enhancing the Reflexivity of System Innovation Projects With System Analyses , 2010 .

[44]  K. Arrow Economic Welfare and the Allocation of Resources for Invention , 1962 .