R&D networks: an evaluation framework

R&D networks have been studied and promoted by scholars and policy makers as a way to increase the performance of innovation systems. At the same time, limited attention has been devoted to evaluate their performances. This paper reviews the literature that studied R&D networks from different approaches and suggests a framework to help developing evaluation systems for R&D networks. The framework is based on a network model that highlights the main elements and characteristics of an R&D network, underlines the opportunity of three different perspectives of evaluation and has been applied and tested on three case studies.

[1]  Takayuki Hayashi.  Effect of R&D programmes on the formation of university-industry-government networks: comparative analysis of Japanese R&D programmes , 2003 .

[2]  Max Boisot,et al.  Markets and Hierarchies in a Cultural Perspective , 1986 .

[3]  Yang-chih Fu,et al.  Measuring personal networks with daily contacts: a single-item survey question and the contact diary , 2005, Soc. Networks.

[4]  D. Ernst,et al.  Global Production Networks, Knowledge Diffusion and Local Capability Formation , 2002 .

[5]  Uwe Cantner,et al.  The Network of Innovators in Jena: An Application of Social Network Analysis , 2006 .

[6]  Stefano Brusoni,et al.  An international comparison of sectoral knowledge bases: persistence and integration in the pharmaceutical industry , 2003 .

[7]  Mark Harvey,et al.  Analysing distributed processes of provision and innovation , 2003 .

[8]  Mcdp Mathieu Weggeman,et al.  Managing Learning in Informal Innovation Networks: Overcoming the Daphne-Dilemma , 2000 .

[9]  Edwin Mansfield,et al.  Technology Transfer, Productivity, and Economic Policy , 1983 .

[10]  Emilio Bartezzaghi,et al.  Organizzare le PMI per la crescita. , 1999 .

[11]  B. W. Ang,et al.  A comparative analysis of R&D project evaluation methods , 2001 .

[12]  Loet Leydesdorff,et al.  Network Structure, Self-Organization and the Growth of International Collaboration in Science.Research Policy, 34(10), 2005, 1608-1618. , 2005, 0911.4299.

[13]  Wolfgang H. Güttel,et al.  Knowledge production of firms: research networks and the "scientification" of business R&D , 2005, Int. J. Technol. Manag..

[14]  Lars Coenen,et al.  The role of Regional Innovation Systems in a Globalising Economy: Comparing Knowledge Bases and Institutional Frameworks of Nordic Clusters , 2005 .

[15]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[16]  Howard E. Aldrich,et al.  Personal and Extended Networks Are Central to the Entrepreneurial Process , 1991 .

[17]  Colin Hastings.  Building the culture of organizational networking: Managing projects in the new organization , 1995 .

[18]  Sylvie K. Chetty,et al.  Collaborating with competitors to acquire resources , 2003 .

[19]  Kathleen M. Eisenhardt,et al.  DYNAMIC CAPABILITIES, WHAT ARE THEY? , 2000 .

[20]  Mario Coccia,et al.  A Basic Model for Evaluating R&D Performance: Theory and Application in Italy , 2001 .

[21]  Jeffrey A. Oxman,et al.  The global service quality measurement program at American Express Bank , 1992 .

[22]  H. Thorelli.  Networks: Between Markets and Hierarchies , 1986 .

[23]  David Z. YankelevskyU,et al.  Personal and extended networks are central to the entrepreneurial process , 2012 .

[24]  A. Salter,et al.  Searching high and low: what types of firms use universities as a source of innovation? , 2004 .

[25]  Edward J. Malecki,et al.  Science, technology, and regional economic development: Review and prospects , 1981 .

[26]  Walter W. Powell,et al.  Networks of Innovators , 2006 .

[27]  Edward Toomer,et al.  Qualitative Methods in Management Research , 1989 .

[28]  Koenraad Debackere,et al.  Dismantling the ivory tower: The influence of networks on innovative output in emerging technologies , 1996 .

[29]  Andrew Webster,et al.  University-Corporate Ties and the Construction of Research Agendas , 1994 .

[30]  Elias G. Carayannis,et al.  Knowledge creation, diffusion, and use in innovation networks and knowledge clusters : a comparative systems approach across the United States, Europe, and Asia , 2006 .

[31]  R. Langlois,et al.  Innovation, Networks, and Vertical Integration , 1995 .

[32]  M. Moser.  Measuring Performance in R&D Settings , 1985 .

[33]  Donald de B. Beaver,et al.  Does collaborative research have greater epistemic authority? , 2004, Scientometrics.

[34]  A. Grandori,et al.  Inter-firm Networks: Antecedents, Mechanisms and Forms , 1995 .

[35]  Terttu Luukkonen,et al.  The difficulties in assessing the impact of EU framework programmes , 1998 .

[36]  Edward J. Malecki,et al.  GOVERNMENT‐FUNDED R&D: SOME REGIONAL ECONOMIC IMPLICATIONS , 1981 .

[37]  Wolfgang Glänzel,et al.  Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies , 2004, Scientometrics.

[38]  S. Breschi,et al.  Knowledge Spillovers And Local Innovation Systems: A Critical Survey , 2001 .

[39]  Martin Karlsson,et al.  Measuring R&D productivity: complementing the picture by focusing on research activities , 2004 .

[40]  J. Rigby,et al.  Peering inside research networks: Some observations on the effect of the intensity of collaboration on the variability of research quality , 2005 .

[41]  Donald S. Remer,et al.  Measuring R&D Productivity , 1985 .

[42]  Benjamin Gomes-Casseres.  Alliance Strategies of Small Firms , 1997 .

[43]  Robert M. Mason,et al.  The content methodology. Facilitating performance measurement by assessing the complexity of R&D projects , 1998 .

[44]  Charlie Karlsson,et al.  Interregional Inventor Networks as Studied by Patent Co-inventorships , 2006 .

[45]  René Belderbos,et al.  Backward Vertical Linkages of Foreign Manufacturing Affiliates: Evidence from Japanese Multinationals , 2001 .

[46]  P. Kotler,et al.  Marketing in the Network Economy , 1999 .

[47]  Herbert I. Fusfeld.  Industrial Research—Where It's Been, Where It's Going , 1995 .

[48]  K. Lewin.  Frontiers in Group Dynamics , 1947 .

[49]  M. Porter.  Clusters and the new economics of competition. , 1998, Harvard business review.

[50]  R. E. Miles,et al.  Managing 21st century network organizations , 1992 .

[51]  Zeng De,et al.  A comparative analysis of R&D project evaluation methods , 2002 .

[52]  Hariolf Grupp,et al.  Interdependencies between the science and technology infrastructure and innovation activities in German regions: empirical findings and policy consequences , 1999 .

[53]  F. Malerba.  Sectoral Systems of Innovation: Concepts, Issues and Analyses of Six Major Sectors in Europe , 2009 .

[54]  A Sapienza,et al.  Knowledge Frontiers: Public Sector Research and Industrial Innovation in Biotechnology, Engineering Ceramics, and Parallel Computing , 1996 .

[55]  Terttu Luukkonen,et al.  Variability in organisational forms of biotechnology firms , 2005 .

[56]  J. Hagedoorn,et al.  Measuring innovative performance: is there an advantage in using multiple indicators? , 2003 .

[57]  Onno Lint,et al.  Finance and Strategy: time to wait or time to market? , 1999 .

[58]  G. Susman,et al.  An Assessment of the Scientific Merits of Action Research. , 1978 .

[59]  S. Roper,et al.  An Ex Ante Evaluation Framework for the Regional Benefits of Publicly Supported R&D Projects , 2004 .

[60]  R. Yin.  The abridged version of case study research: Design and method. , 1998 .

[61]  Rosa Grimaldi,et al.  Institutional Changes and the Commercialization of Academic Knowledge: A Study of Italian Universities' Patenting Activities Between 1965 and 2002 , 2006 .

[62]  Chadwick J. Haberstroh,et al.  Organizing for product innovation , 1968 .

[63]  Patrick Cohendet,et al.  Technology transfer revisited from the perspective of the knowledge-based economy , 2001 .

[64]  Preston G. Smith,et al.  Developing products in half the time , 1995 .

[65]  Fr¬¥ed¬¥erique Sachwald,et al.  Co-operative R&D: why and with whom?: An integrated framework of analysis , 2003 .

[66]  H. Kevin Steensma,et al.  Acquiring technological competencies through inter-organizational collaboration: An organizational learning perspective , 1996 .

[67]  Ammon Salter,et al.  Searching Low and High : What Types of Firms use Universities as a Source of Innovation ? , 2003 .

[68]  I. Nonaka,et al.  How Japanese Companies Create the Dynamics of Innovation , 1995 .

[69]  A. Chandler,et al.  Regional Advantage: Culture and Competition in Silicon Valley and Route 128 , 1994 .

[70]  Kimberly S. Hamilton,et al.  The increasing linkage between U.S. technology and public science , 1997 .

[71]  Benjamin Gomes-Casseres.  Group versus group: How alliance networks compete , 1994 .

[72]  Gordon Kingsley,et al.  Technology transfer and absorption: an 'R & D value-mapping' approach to evaluation , 1996 .

[73]  Luke Georghiou,et al.  Evaluating technology programs: tools and methods , 2000 .

[74]  Philippe Larédo,et al.  The networks promoted by the framework programme and the questions they raise about its formulation and implementation , 1998 .

[75]  Jukka Ojasalo,et al.  Key network management , 2004 .

[76]  Thed N. van Leeuwen,et al.  The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence , 2003, Scientometrics.

[77]  R. Tijssen.  Quantitative assessment of large heterogeneous R&D networks: the case of process engineering in the Netherlands1 , 1998 .

[78]  Henk F. Moed,et al.  Bibliometric Indicators Reflect Publication and Management Strategies , 2000, Scientometrics.

[79]  G. Rao,et al.  Open Innovation , 2019, Strategic Decisions.

[80]  Paul Almeida,et al.  Are Firms Superior to Alliances and Markets? An Empirical Test of Cross-Border Knowledge Building , 2002, Organ. Sci..

[81]  Tilman Altenburg,et al.  Linkages and Spill-overs between Transnational Corporations and Small and Medium-Sized Enterprises in Developing Countries - Opportunities and Policies , 2000 .

[82]  Roberto Fontana,et al.  Firm Size and Openness: The Driving Forces of University-Industry Collaboration , 2003 .

[83]  Charles Edquist,et al.  Systems of innovation perspectives and challenges , 2004 .

[84]  L. Georghiou.  Evolving Frameworks for European Collaboration in Research and Technology , 2001 .

[85]  Kinji Gonda,et al.  Research, technology and development evaluation; developments in Japan , 2005, Scientometrics.

[86]  Viviane M. J. Robinson.  Current Controversies in Action Research , 1993 .

[87]  Vittorio Chiesa,et al.  Differences and similarities in managing technological collaborations in research, development and manufacturing: a case study , 2000 .

[88]  M. Crossan.  The Knowledge-Creating Company: How Japanese Companies Create the Dynamics of Innovation , 1996 .

[89]  Lee Branstetter,et al.  When Do Research Consortia Work Well and Why? Evidence from Japanese Panel Data , 2000 .