Benchmarking regional innovative performance: composite measures and direct innovation counts

There is a considerable amount of discussion, but still no consensus, about which indicator should be used to measure innovation. To participate in this debate, a unique innovation database, SFINNO, is introduced. Innovation counts from the database are used as the baseline, to which individual proxy indicators (patent- and research and development statistics) of innovation and innovation indexes, constructed here with principal component analysis, are compared. The local administrative units of Finland serve as the regional units benchmarked. The study results show that innovation is a complex phenomenon which cannot be entirely explained through the use of proxy statistics, as the linkages between innovation input- and output-indicators are fuzzy. We also show that the strength of these linkages varies by field of technology. Furthermore, different innovation measures produce highly divergent rankings when they are used as benchmarking tools of regional innovative performance. Although the produced innovation indexes perform slightly better, their superiority is marginal. Therefore, caution should be taken before drawing too drastic policy conclusions depending on a single measure of regional innovative performance.

[1]  Thomas Baumert,et al.  The determinants of regional innovation in Europe: A combined factorial and regression knowledge production function approach , 2010 .

[2]  А А Ализаде 2008. 03. 014. ОЭСР о науке, технологии и промышленности: инновации и свершения в глобальной экономике. OECD Science, technology and industry Scoreboard: innovation and performance in the global economy. - Paris: OECD, 2007. - 228 p , 2008 .

[3]  A. Jaffe Real Effects of Academic Research , 1989 .

[4]  Benedetto Lepori,et al.  New perspectives and challenges for the design and production of S&T indicators , 2008 .

[5]  Sandro Mendonça,et al.  Trademarks as an Indicator of Innovation and Industrial Change , 2004 .

[6]  G. Panne,et al.  On the Marshall--Jacobs controversy: it takes two to tango , 2006 .

[7]  D. Archibugi,et al.  Measuring technological change through patents and innovation surveys , 1996 .

[8]  Ajay Agrawal,et al.  Innovation and the Growth of Cities , 2003 .

[9]  M. Lieberman The learning curve, technology barriers to entry, and competitive survival in the chemical processing industries , 1989 .

[10]  Shaun Ryan,et al.  To patent or not to patent , 2001 .

[11]  J. Schumpeter The Theory of Economic Development: An Inquiry into Profits, Capital, Credit, Interest, and the Business Cycle , 1934 .

[12]  Peter Y. Chen,et al.  Correlation: Parametric and Nonparametric Measures , 2002 .

[13]  D. Third OECD/Eurostat . Oslo Manual-Guidelines for Collecting and Interpreting Technological Innovation Paris, France: , 2005 .

[14]  H. Grupp,et al.  Innovation in the service sector: The demand for service-specific innovation measurement concepts and typologies , 2005 .

[15]  Fernando Jiménez-Sáez,et al.  Regional Innovation Systems: How to Assess Performance , 2007 .

[16]  Stefano Tarantola,et al.  Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators , 2005 .

[17]  J. Fagerberg,et al.  National innovation systems, capabilities and economic development , 2008 .

[18]  George S. Ford,et al.  A Valley of Death in the Innovation Sequence: An Economic Investigation , 2007 .

[19]  David B. Audretsch,et al.  Analysing Innovation Output Indicators: The US Experience , 1993 .

[20]  R. Rothwell Successful industrial innovation: critical factors for the 1990s , 1992 .

[21]  Rod Coombs,et al.  A literature-based innovation output indicator , 1996 .

[22]  A. Kaasa,et al.  Effects of Different Dimensions of Social Capital on Innovation: Evidence from Europe at the Regional Level , 2007 .

[23]  M. Thompson,et al.  The Index of Innovation: A New Tool for Regional Analysis , 2011 .

[24]  A. Lagendijk,et al.  Regional Innovation Systems in the Lisbon strategy , 2005 .

[25]  Brigitte Unger Innovation Systems and Innovative Performance: Voice Systems , 2000 .

[26]  J. Fagerberg,et al.  The Oxford handbook of innovation , 2006 .

[27]  I. Jolliffe Principal Component Analysis , 2002 .

[28]  Luc Soete,et al.  Catching up in technology: entry barriers and windows of opportunity , 1988 .

[29]  Karen R. Polenske,et al.  The Economic Geography of Innovation , 2007 .

[30]  J. Fagerberg,et al.  Innovation studies—The emerging structure of a new scientific field , 2009 .

[31]  Wolfgang G. Stock,et al.  Science and technology in the region: The output of regional science and technology, its strengths and its leading institutions , 2005, Scientometrics.

[32]  Ulrich Schmoch,et al.  Service marks as indicators for innovation in knowledge-based services , 2009 .

[33]  R. Rothwell,et al.  Re‐innovation and robust designs: Producer and user benefits , 1988 .

[34]  Michael J. Cooper,et al.  Measuring innovation. , 2011, Healthcare executive.

[35]  C. Bloch,et al.  Oslo Manual - Guidelines for Collecting and Interpreting Innovation Data, 3rd edition: Proposed Guidelines for Collecting and Interpreting Innovation Data , 2005 .

[36]  Alfred Kleinknecht,et al.  The Non-Trivial Choice between Innovation Indicators , 2002 .

[37]  Jeong-Dong Lee,et al.  A fuzzy set theory approach to national composite S&T indices , 2005, Scientometrics.

[38]  Mercedes Rodríguez,et al.  How innovative are services? an empirical analysis for Spain , 2005 .

[39]  Elias G. Carayannis,et al.  Measuring firm innovativeness: towards a composite innovation index built on firm innovative posture, propensity and performance attributes , 2008 .

[40]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[41]  D. Archibugi,et al.  Measuring technological capabilities at the country level: A survey and a menu for choice , 2005 .

[42]  Thomas Baumert,et al.  Regional Systems of Innovation and the Knowledge Production Function: The Spanish Case , 2006 .

[43]  Mark Rogers,et al.  Innovation and Performance: Benchmarking Australian Firms , 2003 .

[44]  J. Hagedoorn,et al.  Measuring innovative performance: is there an advantage in using multiple indicators? , 2003 .

[45]  A. Varga The Spatial Dimension of Innovation and Growth: Empirical Research Methodology and Policy Analysis , 2006 .

[46]  Jianmin Tang,et al.  Multidimensional Innovation and Productivity , 2007 .

[47]  G. Dosi,et al.  Technical Change and Economic Theory , 1989 .

[48]  E. Huizingh Open innovation: State of the art and future perspectives , 2011 .

[49]  Alfred Kleinknecht,et al.  New Concepts in Innovation Output Measurement , 1993 .

[50]  Jacques Michel,et al.  Patent citation analysis.A closer look at the basic input data from patent search reports , 2001, Scientometrics.

[51]  Hugo Pinto,et al.  The Diversity of Innovation in the European Union: Mapping Latent Dimensions and Regional Profiles , 2009 .

[52]  A. Davies,et al.  Toward Theory-Led Evaluation , 2006 .

[53]  A. Arundel,et al.  What percentage of innovations are patented? empirical estimates for European firms , 1998 .

[54]  A. Arundel The relative effectiveness of patents and secrecy for appropriation , 2001 .

[55]  H. Pinto,et al.  Innovation regional planning and latent dimensions: the case of the Algarve region , 2010 .

[56]  Jianmin Tang,et al.  Link between innovation and productivity in Canadian manufacturing industries , 2004 .

[57]  Heinz Hollenstein,et al.  A composite indicator of a firm's innovativeness. An empirical analysis based on survey data for Swiss manufacturing , 1996 .

[58]  P. Beneito The innovative performance of in-house and contracted R&D in terms of patents and utility models , 2006 .

[59]  H. Grupp,et al.  Indicators for national science and technology policy: how robust are composite indicators? , 2004 .

[60]  Alex Coad,et al.  Innovation and firm growth in high-tech sectors: A quantile regression approach , 2008 .

[61]  Karen R. Polenske,et al.  The Economic Geography of Innovation: Measuring the geography of innovation: a literature review , 2007 .

[62]  Roel Rutten,et al.  Innovation in Regions , 2007 .

[63]  Bronwyn H Hall,et al.  Market value and patent citations , 2005 .

[64]  F. Damanpour Organizational Innovation: A Meta-Analysis Of Effects Of Determinants and Moderators , 1991 .

[65]  Z. Ács,et al.  Geography, Endogenous Growth, and Innovation , 2002 .

[66]  L. Anselin,et al.  Patents and innovation counts as measures of regional production of new knowledge , 2002 .

[67]  Maryann P. Feldman,et al.  Real Effects of Academic Research: Comment , 1992 .

[68]  Gerben van der Panne,et al.  Issues in measuring innovation , 2007, Scientometrics.

[69]  Matthew David,et al.  Social Research: The Basics , 2004 .

[70]  Andrew J. Nelson Measuring Knowledge Spillovers: What Patents, Licenses and Publications Reveal About Innovation Diffusion , 2009 .

[71]  Nathan Rosenberg,et al.  An Overview of Innovation , 2009 .

[72]  H. Grupp,et al.  Review and new evidence on composite innovation indicators for evaluating national performance , 2010 .

[73]  F. Booysen An Overview and Evaluation of Composite Indices of Development , 2002 .