A Multi-Criteria Reference Point Based Approach for Assessing Regional Innovation Performance in Spain

The evaluation of regional innovation performance through composite innovation indices can serve as a valuable tool for policy-making. While discussion on the best methodology to construct composite innovation indices continues, we are interested in deepening the use of reference levels and the aggregation issue. So far, additive aggregation methods are, largely, the most widespread aggregation rule, thus allowing for full compensability among single indicators. In this paper, we present an integrated assessment methodology to evaluate regional innovation performance using the Multi-Reference Point based Weak and Strong Composite Indicator (MRP-WSCI) approach, which allows defining reference levels and different degrees of compensability. As an example of application to the Regional Innovation Scoreboard, the proposed technique is developed to measure the innovation performance of Spain’s regions taking into account Spanish and European reference levels. The main features of the proposed approach are: (i) absolute or relative reference levels could be previously defined by the decision maker; (ii) by establishing the reference levels, the resulting composite innovation index is an easy-to-interpret measure; and (iii) the non-compensatory strong composite indicator provides an additional layer of information for policy-making (iv) a visualization tool called Light-Diagram is proposed to track the specific strengths and weaknesses of the regions’ innovation performance.

[1]  Paz Méndez-Rodríguez,et al.  Synthetic indicators of mutual funds' environmental responsibility: An application of the Reference Point Method , 2014, Eur. J. Oper. Res..

[2]  A. Schibany,et al.  The European Innovation Scoreboard: drowning by numbers? , 2008 .

[3]  Heinz Hollenstein,et al.  A composite indicator of a firm's innovativeness. An empirical analysis based on survey data for Swiss manufacturing , 1996 .

[4]  S. Greco,et al.  On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness , 2019 .

[5]  Jan Kozlowski,et al.  Innovation indices: the need for positioning them where they properly belong , 2015, Scientometrics.

[6]  Gottfried Tappeiner,et al.  Measuring regional innovation: A critical inspection of the ability of single indicators to shape technological change , 2017 .

[7]  Francisco Ruiz,et al.  Evaluating university performance using reference point based composite indicators , 2018, J. Informetrics.

[8]  Andrea Fabrizi,et al.  THE IMPACT OF RELATIONAL SPILLOVERS FROM JOINT RESEARCH PROJECTS ON KNOWLEDGE CREATION ACROSS EUROPEAN REGIONS , 2016 .

[9]  Thomas Baumert,et al.  The determinants of regional innovation in Europe: A combined factorial and regression knowledge production function approach , 2010 .

[10]  Jianmin Tang,et al.  Multidimensional Innovation and Productivity , 2007 .

[11]  Jacinto González-Pachón,et al.  Measuring systems sustainability with multi-criteria methods: A critical review , 2017, Eur. J. Oper. Res..

[12]  Juan José Gibaja,et al.  Patterns of Innovation in EU-25 Regions: A Typology and Policy Recommendations , 2009 .

[13]  Giuseppe Munda,et al.  Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting , 2009 .

[14]  Francisco Ruiz,et al.  MRP-WSCI: Multiple reference point based weak and strong composite indicators , 2020 .

[15]  Jose Manuel Cabello,et al.  Building Ease-of-Doing-Business synthetic indicators using a double reference point approach , 2018, Technological Forecasting and Social Change.

[16]  Hugo Pinto,et al.  The Diversity of Innovation in the European Union: Mapping Latent Dimensions and Regional Profiles , 2009 .

[17]  Alfio Giarlotta,et al.  Multicriteria compensability analysis , 2001, Eur. J. Oper. Res..

[18]  Matteo Mazziotta,et al.  Measuring Well-Being Over Time: The Adjusted Mazziotta–Pareto Index Versus Other Non-compensatory Indices , 2018 .

[19]  Jose Manuel Cabello,et al.  Multicriteria development of synthetic indicators of the environmental profile of the Spanish regions , 2014 .

[20]  H. Grupp,et al.  Review and new evidence on composite innovation indicators for evaluating national performance , 2010 .

[21]  Jianmin Tang,et al.  Link between innovation and productivity in Canadian manufacturing industries , 2004 .

[22]  Trinidad Gómez,et al.  Building composite indicators using multicriteria methods: a review , 2019 .

[23]  Teemu Makkonen,et al.  Benchmarking regional innovative performance: composite measures and direct innovation counts , 2012, Scientometrics.

[24]  Angel Cobo,et al.  Innovative propensity with a fuzzy multicriteria approach , 2019, Management Decision.

[25]  H. Grupp,et al.  Indicators for national science and technology policy: how robust are composite indicators? , 2004 .

[26]  Sushil,et al.  Assessing innovativeness of manufacturing firms using an intuitionistic fuzzy based MCDM framework , 2019, Benchmarking: An International Journal.

[27]  Yorgos Goletsis,et al.  Composite innovation metrics: MCDA and the Quadruple Innovation Helix framework , 2017, Technological Forecasting and Social Change.

[28]  Andrzej P. Wierzbicki,et al.  The Use of Reference Objectives in Multiobjective Optimization , 1979 .

[29]  Roberta Capello,et al.  Territorial patterns of innovation: a taxonomy of innovative regions in Europe , 2013 .

[30]  Zenonas Turskis,et al.  EVALUATION OF THE EXPEDIENCY OF TECHNOLOGY COMMERCIALIZATION: A CASE OF INFORMATION TECHNOLOGY AND BIOTECHNOLOGY , 2020, Technological and Economic Development of Economy.

[31]  B. Asheim,et al.  Regional Innovation Systems: Theory, Empirics and Policy , 2011 .

[32]  Mark Rogers,et al.  Innovation and Performance: Benchmarking Australian Firms , 2003 .

[33]  Jose Manuel Cabello,et al.  An application of reference point techniques to the calculation of synthetic sustainability indicators , 2011, J. Oper. Res. Soc..