Performance-based funding models and researcher behavior: An analysis of the influence of the Norwegian Publication Indicator at the individual level

The growing use of performance-based research funding systems (PRFS) has motivated increased interest in how they influence researcher behavior. This paper draws both on survey and publication data to examine developments in researcher behavior and publication activity for individual researchers since the implementation of the Norwegian Publication Indicator in 2004. The Publication Indicator is a system for documenting Norwegian academic publishing with the aim of measuring publication activity and allocating research funding according to the publishing performance. A main feature of the model is that publications are classified at two levels, where higher level papers are valued more in terms of the model’s publication points. Points are then awarded based on the fractional counts. When following the group of researchers that has been active over the entire period, 2004-2012, we find that average points per researcher have fallen over the period. However, at the same time, average publication counts and number co-authors per paper have increased substantially. Essentially, productivity in publication counts has increased but productivity in fractional counts has fallen, as has average publication points. While both increased publications and collaboration would appear to be viewed as positive developments from a policy standpoint, the model’s point system risks discouraging collaboration.

[1]  L. Butler,et al.  Explaining Australia’s increased share of ISI publications—the effects of a funding formula based on publication counts , 2003 .

[2]  D. Lindsey,et al.  Using citation counts as a measure of quality in science measuring what's measurable rather than what's valid , 1989, Scientometrics.

[3]  Tindaro Cicero,et al.  Individual research performance: A proposal for comparing apples to oranges , 2013, J. Informetrics.

[4]  Diana Hicks.  Overview of models of performance-based research funding systems , 2010 .

[5]  Barry Bozeman,et al.  The Impact of Research Collaboration on Scientific Productivity , 2005 .

[6]  Kaare Aagaard,et al.  Impacts of performance-based research funding systems: The case of the Norwegian Publication Indicator , 2015 .

[7]  B. Martin,et al.  University Research Evaluation and Funding: An International Comparison , 2003 .

[8]  Kaare Aagaard,et al.  What happens when national research funding is linked to differentiated publication counts? A comparison of the Australian and Norwegian publication-based funding models , 2016 .

[9]  Julian Warner,et al.  A critical review of the application of citation studies to the Research Assessment Exercises , 2000, J. Inf. Sci..

[10]  Kaare Aagaard,et al.  How incentives trickle down: Local use of a national bibliometric indicator system , 2015 .

[11]  Giovanni Abramo,et al.  The importance of accounting for the number of co-authors and their order when assessing research performance at the individual level in the life sciences , 2018, J. Informetrics.

[12]  L. Butler.  A list of published papers is no measure of value , 2002, Nature.

[13]  D. Hicks.  Performance-based university research funding systems , 2012 .

[14]  Fredrik Niclas Piro,et al.  A macro analysis of productivity differences across fields: Challenges in the measurement of scientific publishing , 2013, J. Assoc. Inf. Sci. Technol..

[15]  Anthony F. J. van Raan,et al.  Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods , 2005, Scientometrics.

[16]  Jochen Gläser,et al.  The Social Orders of Research Evaluation Systems , 2007 .

[17]  Jonathon N. Cummings,et al.  Coordination costs and project outcomes in multi-university collaborations , 2007 .

[18]  Svein Kyvik,et al.  Explaining the increase in publication productivity among academic staff: a generational perspective , 2015 .

[19]  Gunnar Sivertsen,et al.  Evaluering av den bibliometriske forskningsindikator , 2012 .

[20]  Linda Butler,et al.  What Happens when Funding is Linked to Publication Counts , 2004 .

[21]  Chaomei Chen,et al.  How are collaboration and productivity correlated at various career stages of scientists? , 2014, Scientometrics.

[22]  Dag W. Aksnes,et al.  Publication rate expressed by age, gender and academic position - A large-scale analysis of Norwegian academic staff , 2015, J. Informetrics.

[23]  L. Butler,et al.  Modifying publication practices in response to funding formulas , 2003 .