Influence of a performance indicator on Danish research production and citation impact 2000–12

This paper analyses the patterns of Danish research productivity, citation impact and (inter)national collaboration across document types 2000–2012, prior to and after the introduction of the Norwegian publication point-based performance indicator in 2008. Document types analysed are: research articles; conference proceedings papers excluding meeting abstracts; and review articles. The Danish Research & Innovation Agency’s basic statistics combined with Web of Science (WoS) are used for data collection and analyses. Findings demonstrate that the research article productivity increases steeply (37 %) after the start of the performance indicator and the citation impact progresses linearly over the entire period, regardless the introduction of the performance indicator. Academic staff progression is only 24 % during the same time period. The collaboration ratio between purely Danish and internationally cooperated research articles remains stable during the period, the number of collaborative countries increases while the ratio declines significantly for proceedings papers. The citation impact of internationally cooperated research articles increases since 2009 but drops for proceedings papers; also their productivity declines slightly from 2009 according to Research Agency statistics. Since 2006 the WoS indexing of proceedings papers is fast declining; as a consequence the ratio between Danish proceedings papers and research articles declines in WoS. According to Research Agency statistics a decline likewise takes place, starting from 2009. The positive growth in research articles mainly derives from the Science and Technology fields published in prestigious Level 2 journals; the development of articles published in less prestigious Level 1 journals derives from all fields. Three of the eight Danish universities have significantly altered their research publication profiles since 2009. The publication performance model is regarded as the significant accelerator of these processes in recent years.

[1]  Francis Narin,et al.  Scientific co-operation in Europe and the citation of multinationally authored papers , 1991, Scientometrics.

[2]  Ying He,et al.  Contribution of Chinese publications in computer science: A case study on LNCS , 2007, Scientometrics.

[3]  魏屹东,et al.  Scientometrics , 2018, Encyclopedia of Big Data.

[4]  Koenraad Debackere,et al.  Using a bibliometric approach to support research policy making: The case of the Flemish BOF-key , 2004, Scientometrics.

[5]  Jean-François Dartigues,et al.  Association of Plasma Aß Peptides with Blood Pressure in the Elderly , 2011, PloS one.

[6]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[7]  J. S. Katz,et al.  What is research collaboration , 1997 .

[8]  Elaine Howard Ecklund,et al.  International Stem Cell Collaboration: How Disparate Policies between the United States and the United Kingdom Impact Research , 2011, PloS one.

[9]  Jacques Wainer,et al.  Patterns of bibliographic references in the ACM published papers , 2011, Inf. Process. Manag..

[10]  Tim C. E. Engels,et al.  The representation of the social sciences and humanities in the Web of Science—a comparison of publication patterns and incentive structures in Flanders and Norway (2005–9) , 2012 .

[11]  Diana Hicks,et al.  How much is a collaboration worth? A calibrated bibliometric model , 1997, Scientometrics.

[12]  Anthony F. J. van Raan,et al.  Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods , 2005, Scientometrics.

[13]  L. Butler,et al.  Explaining Australia’s increased share of ISI publications—the effects of a funding formula based on publication counts , 2003 .

[14]  Peter Ingwersen,et al.  Publication point indicators: A comparative case study of two publication point systems and citation impact in an interdisciplinary context , 2010, J. Informetrics.

[15]  Linda Butler,et al.  What Happens when Funding is Linked to Publication Counts , 2004 .

[16]  Peter Ingwersen,et al.  Influence of university mergers and the Norwegian performance indicator on overall Danish citation impact 2000-12 , 2013 .

[17]  Birger Larsen,et al.  Influence of proceedings papers on citation impact in seven sub-fields of sustainable energy research 2005–2011 , 2014, Scientometrics.

[18]  Eric H. J. Spruyt,et al.  Changing publication patterns in the Social Sciences and Humanities, 2000–2009 , 2012, Scientometrics.

[19]  J. Schneider.  An Outline of the Bibliometric Indicator Used for Performance-Based Funding of Research Institutions in Norway , 2009 .

[20]  Anthony F. J. van Raan,et al.  Advanced bibliometric methods for the evaluation of universities , 1999, Scientometrics.

[21]  Gunnar Sivertsen,et al.  Evaluering av den bibliometriske forskningsindikator , 2012 .

[22]  Linda Butler,et al.  Extending citation analysis to non-source items , 2006, Scientometrics.

[23]  Nivio Ziviani,et al.  Assessing the quality of scientific conferences based on bibliographic citations , 2010, Scientometrics.

[24]  Wolfgang Glänzel,et al.  Coauthorship Patterns and Trends in the Sciences (1980-1998): A Bibliometric Study With Implications for Database Indexing and Search Strategies , 2002, Libr. Trends.

[25]  H. Moed.  Citation Analysis in Research Evaluation (Information Science & Knowledge Management) , 2005 .