National-scale research performance assessment at the individual level

There is an evident and rapid trend towards the adoption of evaluation exercises for national research systems for purposes, among others, of improving allocative efficiency in public funding of individual institutions. However the desired macroeconomic aims could be compromised if internal redistribution of government resources within each research institution does not follow a consistent logic: the intended effects of national evaluation systems can result only if a “funds for quality” rule is followed at all levels of decision-making. The objective of this study is to propose a bibliometric methodology for: (i) large-scale comparative evaluation of research performance by individual scientists, research groups and departments within research institution, to inform selective funding allocations; and (ii) assessment of strengths and weaknesses by field of research, to inform strategic planning and control. The proposed methodology has been applied to the hard science disciplines of the Italian university research system for the period 2004–2006.

[1]  L. Butler,et al.  Explaining Australia’s increased share of ISI publications—the effects of a funding formula based on publication counts , 2003 .

[2]  Massimo Franceschet,et al.  A cluster analysis of scholar and journal bibliometric indicators , 2009, J. Assoc. Inf. Sci. Technol..

[3]  Giovanni Abramo,et al.  Gender differences in research productivity: A bibliometric analysis of the Italian academic system , 2009, Scientometrics.

[4]  Ulf Sandström,et al.  Meeting the Micro-Level Challenges : Bibliometrics at the Individual Level , 2009 .

[5]  Thed N. van Leeuwen,et al.  A bibliometric classificatory approach for the study and assessment of research performance at the individual level: The effects of age on productivity and impact , 2010, J. Assoc. Inf. Sci. Technol..

[6]  J. Dalrymple Managing Successful Universities , 2007 .

[7]  Nicoline Frølich Funding Systems and Their Effects on Higher Education Systems NATIONAL STUDY – NORWAY November 2006 , 2006 .

[8]  Dominic Orr,et al.  Performance‐based funding as an instrument of competition in German higher education , 2007 .

[9]  Lutz Bornmann,et al.  OPEN PEN ACCESS CCESS , 2008 .

[10]  Mike Shattock Managing modern universities , 2000 .

[11]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[12]  Sean Howard,et al.  The Research Assessment Exercise , 1998 .

[13]  Giovanni Abramo,et al.  Assessment of sectoral aggregation distortion in research productivity measurements , 2008 .

[14]  Loet Leydesdorff,et al.  Caveats for the Use of Citation Indicators in Research and Journal Evaluations , 2008, J. Assoc. Inf. Sci. Technol..

[15]  Thed N. van Leeuwen,et al.  Development and application of journal impact measures in the Dutch science system , 2002, Scientometrics.

[16]  Thed N. van Leeuwen,et al.  Development and Application of New Journal Impact Measures , 2001, Cortex.

[17]  B Rogers,et al.  Gender Differences in Research , 1994, AAOHN journal : official journal of the American Association of Occupational Health Nurses.

[18]  Shaun Goldfinch,et al.  Perils of peer review in a small country? The Performance Based Research Fund in New Zealand , 2012 .

[19]  Henk F. Moed,et al.  Bibliometric Indicators of University Research Performance in Flanders , 1998, J. Am. Soc. Inf. Sci..

[20]  B. Martin,et al.  University Research Evaluation and Funding: An International Comparison , 2003 .

[21]  Diana Hicks,et al.  Evolving regimes of multi-university research evaluation , 2009 .

[22]  P. Bentley,et al.  Gender differences in research productivity : a comparative analysis of Norway and Australia , 2009 .

[23]  Franz Strehl,et al.  Funding Systems and their Effects on Higher Education Systems , 2007 .

[24]  Ronald Rousseau,et al.  Output-Financing at LUC , 2004, Scientometrics.

[25]  Anindya Bhattacharya,et al.  Allocative Efficiency and an Incentive Scheme for Research , 2010 .

[26]  Henk F. Moed,et al.  Bibliometric indicators of university research performance in Flanders , 1998 .