Quality evaluations in the management of basic and applied research

Abstract This paper studies the uses and impacts of evaluations performed by Research Councils and equivalent organizations in Denmark, Finland, Norway, and Sweden. These evaluations are aimed at assessing research quality in basic and applied fields. The evaluated units were research areas, programmes and institutes. The evaluations were carried out by expert groups consisting mainly of non-Nordic scholars. The data for the study were obtained by interviews and written sources. The paper gives a short history of quality evaluations in the Nordic countries and probes into their science policy context and aims. It introduces concepts by which we may analyze uses and impacts, and highlights their meanings by examples. It draws attention to the various audiences of evaluations and to factors that enhance or hinder uses and impacts. It concludes by questioning the cost-effectiveness of evaluations by pointing out some possible negative and long-term impacts.