Evaluation Without Evaluators

The Australian research evaluation system (RES) is unique in its exclusive reliance on a funding formula. For each university, statistics on income from competitive research grants, numbers of publications, numbers of current research students (Masters and PhD students), and timely completions of Masters and PhD studies are collected and used to calculate the allocation of state funds without any further consideration.

[1]  B. Latour,et al.  Laboratory Life: The Construction of Scientific Facts , 1979 .

[2]  Wolfgang Krohn,et al.  Finalization in science , 1976 .

[3]  M. Polanyi.  The Republic of science , 1962 .

[4]  Yochai Benkler,et al.  Coase's Penguin, or Linux and the Nature of the Firm , 2001, ArXiv.

[5]  Peter Hedström.  Dissecting the Social by Peter Hedstrom , 2005 .

[6]  Science Policy in Action: Policy and the Researcher , 2000 .

[7]  P. Hedström.  Dissecting the Social: On the Principles of Analytical Sociology , 2005 .

[8]  W. Powell,et al.  The New Institutionalism in Organizational Analysis , 1993 .

[9]  Beatriz Ruivo.  ‘Phases’ or ‘paradigms’ of science policy? , 1994 .

[10]  S. Woolgar,et al.  The Manufacture of Knowledge: an Essay on the Constructivist and Contextual Nature of Science , 1982 .

[11]  Michael Lynch,et al.  Art and Artifact in Laboratory Science: A Study of Shop Work and Shop Talk in a Research Laboratory , 1985 .

[12]  David H. Guston,et al.  Principal-agent theory and the structure of science policy , 1996 .

[13]  Criteria for Scientific Development: Public Policy and National Goals , 1968 .

[14]  Fritz W. Scharpf,et al.  Der Ansatz des akteurzentrierten Institutionalismus , 1995 .

[15]  D. Braun.  Who Governs Intermediary Agencies? Principal-Agent Relations in Research Policy-Making , 1993, Journal of Public Policy.

[16]  Susan E. Cozzens,et al.  Scientific establishments and hierarchies , 1982 .

[17]  D. Braun,et al.  The role of funding agencies in the cognitive development of science , 1998 .

[18]  D. North.  Institutions, Institutional Change and Economic Performance: Economic performance , 1990 .

[19]  Arie Rip,et al.  The development of restrictedness in the sciences , 1982 .

[20]  S. Marginson,et al.  The Enterprise University: Power, Governance and Reinvention in Australia , 2000 .

[21]  A. Rip.  The republic of science in the 1990s , 1994 .

[22]  R. Mayntz.  Mechanisms in the Analysis of Social Macro-Phenomena , 2004 .

[23]  S. Marginson.  Dynamics of National and Global Competition in Higher Education , 2006 .

[24]  R. Merton.  Social Theory and Social Structure , 1958 .

[25]  F. Scharpf,et al.  Games real actors play , 1997 .

[26]  Wolfgang Krohn,et al.  Finalization in Science. The Social Orientation of Scientific Progress , 1983 .

[27]  F. Scharpf.  Games Real Actors Play: Actor-centered Institutionalism In Policy Research , 1997 .

[28]  G. Laudel.  The art of getting funded: How scientists adapt to their funding conditions , 2006 .

[29]  Linking Theory and Practice: Introduction , 1998 .

[30]  Gernot Böhme,et al.  Die Finalisierung der Wissenschaft / The Finalization of Science , 1973 .

[31]  Jochen Glaser.  Wissenschaftliche Produktionsgemeinschaften: die soziale ordnung der forschung [Scientific Production Communities. The Social Order of Research] , 2006 .

[32]  W. Powell,et al.  The iron cage revisited institutional isomorphism and collective rationality in organizational fields , 1983 .

[33]  R. Mayntz.  Socialist Academies of Sciences: The Enforced Orientation of Basic Research at User Needs , 1998 .

[34]  Johan P. Olsen,et al.  The New Institutionalism: Organizational Factors in Political Life , 1983, American Political Science Review.

[35]  L. Leydesdorff,et al.  Has the Study of Philosophy at Dutch Universities Changed under Economic and Political Pressures? , 1991 .

[36]  Richard Whitley,et al.  Black Boxism and the Sociology of Science: A Discussion of the Major Developments in the Field , 1970 .

[37]  Sheila Jasanoff,et al.  Handbook of Science and Technology Studies , 1995 .

[38]  David Kemp,et al.  Knowledge and innovation: a policy statement on research and research training , 1999 .

[39]  Daryl E. Chubin,et al.  Research Trails and Science Policies: Local and Extra-Local Negotiation of Scientific Work , 1982 .

[40]  Fritz W. Scharpf,et al.  Gesellschaftliche Selbstregelung und politische Steuerung , 1995 .

[41]  Frank Havemann,et al.  A Methodological Study for Measuring the Diversity of Science , 2006 .

[42]  Giorgio Sirilli,et al.  R&D evaluation in Italy: more needs to be done , 2005 .

[43]  R. Whitley.  The Intellectual and Social Organization of the Sciences (Second Edition: with new introductory chapter entitled 'Science Transformed? The Changing Nature of Knowledge Production at the End of the Twentieth Century') , 1984 .

[44]  D. Kleinman.  Untangling Context: Understanding a University Laboratory in the Commercial World , 1998 .

[45]  Peter Hedstrom.  Dissecting the Social: List of tables , 2005 .

[46]  Karin Knorr Cetina,et al.  Laboratory Studies: The Cultural Approach to the Study of Science , 1995 .

[47]  R. Whitley.  Changes in the Social and Intellectual Organisation of the Sciences: Professionalisation and the Arithmetic Ideal , 1977 .

[48]  Barend van der Meulen,et al.  Science policies as principal-agent games: Institutionalization and path dependency in the relation between government and science , 1998 .