Ranking of rankings: benchmarking twenty-five higher education ranking systems in Europe

The purpose of this study is to evaluate the ranking practices of 25 European higher education ranking systems (HERSs). Ranking practices were assessed with 14 quantitative measures derived from the Berlin Principles on Ranking of Higher Education Institutions (BPs). HERSs were then ranked according to their degree of congruence with the BPs. Additionally, the three domains of methodology, transparency, and consumer-friendliness were proposed to underlie the BPs, and the measures were also applied for assessing HERSs regarding these domains. Results indicate that the cooperating HERSs by CHE (Germany), AQA (Austria) and swissUp (Switzerland) exhibit the highest congruence with the BPs. However, no European HERS demonstrates good overall congruence with the BPs, mainly due to methodological shortcomings. Results further show that HERSs compiled and published by non-profit research entities seem to perform better than the majority of HERSs published by for-profit news outlets. International comparisons indicate that HERSs published in German-speaking countries and the Netherlands tend to exhibit a higher congruence with the BPs. Overall, this study hopes to stimulate the improvement of ranking practices through benchmarking with existing exemplary models. The quantitative assessment tool further promises to be useful in explaining relative stability or change of higher education institutions in HERSs, as well as in helping to explain resource allocation pressures within higher education institutions.

[1]  Patrick T. Terenzini,et al.  Living with Myths: Undergraduate Education in America , 1994 .

[2]  Jan Sadlak,et al.  University Rankings: Seeking Prestige, Raising Visibility and Embedding Quality – the Editors' Views , 2008 .

[3]  Simon Marginson,et al.  To Rank or To Be Ranked: The Impact of Global Rankings in Higher Education , 2007 .

[4]  Gero Federkeil,et al.  Rankings and Quality Assurance in Higher Education. , 2008 .

[5]  Jan Sadlak,et al.  Higher Education Rankings: Evolution, Acceptance, and Dialogue , 2005 .

[6]  Rachelle L. Brooks.  Measuring University Quality , 2005 .

[7]  Jamie P. Merisotis.  Summary Report of the Invitational Roundtable on Statistical Indicators for the Quality Assessment of Higher/Tertiary Education Institutions: Ranking and League Table Methodologies , 2002 .

[8]  Elizabeth Vaquera,et al.  Spanish Universities and the Ranking 2005 Initiative , 2005 .

[9]  D. Dill,et al.  Academic quality, league tables, and public policy: A cross-national analysis of university ranking systems , 2005 .

[10]  Nian Cai Liu,et al.  The world-class university and ranking : aiming beyond status , 2007 .

[11]  Patricia M. McDonough,et al.  COLLEGE RANKINGS: Democratized College Knowledge for Whom? , 1998 .

[12]  Kurt De Wit,et al.  The Consequences of European Integration for Higher Education. , 2003 .

[13]  Martin Enserink,et al.  Who Ranks the University Rankers? , 2007, Science.

[14]  Marguerite Clarke,et al.  College and University Ranking Systems: Global Perspectives and American Challenges. , 2007 .

[15]  E. Hazelkorn.  The Impact of League Tables and Ranking Systems on Higher Education Decision Making , 2007 .

[16]  R. Braddock,et al.  International University Ranking Systems and the Idea of University Excellence , 2007 .

[17]  Mantz Yorke,et al.  A good league table guide , 1997 .

[18]  Alexander C. McCormick.  The Complex Interplay between Classification and Ranking of Colleges and Universities: Should the Berlin Principles Apply Equally to Classification?. , 2008 .

[19]  N. Dyke.  Twenty Years of University Report Cards , 2005 .

[20]  Ingo Stolz,et al.  A Comparative Analysis of Higher Education Ranking Systems in Europe , 2008 .

[21]  Mantz Yorke,et al.  Institutional rankings, marketing, and the needs of intending students , 2009 .

[22]  J. Salmi,et al.  League Tables as Policy Instruments: Uses and Misuses , 2007 .

[23]  Bernard Kingston,et al.  The Times Good University Guide 2007 , 2006 .

[24]  Alex Usher,et al.  A World of Difference: A Global Survey of University League Tables. Canadian Education Report Series. , 2006 .

[25]  Rachel Bowden,et al.  Fantasy Higher Education: University and college league tables , 2000 .

[26]  A. Usher,et al.  A Global Survey of University Ranking and League Tables , 2007 .

[27]  Nian Cai Liu,et al.  Examining Major Rankings According to the Berlin Principles , 2008 .

[28]  Rudolf Tippelt,et al.  Hochschullandschaft im Wandel , 2005 .

[29]  Marguerite Clarke,et al.  Some Guidelines for Academic Quality Rankings , 2002 .