Behind league tables and ranking systems

Purpose – The purpose of this paper is to examine the role of university ranking systems as instruments of university quality assessment. Some controversy surrounds the methodology used to compile such instruments. Accordingly, different compilers have adopted different methods to produce these rankings. This study examines to what extent this diversity in methodology is now converging in the context of Spanish university rankings. Design/methodology/approach – To conduct this research, a two-step approach was adopted. First, the indicators used in four Spanish rankings were examined. Second, empirical analysis was used to identify differences between university rankings. Findings – Results reveal that, despite the vast number and variety of indicators, there is a positive, significant relationship between rankings. Spanish university rankings thus show some degree of convergence. Social implications – Because rankings influence behavior and shape institutional decision making, a better understanding of h...

[1]  D. Dilts,et al.  Assessing What Professors Do: An Introduction to Academic Performance Appraisal in Higher Education , 1994 .

[2]  Y. Cheng,et al.  Multi‐models of quality in education , 1997 .

[3]  Debasish Datta,et al.  The Relative Efficiencies of Canadian Universities: A DEA Perspective , 1998 .

[4]  María del Carmen Pérez Esparrells,et al.  El uso de los indicadores de gestión en la evaluación de la calidad universitaria , 1998 .

[5]  Charles Eccles,et al.  The Use of University Rankings in the United Kingdom , 2002 .

[6]  G. Federkeil Some Aspects of Ranking Methodology--The CHE-Ranking of German Universities , 2002 .

[7]  Tetsuo Kobayashi,et al.  University Rankings in Japan , 2002 .

[8]  Waldemar Siwin´Ski Perspektywy --Ten Years of Rankings , 2002 .

[9]  Lee Harvey,et al.  The End of Quality? , 2002 .

[10]  Robert K. Toutkoushian,et al.  Using Publications Counts to Measure an Institution's Research Productivity , 2003 .

[11]  Stefano Tarantola,et al.  Handbook on Constructing Composite Indicators: Methodology and User Guide , 2005 .

[12]  Anthony F. J. van Raan,et al.  Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods , 2005, Scientometrics.

[13]  N. Dyke Twenty Years of University Report Cards , 2005 .

[14]  David Turner,et al.  Benchmarking in universities: league tables revisited , 2005 .

[15]  Cinzia Daraio,et al.  Exploring size and agglomeration effects on public research productivity , 2005, Scientometrics.

[16]  Fumi Kitagawa Universities and Innovation in the Knowledge Economy: Cases from English Regions , 2005 .

[17]  D. Dill,et al.  Academic quality, league tables, and public policy: A cross-national analysis of university ranking systems , 2005 .

[18]  Simon Marginson,et al.  To Rank or To Be Ranked: The Impact of Global Rankings in Higher Education , 2007 .

[19]  Wing Hong Chan,et al.  University Efficiency: A Comparison and Consolidation of Results from Stochastic and Non‐stochastic Methods , 2006 .

[20]  A. Usher,et al.  A Global Survey of University Ranking and League Tables , 2007 .

[21]  Giovanni Abramo,et al.  The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology , 2008, Scientometrics.

[22]  P. J. Wells,et al.  Quality Assurance and Accreditation: A Glossary of Basic Terms and Definitions , 2007 .

[23]  Gualberto Buela-Casal,et al.  Comparative study of international academic rankings of universities , 2007, Scientometrics.

[24]  Martin Enserink,et al.  Who Ranks the University Rankers? , 2007, Science.

[25]  J. Salmi,et al.  League Tables as Policy Instruments: Uses and Misuses , 2007 .

[26]  E. Hazelkorn The Impact of League Tables and Ranking Systems on Higher Education Decision Making , 2007 .

[27]  Hamish Coates Universities on the Catwalk: Models for Performance Ranking in Australia , 2007 .

[28]  Lars Coenen,et al.  The Role of Universities in the Regional Innovation Systems of the North East of England and Scania, Sweden: Providing Missing Links? , 2007 .

[29]  Simon Marginson,et al.  Global University Rankings: Implications in general and for Australia , 2007 .

[30]  Jill Ann Tarzian Sorensen,et al.  Evaluating academic technology transfer performance by how well access to knowledge is facilitated––defining an access metric , 2008 .

[31]  P. Murias,et al.  A Composite Indicator for University Quality Assesment: The Case of Spanish Higher Education System , 2008 .

[32]  David A. Wolfe,et al.  Universities and regional economic development: The entrepreneurial University of Waterloo , 2008 .

[33]  M. Drabenstott Universities, Innovation and Regional Development: A View from the United States , 2008 .

[34]  S. Marginson The knowledge economy and higher education: a system for regulating the value of knowledge , 2009 .

[35]  Ana Brochado,et al.  Comparing alternative instruments to measure service quality in higher education , 2009 .

[36]  Ellen Hazelkorn,et al.  Rankings and the battle for world-class excellence , 2009 .

[37]  Ellen Hazelkorn,et al.  Rankings and the Battle for World-Class Excellence: Institutional Strategies and Policy Choices , 2009 .

[38]  Grant Harman,et al.  New challenges for higher education: global and Asia-Pacific perspectives , 2009 .

[39]  Simon Marginson,et al.  The knowledge economy and higher education: Rankings and classifications, research metrics and learning outcomes measures as a system for regulating the value of knowledge , 2009 .

[40]  Dana M. Johnson,et al.  Service quality in higher education , 2009 .

[41]  J. Sierra,et al.  Ranking de 2008 en productividad en investigación de las universidades públicas españolas , 2009 .

[42]  F. V. Vught,et al.  The EU Innovation Agenda: Challenges for European Higher Education and Research. , 2009 .

[43]  Calidad de las universidades: un índice sintético , 2009 .

[44]  El futuro de la Universidad: Un tema para debate dentro y fuera de las universidades , 2009 .

[45]  R. Yeo Service quality ideals in a competitive tertiary environment , 2009 .

[46]  Deane E. Neubauer Ten Globalization Challenges to Higher Education Quality and Quality Assurance , 2010 .

[47]  José Luis Ortega,et al.  Comparing university rankings , 2010, Scientometrics.

[48]  Rebeka Lukman,et al.  University ranking using research, educational and environmental indicators , 2010 .

[49]  Gualberto Buela-Casal,et al.  Ranking de 2009 en investigacin de las universidades pblicas espaolas , 2010 .

[50]  Chia-Wei Tang,et al.  Obtaining a picture of undergraduate education quality: a voice from inside the university , 2010 .

[51]  Francisco Herrera,et al.  A methodology for Institution-Field ranking based on a bidimensional analysis: the IFQ2A index , 2011, Scientometrics.

[52]  Ulrich Teichler,et al.  University rankings : theoretical basis, methodology and impacts on global higher education , 2011 .

[53]  Emilio Delgado López-Cózar Rankings ISI de las universidades españolas según campos y disciplinas científicas (2ª ed. 2011) , 2011 .

[54]  Is quality assurance in higher education contextually relative , 2011 .

[55]  Emilio Delgado López-Cózar Rankings ISI de las universidades españolas según campos científicos: descripción y resultados , 2011 .

[56]  Mu-Hsuan Huang,et al.  A Comparison of Three Major Academic Rankings for World Universities: From a Research Evaluation Perspective , 2011 .

[57]  Jung Cheol Shin,et al.  Organizational Effectiveness and University Rankings , 2011 .

[58]  E. Gummesson,et al.  Value co-creation and university teaching quality Consequences for the European Higher Education Area (EHEA) , 2012 .

[59]  S. Robertson World-class higher education (for whom?) , 2012 .

[60]  Gualberto Buela-Casal,et al.  Ranking de 2011 en producción y productividad en investigación de las universidades públicas españolas , 2012 .

[61]  A. Hou,et al.  Is there a gap between students’ preference and university presidents’ concern over college ranking indicators?: a case study of “College Navigator in Taiwan” , 2012 .

[62]  Preiddy Efraín-García,et al.  Visibility in international rankings. Strategies for enhancing the competitiveness of Spanish universities , 2012, Scientometrics.

[63]  Angela Yung-Chi Hou,et al.  Impact of excellence programs on Taiwan higher education in terms of quality assurance and academic excellence, examining the conflicting role of Taiwan’s accrediting agencies , 2012 .

[64]  Michael Hoyler,et al.  Global geographies of higher education: The perspective of world university rankings , 2013 .