Inter-ranking reputational effects: an analysis of the Academic Ranking of World Universities (ARWU) and the Times Higher Education World University Rankings (THE) reputational relationship

Global university rankings have become a critical factor in the higher education sector, engendering increasing interest and exerting a notable influence over a wide variety of stakeholders. They are presented to different audiences as tools that evaluate and rank universities according to quality. However, some authors are of the opinion that rankings express reputational factors to a large extent. This article presents a model of the intra- and inter-ranking relationships from the perspective of reputation along with an empirical study on two of the most influential rankings: the Academic Ranking of World Universities and the Times Higher Education World University Rankings. Data from these two rankings between 2010 and 2018, and the application of ordinal regressions, provide evidence that both rankings are mutually influential, generating intra and reciprocal reputational effects over time.

[1]  Domingo Docampo,et al.  The effect of university mergers on the Shanghai ranking , 2015, Scientometrics.

[2]  Robert T. Blackburn,et al.  Changes in academic research performance over time: A study of institutional accumulative advantage , 1989 .

[3]  C. Gross,et al.  Effect of blinded peer review on abstract acceptance. , 2006, JAMA.

[4]  J. Scott Armstrong,et al.  Business School Prestige - Research Versus Teaching , 2005 .

[5]  Marshall H. Medoff,et al.  Evidence of a Harvard and Chicago Matthew Effect , 2006 .

[6]  Wen Lou,et al.  Does author affiliation reputation affect uncitedness? , 2015, ASIST.

[7]  David J. Smyth.  The Determinants of the Reputations of Economics Departments: Pages Published, Citations and the Andy Rooney Effect , 1999 .

[8]  Henk F. Moed,et al.  A critical comparative analysis of five world university rankings , 2016, Scientometrics.

[9]  Fredrik Niclas Piro,et al.  How can differences in international university rankings be explained? , 2016, Scientometrics.

[10]  Vicente Safón,et al.  Can the reputation of an established business school change? , 2012 .

[11]  Thed N. van Leeuwen,et al.  The Leiden ranking 2011/2012: Data collection, indicators, and interpretation , 2012, J. Assoc. Inf. Sci. Technol..

[12]  Niilo. Kauppi.  The global ranking game: narrowing academic excellence through numerical objectification , 2018, Studies in Higher Education.

[13]  M. Meyer,et al.  Drivers of citations: An analysis of publications in “top” accounting journals , 2017 .

[14]  Eric L. Dey,et al.  Changing Patterns of Publication Productivity: Accumulative Advantage or Institutional Isomorphism?. , 1997 .

[15]  Vicente Safón.  What do global university rankings really measure? The search for the X factor and the X entity , 2013, Scientometrics.

[16]  R. Blank.  The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review , 1991 .

[17]  Factors That Influence Recruiters' Choice of B-Schools and Their MBA Graduates: Evidence and Implications for B-Schools , 2007 .

[18]  Nicholas A. Bowman,et al.  Anchoring effects in world university rankings: exploring biases in reputation scores , 2011 .

[19]  Yudhijit Bhattacharjee,et al.  Citation impact. Saudi universities offer cash in exchange for academic prestige. , 2011, Science.

[20]  Alexander Toet,et al.  Effects of mediated social touch on affective experiences and trust , 2015, PeerJ.

[21]  Salih Murat Akkın,et al.  Kitap Değerlendirmesi: Global University Rankings and Their Impact / A. Rauhvargers, 2011 , 2011 .

[22]  Vicente Safón,et al.  Measuring the Reputation of Top US Business Schools: A MIMIC Modeling Approach , 2009 .

[23]  Ilia D. Dichev.  News or Noise? , 2001 .

[24]  Ilia D. Dichev.  How Good Are Business School Rankings , 1999 .

[25]  Arthur A. Raney,et al.  A cognitive approach to understanding university image , 2003 .

[26]  K. Webber,et al.  Measuring the Research Performance of Postsecondary Institutions , 2011 .

[27]  Frederick P. Morgeson,et al.  Same as It Ever Was: Recognizing Stability in the BusinessWeek Rankings , 2008 .

[28]  T. Stengos,et al.  Sensitivity of university rankings: implications of stochastic dominance efficiency analysis , 2018, Education Economics.

[29]  H. George Frederickson,et al.  University Rankings: Evidence and a Conceptual Framework , 2016 .

[30]  Anthony F. J. van Raan,et al.  Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods , 2005, Scientometrics.

[31]  Emilio Delgado López-Cózar,et al.  Repercusión de los rankings universitarios en la prensa española , 2014 .

[32]  E. Hazelkorn.  Global Rankings and the Geopolitics of Higher Education : Understanding the influence and impact of rankings on higher education, policy and society , 2016 .

[33]  T. Judge,et al.  What Causes a Management Article to be Cited—Article, Author, or Journal? , 2007 .

[34]  M. Spence.  Job Market Signaling , 1973 .

[35]  Cassidy R. Sugimoto,et al.  Bias in peer review , 2013, J. Assoc. Inf. Sci. Technol..

[36]  Debra L. Shapiro,et al.  PEER REVIEW IN THE ORGANIZATIONAL AND MANAGEMENT SCIENCES: PREVALENCE AND EFFECTS OF REVIEWER HOSTILITY, BIAS, AND DISSENSUS , 2006 .

[37]  Xianwen Wang,et al.  The open access advantage considering citation, article usage and social media attention , 2015, Scientometrics.

[38]  Charles J. Fombrun,et al.  Reputation: Realizing Value from the Corporate Image , 1996 .

[39]  José Luis Ortega,et al.  Comparing university rankings , 2010, Scientometrics.

[40]  John T. E. Richardson,et al.  Counting What Is Measured or Measuring What Counts? League Tables and Their Impact On Higher Education Institutions in England , 2008 .

[41]  G. Harman,et al.  Strategic Mergers of Strong Institutions to Enhance Competitive Advantage , 2008 .

[42]  Jeffrey Evans Stake.  The Interplay between Law School Rankings, Reputations, and Resource Allocation: Ways Rankings Mislead , 2005 .

[43]  J. Scott Armstrong,et al.  The Ombudsman: Business School Prestige—Research versus Teaching , 1994 .

[44]  Mike Wright,et al.  *Reviewing Journal Rankings and Revisiting Peer Reviews: Editorial Perspectives , 2007 .

[45]  Nicholas A. Bowman,et al.  U.S. News & World Report College Rankings: Modeling Institutional Effects on Organizational Reputation , 2009, American Journal of Education.

[46]  Johannes Sorz,et al.  Inconsistent year-to-year fluctuations limit the conclusiveness of global higher education rankings for university management , 2015, PeerJ.

[47]  Martin Fieder,et al.  Too much noise in the Times Higher Education rankings , 2010, Scientometrics.

[48]  Michael Luca,et al.  Strategic Disclosure: The Case of Business School Rankings , 2015 .

[49]  Matthew E Falagas,et al.  How masked is the "masked peer review" of abstracts submitted to international medical conferences? , 2006, Mayo Clinic proceedings.

[50]  J. R. Cole,et al.  Scientific output and recognition: a study in the operation of the reward system in science. , 1967, American sociological review.

[51]  E. Lawson,et al.  Effect of institutional prestige on reviewers' recommendations and editorial decisions. , 1994, JAMA.

[52]  A. Saltelli,et al.  Rickety numbers: Volatility of university rankings and policy implications , 2011 .

[53]  Kimberly F. Kane.  MBAs: A recruiter's-eye view , 1993 .

[54]  K. Rondeau.  The Impact of World Ranking Systems on Graduate Schools of Business: Promoting the Manipulation of Image over the Management of Substance , 2017 .

[55]  Antoaneta P. Petkova,et al.  Being good or being known: An empirical examination of the dimensions, antecedents, and consequences of organizational reputation , 2005 .

[56]  Fernando Casani,et al.  Legitimating the world-class university concept through the discourse of elite universities’ presidents† , 2016 .

[57]  Linda Wedlin,et al.  The Role of Rankings in Codifying a Business School Template: Classifications, Diffusion and Mediated Isomorphism in Organizational Fields , 2007 .

[58]  Khalid Mahmood,et al.  Correlation among top 100 universities in the major six global rankings: policy implications , 2016, Scientometrics.

[59]  S. Ceci,et al.  Peer-review practices of psychological journals: The fate of published articles, submitted again , 1982, Behavioral and Brain Sciences.

[60]  R. Majdzadeh,et al.  Impact of Merger and Acquisition on University Performance. , 2017, Archives of Iranian medicine.

[61]  R. Kuncl,et al.  Modeling Change and Variation in U.S. News & WorldReport College Rankings: What would it really take to be in the Top 20? , 2014 .

[62]  Kevin Lane Keller.  Strategic Brand Management , 2007 .

[63]  Cengiz Acartürk,et al.  A comparative analysis of global and national university ranking systems , 2015, Scientometrics.

[64]  H. Moed,et al.  The use of bibliometric data for the measurement of university research performance , 1985 .

[65]  Barbara McGillivray,et al.  Uptake and outcome of manuscripts in Nature journals by review model and author characteristics , 2018, Research Integrity and Peer Review.

[66]  Sergey Popov,et al.  Alma mat(t)er(s): Determinants of early career success in economics , 2014, PloS one.

[67]  Paul A. Argenti,et al.  Branding B-Schools: Reputation Management for MBA Programs , 2000 .

[68]  B. Keith,et al.  Organizational Contexts and University Performance Outcomes: The Limited Role of Purposive Action in the Management of Institutional Status , 2001 .

[69]  J. Fredericks Volkwein,et al.  Prestige Among Graduate and Professional Schools: Comparing the U.S. News’ Graduate School Reputation Ratings Between Disciplines , 2009 .

[70]  R. Merton.  The Matthew Effect in Science , 1968, Science.

[71]  Gökçen Arkalı Olcay,et al.  Technological Forecasting & Social Change Is measuring the knowledge creation of universities possible ? : A review of university rankings , 2016 .

[72]  Rachelle L. Brooks.  Measuring University Quality , 2005 .