Starry-eyed II: the logistics journal ranking debate revisited

Purpose In a previous paper (McKinnon, 2013), I questioned the principle and practice of journal ranking and discussed its effects on logistics research. Since then several important developments have occurred that have prompted this updated review of the issues. Design/methodology/approach New literature on the journal ranking debate has been reviewed. The validity of the journal ranking as a proxy measure of paper quality is explored using data from the UK Research Excellence Framework (REF) assessment. Changes to the ranking of ten logistics / supply chain management (SCM) journals in four listings are analysed and possible reasons for the relatively low status of the journals are examined. Findings The influence of journal rankings on the academic research process is strengthening while the debate about their legitimacy intensifies. UK REF data casts doubt on the reliability of the journal ranking as an indicator of a paper’s merit. Logistics/SCM journals continue to occupy mid-to-lower tier positions...

[1]  Hugh Willmott,et al.  Journal list fetishism and the perversion of scholarship: reactivity and the ABS list , 2011 .

[2]  E. Garfield.  The history and meaning of the journal impact factor. , 2006, JAMA.

[3]  Alexander E. Ellinger,et al.  Benchmarking leading supply chain management and logistics strategy journals , 2011 .

[4]  Thomas J. Goldsby,et al.  On the measurement and benchmarking of research impact among active logistics scholars , 2013 .

[5]  S. Nkomo,et al.  The Seductive Power of Academic Journal Rankings: Challenges of Searching for the Otherwise , 2009 .

[6]  D. Mollenkopf.  What does it take to get published these days , 2014 .

[7]  Jim Taylor,et al.  The Assessment of Research Quality in UK Universities: Peer Review or Metrics? , 2011 .

[8]  M. Enz,et al.  We Must Find the Courage to Change , 2015 .

[9]  Quentin L. Burrell,et al.  Modeling citation behavior in Management Science journals , 2006, Inf. Process. Manag..

[10]  Rüdiger Mutz,et al.  Skewed citation distributions and bias factors: Solutions to two core problems with the journal impact factor , 2012, J. Informetrics.

[11]  Alexander E. Ellinger,et al.  IJPDLM’s 45th anniversary: a retrospective bibliometric analysis and future directions , 2016 .

[12]  Thomas J. Goldsby,et al.  Logistics Professional Identity: Strengthening the Discipline as Galaxies Collide , 2014 .

[13]  Michael Craig Lutz Zachary Maloni,et al.  Publication Productivity in the Supply Chain Management Discipline: 2011–13 , 2015 .

[14]  Dennis Tourish,et al.  Leading questions: Journal rankings, academic freedom and performativity: What is, or should be, the future of Leadership? , 2011 .

[15]  Joe B. Hanna,et al.  An analysis of the value of supply chain management periodicals , 2009 .

[16]  B. Jay Coleman,et al.  Benchmarking Individual Publication Productivity in Logistics , 2012 .

[17]  Markus J. Milne,et al.  The Construction of Journal Quality: No Engagement Detected , 2002 .

[18]  Alan C. McKinnon,et al.  Starry‐eyed: journal rankings and the future of logistics research , 2013 .

[19]  Loet Leydesdorff,et al.  A review of theory and practice in scientometrics , 2015, Eur. J. Oper. Res..

[20]  Peter Erskine Wells.  The ABS rankings of journal quality: an exercise in delusion , 2010 .

[21]  J. Woxenius.  The consequences of the extended gap between curiosity-driven and impact-driven research , 2015 .

[22]  E. Todeva,et al.  Accounting for Research Quality: Research Audits and the Journal Rankings Debate , 2015 .

[23]  Thed N. van Leeuwen,et al.  Characteristics of journal impact factors: The effects of uncitedness and citation distribution on the understanding of journal impact factors , 2005, Scientometrics.

[24]  Dennis Tourish,et al.  In defiance of folly: Journal rankings, mindless measures and the ABS guide , 2015 .

[25]  Vikas Kumar,et al.  A pilot study on normalized weighted approach to citation study: A case of logistics and transportation journals , 2004 .

[26]  Daniela Lorenz,et al.  Robustness of personal rankings: the Handelsblatt example , 2015 .

[27]  Derek Sayer,et al.  Rank Hypocrisies: The Insult of the REF , 2014 .

[28]  Simon Hussain,et al.  Journal list fetishism and the ‘sign of 4’ in the ABS guide: A question of trust? , 2015 .

[29]  Alexander E. Ellinger,et al.  CONSTRUCTING IMPACT FACTORS TO MEASURE THE INFLUENCE OF SUPPLY CHAIN MANAGEMENT AND LOGISTICS JOURNALS , 2009 .