Ranking Leading Econometrics Journals Using Citations Data from ISI and RePEc

The paper focuses on the robustness of rankings of academic journal quality and research impact of 10 leading econometrics journals taken from the Thomson Reuters ISI Web of Science (ISI) Category of Economics, using citations data from ISI and the highly accessible Research Papers in Economics (RePEc) database that is widely used in economics, finance and related disciplines. The journals are ranked using quantifiable static and dynamic Research Assessment Measures (RAMs), with 15 RAMs from ISI and 5 RAMs from RePEc. The similarities and differences in various RAMs, which are based on alternative weighted and unweighted transformations of citations, are highlighted to show which RAMs are able to provide informational value relative to others. The RAMs include the impact factor, mean citations and non-citations, journal policy, number of high quality papers, and journal influence and article influence. The paper highlight robust rankings based on the harmonic mean of the ranks of 20 RAMs, which in some cases are closely related. It is shown that emphasizing the most widely-used RAM, the 2-year impact factor of a journal, can lead to a distorted evaluation of journal quality, impact and influence relative to the harmonic mean of the ranks.

[1]  P. Seglen,et al.  Education and debate , 1999, The Ethics of Public Health.

[2]  Michael McAleer,et al.  How are journal impact, prestige and article influence related? An application to neuroscience , 2011 .

[3]  Michael McAleer,et al.  Coercive journal self citations, impact factor, Journal Influence and Article Influence , 2013, Math. Comput. Simul..

[4]  東京物理學校,et al.  理學 : The science , 1946 .

[5]  Michael G Crisp.  Eigenfactor , 2008 .

[6]  Christian Zimmermann,et al.  Academic Rankings with RePEc , 2012 .

[7]  Michael McAleer,et al.  Great Expectatrics: Great Papers, Great Journals, Great Econometrics , 2010 .

[8]  Michael McAleer,et al.  What makes a great journal great in the sciences? Which came first, the chicken or the egg? , 2010, Scientometrics.

[9]  Carl T. Bergstrom,et al.  The Eigenfactor™ Metrics , 2008, The Journal of Neuroscience.

[10]  Michael McAleer,et al.  Robust Ranking of Journal Quality: An Application to Economics , 2012 .

[11]  Carl T. Bergstrom,et al.  Assessing citations with the Eigenfactor™ Metrics , 2008, Neurology.

[12]  Michael McAleer,et al.  WHAT DO EXPERTS KNOW ABOUT FORECASTING JOURNAL QUALITY? A COMPARISON WITH ISI RESEARCH IMPACT IN FINANCE , 2012 .

[13]  L. Bauwens,et al.  Econometrics , 2005 .

[14]  Michael McAleer,et al.  What Makes a Great Journal Great in Economics? The Singer Not the Song , 2010 .

[15]  Jorge E. Hirsch,et al.  An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship , 2009, Scientometrics.

[16]  Carl T. Bergstrom.  Eigenfactor Measuring the value and prestige of scholarly journals , 2007 .

[17]  Michael McAleer,et al.  Ranking Journal Quality by Harmonic Mean of Ranks: An Application to ISI Statistics & Probability , 2012 .

[18]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.