A multidimensional approach to evaluating management journals: Refining pagerank via the differentiation of citation types and identifying the roles that management journals play

In this article, the authors introduce two citation‐based approaches to facilitate a multidimensional evaluation of 39 selected management journals. The first is a refined application of PageRank via the differentiation of citation types. The second is a form of mathematical manipulation to identify the roles that the selected management journals play. Their findings reveal that Academy of Management Journal, Academy of Management Review, and Administrative Science Quarterly are the top three management journals, respectively. They also discovered that these three journals play the role of a knowledge hub in the domain. Finally, when compared with Journal Citation Reports (Thomson Reuters, Philadelphia, PA), their results closely match expert opinions.

[1]  Mark D. Miller,et al.  Examining differences across journal rankings , 2005, CACM.

[2]  C. Harris.  Ranking the Management Journals , 2008 .

[3]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.

[4]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[5]  Henk F. Moed,et al.  Journal impact measures in bibliometric research , 2004, Scientometrics.

[6]  C. Spearman.  The proof and measurement of association between two things. , 2015, International journal of epidemiology.

[7]  P. Seglen,et al.  Education and debate , 1999, The Ethics of Public Health.

[8]  A. Tahai,et al.  A revealed preference study of management journals' direct influences , 1999 .

[9]  Ian C. MacMillan,et al.  Delineating a forum for business policy scholars , 1987 .

[10]  Ying Ding,et al.  Discovering author impact: A PageRank perspective , 2010, Inf. Process. Manag..

[11]  Kar-li Brenda Cheang,et al.  A proposed multidimensional information system framework for journal evaluations : a case study in the field of education and educational research , 2014 .

[12]  Sergei Maslov,et al.  Finding scientific gems with Google's PageRank algorithm , 2006, J. Informetrics.

[13]  The Impact Factor Game , 2006, PLoS medicine.

[14]  Daniel G. Bachrach,et al.  The influence of management journals in the 1980s and 1990s , 2005 .

[15]  M. Amin,et al.  Impact factors: use and abuse. , 2003, Medicina.

[16]  Ronald Rousseau,et al.  Journal Evaluation: Technical and Practical Issues, , 2002, Libr. Trends.

[17]  A. Sharplin,et al.  The Relative Importance of Journals Used in Management Research: An Alternative Ranking , 1985 .

[18]  Josephine E. Olson,et al.  Top-25-Business-School Professors Rate Journals in Operations Management and Related Fields , 2005, Interfaces.

[19]  Carl D. Meyer,et al.  Deeper Inside PageRank , 2004, Internet Math..

[20]  Johan Bollen,et al.  Journal status , 2006, Scientometrics.

[21]  Jonathan E. Smith,et al.  The Behavioral Sciences and Management: An Evaluation of Relevant Journals , 1990 .

[22]  Theodore Eliades,et al.  Impact Factor A Review with Specific Relevance to Orthodontic Journals , 2001, Journal of Orofacial Orthopedics / Fortschritte der Kieferorthopädie.

[23]  Henk F. Moed,et al.  Citation-based metrics are appropriate tools in journal assessment provided that they are accurate and used in an informed way , 2012, Scientometrics.

[24]  D. Pendlebury.  The use and misuse of journal metrics and other citation indicators , 2009, Archivum Immunologiae et Therapiae Experimentalis.

[25]  Andrew Lim,et al.  Evaluating OR/MS Journals via PageRank , 2011, Interfaces.

[26]  Gabriel Pinski,et al.  Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics , 1976, Inf. Process. Manag..

[27]  F. DuBois,et al.  Ranking the International Business Journals , 2000 .

[28]  Loet Leydesdorff,et al.  Caveats for the Use of Citation Indicators in Research and Journal Evaluations , 2008, J. Assoc. Inf. Sci. Technol..

[29]  Richard M. Smith,et al.  Commentary: the power of the unrelenting impact factor--is it a force for good or harm? , 2006, International journal of epidemiology.

[30]  Peter Weingart,et al.  Impact of bibliometrics upon the science system: Inadvertent consequences? , 2005, Scientometrics.

[31]  R. Coe,et al.  Evaluating the management journals: a second look. , 1984, Academy of Management journal. Academy of Management.

[32]  Yi Zhao,et al.  Bringing PageRank to the citation analysis , 2008, Inf. Process. Manag..

[33]  M. Lynne Markus,et al.  Beyond Rigor and Relevance: Producing Consumable Research about Information Systems , 1998 .

[34]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[35]  Declan Butler,et al.  Free journal-ranking tool enters citation market , 2008, Nature.

[36]  M. Kendall.  A NEW MEASURE OF RANK CORRELATION , 1938 .

[37]  Ying Ding,et al.  Applying weighted PageRank to author citation networks , 2011, J. Assoc. Inf. Sci. Technol..

[38]  Andrew Lim,et al.  Distinguishing citation quality for journal impact assessment , 2009, Commun. ACM.

[39]  Ying Ding,et al.  Topic-based PageRank on author cocitation networks , 2011, J. Assoc. Inf. Sci. Technol..

[40]  L. Brown,et al.  Ranking Journals Using Social Science Research Network Downloads , 2002 .

[41]  C. Chow,et al.  Are Articles in “Top” Management Journals Necessarily of Higher Quality? , 2007 .

[42]  James Caverlee,et al.  PageRank for ranking authors in co-citation networks , 2009, J. Assoc. Inf. Sci. Technol..

[43]  Amy N. Langville,et al.  Chapter 16. Methods of Comparison , 2012 .

[44]  P. M. Podsakoff,et al.  Journal Influence in the Field of Management: An Analysis Using Salancik's Index in a Dependency Network , 1994 .

[45]  R. Graham,et al.  Spearman's Footrule as a Measure of Disarray , 1977 .