Evaluating OR/MS Journals via PageRank

Scholars, practitioners, and students in operations research and management science (OR/MS) often hesitate to use traditional approaches to evaluate journal quality because of the inconsistency of these approaches to perceptions and other associated biases. We introduce an alternative approach, which is based on Google's PageRank, to evaluate 31 OR/MS journals. This approach enhances the impact factor method by considering both citation quantity and quality. When we apply our method to OR/MS journals, the results match survey opinions and significantly outperform rankings based on impact factors. In addition, we provide an extensive discussion of other methods that have been used to assess journal quality. Compared to these methods, our method is better able to discern quality differences for journals that are perceived to be of relatively higher quality. Most importantly, we integrate our method into a Web-based journal-ranking system.

[1]  Josephine E. Olson,et al.  Top-25-Business-School Professors Rate Journals in Operations Management and Related Fields , 2005, Interfaces.

[2]  Manoj K. Malhotra,et al.  Institutional research productivity in production and operations management , 1996 .

[3]  Robert J. Vokurka,et al.  The relative importance of journals used in operations management research A citation analysis , 1996 .

[4]  R. Pieters,et al.  Who talks to whom? Intra-and interdisciplinary communication of economics journals , 2002 .

[5]  Vijay K. Agrawal CONSTITUENCIES OF JOURNALS IN PRODUCTION AND OPERATIONS MANAGEMENT: IMPLICATIONS ON REACH AND QUALITY* , 2009 .

[6]  Michael F. Gorman,et al.  Note - "OM Forum: Evaluating Operations Management - Related Journals via the Author Affiliation Index" - Do Professors at Top U.S. Business Schools Do What They Say? , 2007, Manuf. Serv. Oper. Manag..

[7]  Clyde W. Holsapple,et al.  An empirical assessment of influences on POM research , 1996 .

[8]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[9]  Oscar Volij,et al.  The Measurement of Intellectual Influence , 2002 .

[10]  C. Holsapple,et al.  Evaluating and classifying POM journals , 1997 .

[11]  A. Soteriou,et al.  Assessing production and operations management related journals: the European perspective , 1999 .

[12]  F. DuBois,et al.  Ranking the International Business Journals , 2000 .

[13]  Loet Leydesdorff,et al.  Caveats for the Use of Citation Indicators in Research and Journal Evaluations , 2008, J. Assoc. Inf. Sci. Technol..

[14]  Gabriel Pinski,et al.  Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics , 1976, Inf. Process. Manag..

[15]  Michael F. Gorman,et al.  Evaluating Operations Management-Related Journals via the Author Affiliation Index , 2005, Manuf. Serv. Oper. Manag..

[16]  L. Lee Colquitt,et al.  Relative Significance of Insurance and Actuarial Journals and Articles: A Citation Analysis , 1997 .

[17]  S. Barman,et al.  Discipline note Perceived relevance and quality of POM journals: a decade later , 2001 .