Introducing sub-impact factor (SIF-) sequences and an aggregated SIF-indicator for journal ranking

The main methods for ranking academic journals are peer review based approaches and applications of various bibliometric indicators, or a mixture of the two. Such rankings are used to assess the overall quality of journals, although their real meaning remains unclear as long as the notion of “quality’ is not precisely defined. In our approach we examine journal evaluation from the perspective of knowledge accumulation taking the citation distribution into account. A new indicator, the sub-impact factor denoted as SIF, derived sub-impact factor sequences and an aggregated SIF-indicator are proposed. An empirical study is performed on 64 journals in the area of operations research and management science, illustrating the use of these indicators.

[1]  L. Egghe.  An improvement of the h-index: the g-index , 2006 .

[2]  S. Liebowitz,et al.  Assessing the Relative Impacts of Economic Journals , 1984 .

[3]  P. R. Chandy,et al.  Awareness and Evaluation of Selected Marketing Journals Inside and outside the Discipline: An Empirical Study , 1990 .

[4]  N. Bontis,et al.  A citation-based ranking of the business ethics scholarly journals , 2009 .

[5]  Andrew C. Inkpen,et al.  An Analysis of Significant Contributions to the International Business Literature , 1991 .

[6]  Michael J. Stahl,et al.  Publication In Leading Management Journals as a Measure of Institutional Research Productivity , 1988 .

[7]  W. J. Moore,et al.  THE RELATIVE QUALITY OF ECONOMICS JOURNALS: A SUGGESTED RATING SYSTEM , 1972 .

[8]  Stephen J. Bensman.  The evaluation of research by scientometric indicators , 2011, J. Assoc. Inf. Sci. Technol..

[9]  Thierry Lafouge,et al.  Comparative analysis between impact factor and h-index for pharmacology and psychiatry journals , 2010, Scientometrics.

[10]  Ronald Rousseau,et al.  A General Approach to Citation Analysis and an h-Index Based on the Standard Impact Factor Framework , 2009 .

[11]  Craig R. Carter.  ASSESSING LOGISTICS AND TRANSPORTATION JOURNALS : ALTERNATIVE PERSPECTIVES , 2002 .

[12]  James Testa.  The Thomson Reuters Journal Selection Process , 2009 .

[13]  Peter Vinkler,et al.  The Evaluation of Research by Scientometric Indicators , 2010 .

[14]  Ronald Rousseau,et al.  Basic Independence Axioms for the Publication-citation System , 2012, J. Sci. Res..

[15]  A. Serenko,et al.  Investigating Information Systems Research in Canada , 2012 .

[16]  Qiuping Li,et al.  Knowledge communication and translation. , 2009 .

[17]  Qiuping Li,et al.  Knowledge communication and translation - a knowledge transfer model , 2009, J. Knowl. Manag..

[18]  Eugene Garfield,et al.  New factors in the evaluation of scientific literature through citation indexing , 1963 .

[19]  Jack W. Skeels,et al.  THE RELATIVE QUALITY OF ECONOMICS JOURNALS: AN ALTERNATIVE RATING SYSTEM , 1972 .

[20]  Loet Leydesdorff,et al.  Integrated Impact Indicators (I3) compared with Impact Factors (IFs): An alternative research design with policy implications , 2011, J. Assoc. Inf. Sci. Technol..

[21]  L. Brown,et al.  Ranking Journals Using Social Science Research Network Downloads , 2002 .

[22]  W. Bean.  Personal Knowledge: Towards a Post-Critical Philosophy , 1961 .

[23]  J. Christenson.  ACCREDITING KNOWLEDGE: JOURNAL STATURE AND CITAtiON IMPACT IN SOCIAL SCIENCE1 , 1985 .

[24]  Tobias Opthof,et al.  Submission, acceptance rate, rapid review system and impact factor: editorial , 1999 .

[25]  Jonathan E. Smith,et al.  The Behavioral Sciences and Management: An Evaluation of Relevant Journals , 1990 .

[26]  Jenice Prather-Kinsey,et al.  An Analysis of International Accounting Research in U.S. Academic Accounting Journals, 1980 Through 1993 , 1998 .

[27]  Ronald Rousseau,et al.  Journal Evaluation: Technical and Practical Issues, , 2002, Libr. Trends.

[28]  John Mingers,et al.  Using the h-index to measure the quality of journals in the field of business and management , 2012, Inf. Process. Manag..

[29]  Stefanie Haustein,et al.  Multidimensional journal evaluation , 2010 .

[30]  Carl R. Chen,et al.  Author Affiliation Index, Finance Journal Ranking, and the Pattern of Authorship , 2007 .

[31]  Alan N. Attaway,et al.  Reassessing accounting faculty scholarly expectations: Journal classification by author affiliation , 2008 .

[32]  Carl T. Bergstrom.  Eigenfactor Measuring the value and prestige of scholarly journals , 2007 .

[33]  Sandra Rousseau,et al.  Journal evaluation by environmental and resource economists: A survey , 2007, Scientometrics.

[34]  Clyde W. Holsapple,et al.  A publication power approach for identifying premier information systems journals , 2008, J. Assoc. Inf. Sci. Technol..

[35]  Nick Bontis,et al.  Global ranking of knowledge management and intellectual capital academic journals: 2013 update , 2013, J. Knowl. Manag..

[36]  Yi Zhao,et al.  Bringing PageRank to the citation analysis , 2008, Inf. Process. Manag..

[37]  G H Whitehouse,et al.  Citation rates and impact factors: should they matter? , 2001, The British journal of radiology.

[38]  J. D. Tardós,et al.  Publish or Perish , 1987 .

[39]  Michael Rowlinson,et al.  Journal Rankings in Business and Management and the 2001 Research Assessment Exercise in the UK , 2004 .

[40]  A. Tahai,et al.  A revealed preference study of management journals' direct influences , 1999 .

[41]  PetroviciDan,et al.  Using the h-index to measure the quality of journals in the field of business and management , 2012 .

[42]  Rajiv Kohli,et al.  A multiple criteria assessment of decision technology system journal quality , 2001, Inf. Manag..

[43]  Wolfgang Glänzel,et al.  The application of characteristic scores and scales to the evaluation and ranking of scientific journals , 2011, J. Inf. Sci..

[44]  Gerald F. Smith,et al.  Assessing the Influence of Auditing: A Journal of Practice & Theory: 1985–2000 , 2002 .

[45]  Richard F. Poist,et al.  Desired attributes of an inland port: Shipper vs. carrier perspectives , 2003 .

[46]  Nick Bontis,et al.  A follow-up ranking of academic journals , 2009, J. Knowl. Manag..

[47]  Ronald Rousseau,et al.  Article impact calculated over arbitrary periods , 2005, J. Assoc. Inf. Sci. Technol..

[48]  Ronald Rousseau,et al.  Citation distribution of pure mathematics journals , 1988 .

[49]  John R. Doyle,et al.  Judging the quality of research in business schools: The UK as a case study , 1995 .

[50]  Henk F. Moed,et al.  Journal impact measures in bibliometric research , 2004, Scientometrics.

[51]  魏屹东,et al.  Scientometrics , 2018, Encyclopedia of Big Data.

[52]  M. Bohanec,et al.  The Analytic Hierarchy Process , 2004 .

[53]  Gabriel Pinski,et al.  Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics , 1976, Inf. Process. Manag..

[54]  Amber E. Budden,et al.  Bang for Your Buck: Rejection Rates and Impact Factors in Ecological Journals , 2008 .

[55]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[56]  Ronald Rousseau,et al.  Evaluating Environmental and Resource Economics Journals: A TOP-Curve Approach , 2009, Review of Environmental Economics and Policy.

[57]  Jerome K. Vanclay,et al.  Impact factor: outdated artefact or stepping-stone to journal certification? , 2011, Scientometrics.

[58]  P. M. Podsakoff,et al.  Journal Influence in the Field of Management: An Analysis Using Salancik's Index in a Dependency Network , 1994 .

[59]  Wolfgang Glänzel,et al.  A Hirsch-type index for journals , 2006, Scientometrics.

[60]  Xi Chen,et al.  Combination of EigenfactorTM and h-index to evaluate scientific journals , 2009, Scientometrics.

[61]  Tobias Opthof,et al.  Reducing the backlog and improving the impact , 1999 .

[62]  Shyama Balakrishnan,et al.  Principles of information retrieval , 2000 .

[63]  J. R. Cole,et al.  Chance and consensus in peer review. , 1981, Science.

[64]  E. Garfield.  Citation analysis as a tool in journal evaluation. , 1972, Science.

[65]  Gangan Prathap.  The iCE approach for journal evaluation , 2010, Scientometrics.