How are new citation-based journal indicators adding to the bibliometric toolbox?

The launching of Scopus and Google Scholar, and methodological developments in social-network analysis have made many more indicators for evaluating journals available than the traditional impact factor, cited half-life, and immediacy index of the ISI. In this study, these new indicators are compared with one another and with the older ones. Do the various indicators measure new dimensions of the citation networks, or are they highly correlated among themselves? Are they robust and relatively stable over time? Two main dimensions are distinguished—size and impact—which together shape influence. The h-index combines the two dimensions and can also be considered as an indicator of reach (like Indegree). PageRank is mainly an indicator of size, but has important interactions with centrality measures. The Scimago Journal Ranking (SJR) indicator provides an alternative to the journal impact factor, but the computation is less easy. © 2009 Wiley Periodicals, Inc.

[1]  Jorge E. Hirsch,et al.  An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship , 2009, Scientometrics.

[2]  Stephen J. Bensman,et al.  Definition and identification of journals as bibliographic and subject entities: Librarianship versus ISI Journal Citation Reports methods and their effect on citation measures , 2009, J. Assoc. Inf. Sci. Technol..

[3]  W. S. Robinson,et al.  Ecological correlations and the behavior of individuals. , 1950, International journal of epidemiology.

[4]  LeydesdorffLoet,et al.  Main-path analysis and path-dependent transitions in HistCite-based historiograms , 2008 .

[5]  Diana Lucio-Arias,et al.  Main-path analysis and path-dependent transitions in HistCiteTM-based historiograms , 2008, J. Assoc. Inf. Sci. Technol..

[6]  Michel Zitt,et al.  Modifying the journal impact factor by fractional citation weighting: The audience factor , 2008, J. Assoc. Inf. Sci. Technol..

[7]  Loet Leydesdorff,et al.  Dynamic animations of journal maps: Indicators of structural changes and interdisciplinary developments , 2009, J. Assoc. Inf. Sci. Technol..

[8]  Ricardo Arencibia-Jorge,et al.  Comparison of SCImago journal rank indicator with journal impact factor , 2008, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[9]  R. Rousseau,et al.  Reflections on recent developments of the h-index and h-type indices , 2008 .

[10]  L. Egghe,et al.  Study of different h-indices for groups of authors , 2008, J. Assoc. Inf. Sci. Technol..

[11]  Johan Bollen,et al.  Towards usage-based impact metrics: first results from the mesur project. , 2008, JCDL '08.

[12]  Tove Faber Frandsen,et al.  The Reference Return Ratio , 2008, J. Informetrics.

[13]  Yi Zhao,et al.  Bringing PageRank to the citation analysis , 2008, Inf. Process. Manag..

[14]  Loet Leydesdorff,et al.  Caveats for the Use of Citation Indicators in Research and Journal Evaluations , 2008, J. Assoc. Inf. Sci. Technol..

[15]  Loet Leydesdorff,et al.  Visualization of the citation impact environments of scientific journals: An online mapping exercise , 2009, J. Assoc. Inf. Sci. Technol..

[16]  Stephen J. Bensman.  Garfield and the impact factor , 2007, Annu. Rev. Inf. Sci. Technol..

[17]  Lokman I. Meho,et al.  Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar , 2007, J. Assoc. Inf. Sci. Technol..

[18]  Loet Leydesdorff,et al.  Betweenness centrality as an indicator of the interdisciplinarity of scientific journals , 2007, J. Assoc. Inf. Sci. Technol..

[19]  Carl T. Bergstrom.  Eigenfactor Measuring the value and prestige of scholarly journals , 2007 .

[20]  R. Rousseau,et al.  The R- and AR-indices: Complementing the h-index , 2007 .

[21]  Lokman I. Meho,et al.  A New Era in Citation and Bibliometric Analyses: Web of Science, Scopus, and Google Scholar , 2006, ArXiv.

[22]  Johan Bollen,et al.  Mapping the structure of science through usage , 2006, Scientometrics.

[23]  W. Glänzel,et al.  A Hirsch-type index for journals , 2006, Scientometrics.

[24]  James Testa,et al.  The Thomson Scientific journal selection process. , 2006, International microbiology : the official journal of the Spanish Society for Microbiology.

[25]  Loet Leydesdorff,et al.  Betweenness Centrality" as an Indicator of the , 2006 .

[26]  Marjori Matzke,et al.  F1000Prime recommendation of An index to quantify an individual's scientific research output. , 2005 .

[27]  Ronald Rousseau,et al.  Median and percentile impact factors: A set of new indicators , 2005, Scientometrics.

[28]  Michael J. Moravcsik,et al.  Applied scientometrics: An assessment methodology for developing countries , 1985, Scientometrics.

[29]  Ronald Rousseau,et al.  Article impact calculated over arbitrary periods , 2005, J. Assoc. Inf. Sci. Technol..

[30]  Jacques Gaillard,et al.  Use of publication lists to study scientific production and strategies of scientists in developing countries , 2005, Scientometrics.

[31]  Narongrit Sombatsompop,et al.  A modified method for calculating the Impact Factors of journals in ISI Journal Citation Reports: Polymer Science Category in 1997–2001 , 2004, Scientometrics.

[32]  Ronald Rousseau,et al.  The immediacy index and the journal impact factor: two highly correlated derived measures , 2004 .

[33]  Kostas Tsioutsiouliklis,et al.  \Googlearchy": How a Few Heavily-Linked Sites Dominate Politics on the Web , 2003 .

[34]  Alexander I. Pudovkin,et al.  Algorithmic procedure for finding semantically related journals , 2002, J. Assoc. Inf. Sci. Technol..

[35]  R. Hanneman.  Introduction to Social Network Methods , 2001 .

[36]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[37]  Stephen J. Bensman,et al.  Scientific and Technical Serials Holdings Optimization in an Inefficient Market: A LSU Serials Redesign Project Exercise , 1998 .

[38]  E Garfield,et al.  Long-term vs. short-term journal impact: does it matter? , 1998, The Physiologist.

[39]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[40]  J. Testa.  A base de dados ISI e seu processo de seleção de revistas , 1998 .

[41]  S. P. Harter,et al.  ISI's Impact Factor as Misnomer: A Proposed New Measure to Assess Journal Impact , 1997, J. Am. Soc. Inf. Sci..

[42]  Stephen J. Bensman.  The Structure of the Library Market for Scientific Journals: The Case of Chemistry , 1996 .

[43]  Plergiorgio Strata,et al.  Citation analysis , 1995, Nature.

[44]  E. Garfield.  How ISI selects journals for coverage: Quantitative and qualitative considerations , 1990 .

[45]  E. Leeuw,et al.  The See-Saw Effect: a multilevel problem? , 1988 .

[46]  S. Bradford.  "Sources of information on specific subjects" by S.C. Bradford , 1985 .

[47]  L. Freeman.  Centrality in social networks conceptual clarification , 1978 .

[48]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[49]  Gabriel Pinski,et al.  Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics , 1976, Inf. Process. Manag..

[50]  E. Garfield.  Citation analysis as a tool in journal evaluation. , 1972, Science.

[51]  I. Yamada,et al.  On the Modified θ Method , 1970 .

[52]  John Martyn,et al.  An evaluation of British scientific journals , 1968 .

[53]  D J PRICE,et al.  NETWORKS OF SCIENTIFIC PAPERS. , 1965, Science.

[54]  Eugene Garfield,et al.  New factors in the evaluation of scientific literature through citation indexing , 1963 .

[55]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .