Extending citer analysis to journal impact evaluation

The concept of citer analysis investigated earlier by Ajiferuke and Wolfram (In: B. Larsen, J. Leta (eds.) Proceedings of the 12th international conference of the international society for scientometrics and informetrics (ISSI) pp. 798–808, 2009, Scientometrics 83:623–638, 2010) is extended to journals where different citing units (citers, citing articles, citing journals) are compared with the journal impact factor and each other to determine if differences in ranking arise from different measures. The citer measures for the 31 high impact journals studied from information science and library science are significantly correlated, even more so than the earlier citer analysis findings, indicating that there is a close relationship among the different units of measure. Still, notable differences in rankings for the journals examined were evident for the different measures used, especially from either 5-year impact factor or number of citing articles per publication to the number of citing journals per publication. The journals that are adversely affected seem to be those whose citations are concentrated in a few journals. This informed the need to develop a journal citation concentration index, which can serve as a complementary measure to the existing journal impact indices.

[1]  D. Dieks,et al.  Differences in Impact of Scientific Publications: Some Indices Derived from a Citation Analysis , 1976 .

[2]  Michel Zitt,et al.  Internationalization of scientific journals: A measurement based on publication and citation scope , 2006, Scientometrics.

[3]  Henk F. Moed,et al.  Citation-based metrics are appropriate tools in journal assessment provided that they are accurate and used in an informed way , 2012, Scientometrics.

[4]  Eugene Garfield,et al.  New factors in the evaluation of scientific literature through citation indexing , 1963 .

[5]  Dietmar Wolfram,et al.  A comparison of citer and citation-based measure outcomes for multiple disciplines , 2010, J. Assoc. Inf. Sci. Technol..

[6]  Ronald Rousseau,et al.  Journal Evaluation: Technical and Practical Issues, , 2002, Libr. Trends.

[7]  Vincent Larivière,et al.  History of the journal impact factor: Contingencies and consequences , 2009, Scientometrics.

[8]  Neil R. Smalheiser,et al.  Author name disambiguation , 2009, Annu. Rev. Inf. Sci. Technol..

[9]  D. Pendlebury.  The use and misuse of journal metrics and other citation indicators , 2009, Archivum Immunologiae et Therapiae Experimentalis.

[10]  Johan Bollen,et al.  Toward alternative metrics of journal impact: A comparison of download and citation data , 2005, Inf. Process. Manag..

[11]  Jerome K. Vanclay,et al.  Impact factor: outdated artefact or stepping-stone to journal certification? , 2011, Scientometrics.

[12]  Dietmar Wolfram,et al.  Citer analysis as a measure of research impact: library and information science as a case study , 2010, Scientometrics.

[13]  John P. A. Ioannidis,et al.  Concentration of the Most-Cited Papers in the Scientific Literature: Analysis of Journal Ecosystems , 2006, PloS one.

[14]  Michael H. MacRoberts,et al.  Problems of citation analysis: A critical review , 1989, JASIS.

[15]  Henk F. Moed,et al.  Journal impact measures in bibliometric research , 2004, Scientometrics.

[16]  Carl T. Bergstrom,et al.  Differences in impact factor across fields and over time , 2009 .

[17]  Fiorenzo Franceschini,et al.  Analysis of the ch-index: an indicator to evaluate the diffusion of scientific research output by citers , 2010, Scientometrics.

[18]  Chuan Yi Tang,et al.  A 2.|E|-Bit Distributed Algorithm for the Directed Euler Trail Problem , 1993, Inf. Process. Lett..

[19]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[20]  Andreas Strotmann,et al.  Author name disambiguation for collaboration network analysis and visualization , 2009, ASIST.

[21]  Ronald Rousseau.  Updating the journal impact factor or total overhaul? , 2012, Scientometrics.

[22]  Vicente P. Guerrero-Bote,et al.  A new approach to the metric of journals' scientific prestige: The SJR indicator , 2010, J. Informetrics.

[23]  Leo Egghe.  A rationale for the relation between the citer h-index and the classical h-index of a researcher , 2012, Scientometrics.

[24]  Kun Lu,et al.  Who are the research disciples of an author? Examining publication recitation and oeuvre citation exhaustivity , 2011, J. Informetrics.

[25]  Carl T. Bergstrom,et al.  The Eigenfactor™ Metrics , 2008, The Journal of Neuroscience.

[26]  Allan D. Pratt,et al.  A measure of class concentration in bibliometrics , 1977, J. Am. Soc. Inf. Sci..