Sequence analysis of annually normalized citation counts: an empirical analysis based on the characteristic scores and scales (CSS) method

In bibliometrics, only a few publications have focused on the citation histories of publications, where the citations for each citing year are assessed. In this study, therefore, annual categories of field- and time-normalized citation scores (based on the characteristic scores and scales method: 0 = poorly cited, 1 = fairly cited, 2 = remarkably cited, and 3 = outstandingly cited) are used to study the citation histories of papers. As our dataset, we used all articles published in 2000 and their annual citation scores until 2015. We generated annual sequences of citation scores (e.g., $$\left\{ {01233233221} \right\}$$01233233221) and compared the sequences of annual citation scores of six broader fields (natural sciences, engineering and technology, medical and health sciences, agricultural sciences, social sciences, and humanities). In agreement with previous studies, our results demonstrate that sequences with poorly cited (0) and fairly cited (1) elements dominate the publication set; sequences with remarkably cited (3) and outstandingly cited (4) periods are rare. The highest percentages of constantly poorly cited papers can be found in the social sciences; the lowest percentages are in the agricultural sciences and humanities. The largest group of papers with remarkably cited (3) and/or outstandingly cited (4) periods shows an increasing impact over the citing years with the following orders of sequences: $$\left\{ {0123} \right\}$$0123 (6.01%), which is followed by $$\left\{ {123} \right\}$$123 (1.62%). Only 0.11% of the papers (n = 909) are constantly on the outstandingly cited level.

[1]  Wolfgang Glänzel,et al.  Characteristic scores and scales in assessing citation impact , 1988, J. Inf. Sci..

[2]  Dragomir R. Radev,et al.  NLP-driven citation analysis for scientometrics , 2016, Natural Language Engineering.

[3]  Loet Leydesdorff,et al.  A review of theory and practice in scientometrics , 2015, Eur. J. Oper. Res..

[4]  Wolfgang Glänzel,et al.  Characteristic scores and scales: A bibliometric analysis of subject characteristics based on long-term citation observation , 2007, J. Informetrics.

[5]  Alonso Rodríguez-Navarro,et al.  Research assessment based on infrequent achievements: A comparison of the United States and Europe in terms of highly cited papers and Nobel Prizes , 2016, J. Assoc. Inf. Sci. Technol..

[6]  Pedro Albarrán,et al.  References made and citations received by scientific articles , 2011, J. Assoc. Inf. Sci. Technol..

[7]  Peter Vinkler,et al.  The size and impact of the elite set of publications in scientometric assessments , 2016, Scientometrics.

[8]  J. Vlachý,et al.  Citation histories of scientific publications. The data sources , 1985, Scientometrics.

[9]  Ulrich Kohler,et al.  Sequence Analysis with Stata , 2006 .

[10]  Wolfgang Glänzel,et al.  On the possibility and reliability of predictions based on stochastic citation processes , 2006, Scientometrics.

[11]  Ludo Waltman,et al.  A review of the literature on citation impact indicators , 2015, J. Informetrics.

[12]  Massimo Franceschet,et al.  Clustering citation histories in the Physical Review , 2016, J. Informetrics.

[13]  Loet Leydesdorff,et al.  Group‐based trajectory modeling (GBTM) of citations in scholarly literature: Dynamic qualities of “transient” and “sticky knowledge claims” , 2013, J. Assoc. Inf. Sci. Technol..

[14]  Lutz Bornmann,et al.  The wisdom of citing scientists , 2013, J. Assoc. Inf. Sci. Technol..

[15]  Michael Parkinson,et al.  The Evaluation of Research by Scientometric Indicators , 2011 .

[16]  Wolfgang Glänzel,et al.  The role of the h-index and the characteristic scores and scales in testing the tail properties of scientometric distributions , 2010, Scientometrics.

[17]  Henry G. Small,et al.  Discovering discoveries: Identifying biomedical discoveries using citation contexts , 2017, J. Informetrics.

[18]  Lutz Bornmann,et al.  Citation speed as a measure to predict the attention an article receives: An investigation of the validity of editorial decisions at Angewandte Chemie International Edition , 2010, J. Informetrics.

[19]  Wolfgang Glänzel,et al.  Mean response time — A new indicator of journal citation speed with application to physics journals , 1986 .

[20]  Christopher Carroll,et al.  Measuring academic research impact: creating a citation profile using the conceptual framework for implementation fidelity as a case study , 2016, Scientometrics.

[21]  E GARFIELD,et al.  Citation indexes for science; a new dimension in documentation through association of ideas. , 2006, Science.

[22]  Pedro Cosme Vieira,et al.  Sleeping Beauties and their princes in innovation studies , 2017, Scientometrics.

[23]  Wolfgang Glänzel,et al.  The application of characteristic scores and scales to the evaluation and ranking of scientific journals , 2011, J. Inf. Sci..

[24]  Chaomei Chen,et al.  The Recurrence of Citations within a Scientific Article , 2015, ISSI.

[25]  Stephen J. Bensman The evaluation of research by scientometric indicators , 2011, J. Assoc. Inf. Sci. Technol..

[26]  E. Garfield Citation indexes for science. A new dimension in documentation through association of ideas. 1955. , 1955, International journal of epidemiology.

[27]  Wolfgang Glänzel,et al.  Do usage and scientific collaboration associate with citation impact , 2016 .

[28]  Filippo Radicchi,et al.  Quantitative evaluation of alternative field normalization procedures , 2013, J. Informetrics.

[29]  Marcel Ausloos,et al.  Benford's law: A “sleeping beauty” sleeping in the dirty pages of logarithmic tables , 2017, J. Assoc. Inf. Sci. Technol..

[30]  Wolfgang Glänzel,et al.  Applying the CSS method to bibliometric indicators used in (university) rankings , 2016, Scientometrics.

[31]  Wolfgang Glänzel,et al.  Predictive Aspects of a Stochastic Model for Citation Processes , 1995, Inf. Process. Manag..

[32]  Ying Ding,et al.  Measuring delayed recognition for papers: Uneven weighted summation and total citations , 2016, J. Informetrics.

[33]  Wolfgang Glänzel,et al.  Towards a model for diachronous and synchronous citation analyses , 2004, Scientometrics.