Research on the Relevancy of Scientific Literature Based on the Citation-Mention Frequency

All papers cite references, but not all citations are equal. This is because references have different citation-mention frequencies. Some references are mentioned only once, while some are mentioned several times. Papers are cited by others when they are relevant to the citing paper. The fact that a reference has a high citation-mention frequency may mean that its content is more closely related to the citing paper. From this point of view, we examined the relevancy of a cited paper to a citing paper on the basis of citation-mention frequency. Two aspects of relevancy are considered: citation linkage and content. We construct a highly mentioned class of references and a rarely mentioned class of references. We introduce the concepts of “reference-similarity” and “content-similarity.” First, we count the number of co-cited references and calculate the reference-similarity. Second, we extract the abstracts of papers and calculate the content-similarity using the bag-of-words model. The results show that references from the highly mentioned class are more relevant to the citing papers than those from the rarely mentioned class.

[1]  Jennifer Widom,et al.  SimRank: a measure of structural-context similarity , 2002, KDD.

[2]  Ming Li,et al.  Counting citations in texts rather than reference lists to improve the accuracy of assessing scientific contribution , 2011, BioEssays : news and reviews in molecular, cellular and developmental biology.

[3]  Alexandru T. Balaban.  Positive and negative aspects of citation indices and journal impact factors , 2012, Scientometrics.

[4]  Ying Ding,et al.  The distribution of references across texts: Some implications for citation analysis , 2013, J. Informetrics.

[5]  Chaomei Chen,et al.  Where are citations located in the body of scientific articles? A study of the distributions of citation locations , 2013, J. Informetrics.

[6]  Ludo Waltman,et al.  A review of the literature on citation impact indicators , 2015, J. Informetrics.

[7]  Vwani P. Roychowdhury,et al.  Read Before You Cite! , 2003, Complex Syst..

[8]  Vincent Larivière,et al.  The invariant distribution of references in scientific articles , 2016, J. Assoc. Inf. Sci. Technol..

[9]  Rong Tang,et al.  Author-rated importance of cited references in biology and psychology publications , 2008, J. Documentation.

[10]  Chaomei Chen,et al.  The Recurrence of Citations within a Scientific Article , 2015, ISSI.

[11]  K. Pearson.  VII. Note on regression and inheritance in the case of two parents , 1895, Proceedings of the Royal Society of London.

[12]  Henry Voos,et al.  Are All Citations Equal? Or, Did We Op. Cit. Your Idem?. , 1976 .

[13]  Shi Li,et al.  Quantifying a Paper’s Academic Impact by Distinguishing the Unequal Intensities and Contributions of Citations , 2019, IEEE Access.

[14]  Guang Yu,et al.  A study on the citation situation within the citing paper: citation distribution of references according to mention frequency , 2017, Scientometrics.

[15]  Daniel Lemire,et al.  Measuring academic influence: Not all citations are equal , 2015, J. Assoc. Inf. Sci. Technol..

[16]  Henry G. Small,et al.  Co-citation in the scientific literature: A new measure of the relationship between two documents , 1973, J. Am. Soc. Inf. Sci..

[17]  Cassidy R. Sugimoto,et al.  P-Rank: An indicator measuring prestige in heterogeneous scholarly networks , 2011, J. Assoc. Inf. Sci. Technol..

[18]  M. Moravcsik,et al.  Some Results on the Function and Quality of Citations , 1975 .

[19]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[20]  M. M. Kessler.  Bibliographic coupling between scientific papers , 1963 .

[21]  Zhigang Hu,et al.  Understanding multiply mentioned references , 2017, J. Informetrics.

[22]  Andreas Strotmann,et al.  Dimensions and uncertainties of author citation rankings: Lessons learned from frequency‐weighted in‐text citation counting , 2016, J. Assoc. Inf. Sci. Technol..

[23]  Andreas Strotmann,et al.  Re-citation Analysis: A Promising Method for Improving Citation Analysis for Research Evaluation, Knowledge Network Analysis, Knowledge Representation and Information Retrieval , 2015, ISSI.

[24]  Xiaojun Wan,et al.  WL‐index: Leveraging citation mention number to quantify an individual's scientific impact , 2014, J. Assoc. Inf. Sci. Technol..

[25]  Gertrud Herlach,et al.  Can retrieval of information from citation indexes be simplified? Multiple mention of a reference as a characteristic of the link between cited and citing article , 1978, J. Am. Soc. Inf. Sci..

[26]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[27]  Dangzhi Zhao,et al.  Functions of Uni- and Multi-citations: Implications for Weighted Citation Analysis , 2017, J. Data Inf. Sci..