Exploring prestigious citations sourced from top universities in bibliometrics and altmetrics: a case study in the computer science discipline

Citation count is an important indicator for measuring research outputs. There have been numerous studies that have investigated factors affecting citation counts from the perspectives of cited papers and citing papers. In this paper, we focused specifically on citing papers and explored citations sourced from prestigious affiliations in the computer science discipline. The QS World University Rankings was employed to identify prestigious citations, named QS citations. We used the Microsoft Academic Graph, a massive scholarly dataset, and conducted different kinds of analysis between papers with QS citations and those without QS citations. We discovered that papers with QS citations are generally associated with higher total citation counts than those without QS citations. We extended the analysis to authors and journals, and the results indicated that when authors or journals have higher proportions of papers with QS citations, they are usually associated with higher values of the H-index or the Journal Impact Factor respectively. Additionally, papers with QS citations are also associated with a higher Altmetric Attention Score and a higher number of specific types of altmetrics such as tweet counts.

[1]  Cassidy R. Sugimoto,et al.  Institutional interactions: Exploring social, cognitive, and geographic relationships between institutions as demonstrated through citation networks , 2011, J. Assoc. Inf. Sci. Technol..

[2]  Lutz Bornmann,et al.  Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics , 2014, Scientometrics.

[3]  Theodore Brown,et al.  Predicting citation patterns: defining and determining influence , 2016, Scientometrics.

[4]  David M. Walker,et al.  Citation pattern and lifespan: a comparison of discipline, institution, and individual , 2011, Scientometrics.

[5]  Ludo Waltman,et al.  Predicting the long-term citation impact of recent publications , 2015, J. Informetrics.

[6]  Thed N. van Leeuwen,et al.  The Leiden ranking 2011/2012: Data collection, indicators, and interpretation , 2012, J. Assoc. Inf. Sci. Technol..

[7]  Johan Bollen,et al.  Journal status , 2006, Scientometrics.

[8]  José Luis Ortega,et al.  Comparing university rankings , 2010, Scientometrics.

[9]  Iman Tahamtan,et al.  Factors affecting number of citations: a comprehensive review of the literature , 2016, Scientometrics.

[10]  Leo Freyer Robust rankings - Review of multivariate assessments illustrated by the Shanghai rankings , 2014, Scientometrics.

[11]  Dragan Ivanovic,et al.  Highly cited articles in the Information Science and Library Science category in Social Science Citation Index: A bibliometric analysis , 2016, J. Libr. Inf. Sci..

[12]  Yin Leng Theng,et al.  Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media , 2016, Scientometrics.

[13]  Chrisovaladis Malesios,et al.  Some variations on the standard theoretical models for the h‐index: A comparative analysis , 2015, J. Assoc. Inf. Sci. Technol..

[14]  Carl T. Bergstrom Eigenfactor Measuring the value and prestige of scholarly journals , 2007 .

[15]  K. A. Khor,et al.  Influence of international co-authorship on the research citation impact of young universities , 2016, Scientometrics.

[16]  Lutz Bornmann,et al.  A new approach to the QS university ranking using the composite I‐distance indicator: Uncertainty and sensitivity analyses , 2016, J. Assoc. Inf. Sci. Technol..

[17]  Tian Yu,et al.  Citation impact prediction for scientific papers using stepwise regression analysis , 2014, Scientometrics.

[18]  E. Garfield The history and meaning of the journal impact factor. , 2006, JAMA.

[19]  Ronald Rousseau,et al.  Does international collaboration yield a higher citation potential for US scientists publishing in highly visible interdisciplinary Journals? , 2016, J. Assoc. Inf. Sci. Technol..

[20]  Heather A. Piwowar,et al.  Altmetrics: Value all research products , 2013, Nature.

[21]  D. Aksnes CHARACTERISTICS OF HIGHLY CITED PAPERS , 2003 .

[22]  Loet Leydesdorff,et al.  Alternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most-highly cited papers , 2012, Scientometrics.

[23]  Loet Leydesdorff,et al.  How to evaluate universities in terms of their relative citation impacts: Fractional counting of citations and the normalization of differences among disciplines , 2010, J. Assoc. Inf. Sci. Technol..

[24]  Leo Freyer Robust rankings , 2014, Scientometrics.

[25]  Loet Leydesdorff,et al.  How are new citation-based journal indicators adding to the bibliometric toolbox? , 2009, J. Assoc. Inf. Sci. Technol..

[26]  Ying Ding,et al.  Weighted citation: An indicator of an article's prestige , 2010, J. Assoc. Inf. Sci. Technol..

[27]  Ted Bergstrom Papers The Eigenfactor Metrics: A network approach to assessing scholarly journals , 2010 .

[28]  Rodrigo Costas,et al.  Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective , 2014, J. Assoc. Inf. Sci. Technol..

[29]  Yang Song,et al.  An Overview of Microsoft Academic Service (MAS) and Applications , 2015, WWW.

[30]  Quentin L. Burrell,et al.  On the h-index, the size of the Hirsch core and Jin's A-index , 2007, J. Informetrics.

[31]  Ying Ding,et al.  Popular and/or prestigious? Measures of scholarly esteem , 2010, Inf. Process. Manag..

[32]  Mônica G. Campiteli,et al.  An index to quantify an individual's scientific research valid across disciplines , 2005 .

[33]  Mike Thelwall,et al.  Interpreting correlations between citation counts and other indicators , 2016, Scientometrics.

[34]  Michael H. MacRoberts,et al.  Problems of citation analysis: A critical review , 1989, JASIS.

[35]  Ali Ouchi,et al.  Do altmetrics correlate with citations? A study based on the 1,000 most-cited articles , 2019 .

[36]  Carl T. Bergstrom,et al.  The Eigenfactor MetricsTM: A Network Approach to Assessing Scholarly Journals , 2010, Coll. Res. Libr..

[37]  Olle Persson,et al.  Are highly cited papers more international? , 2010, Scientometrics.

[38]  Thed N. van Leeuwen,et al.  Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? , 2002, Scientometrics.