Citation regression analysis of computer science publications in different ranking categories and subfields

A number of bibliometric studies point out that the role of conference publications in computer science differs from that in other traditional fields. Thus, it is interesting to identify the relative status of journal and conference publications in different subfields of computer science based on the citation rates categorised by the China Computer Federation (CCF) classifications and venue types. In this research, we construct a dataset containing over 100,000 papers recommended by the CCF catalogue and their citation information. We also investigate some other factors that often influence a paper’s citation rate. An experimental study shows that the relative status of journals and conferences varies greatly in different subfields of computer science, and the impact of different publication levels varies according to the citation rate. We also verify that the classification of a publication, number of authors, maximum h-index of all authors of a paper, and average number of papers published by a publication have different effects on the citation rate, although the citation rate may have a different degree of correlation with these factors.

[1]  Vincent Larivière,et al.  The weakening relationship between the impact factor and papers' citations in the digital age , 2012, J. Assoc. Inf. Sci. Technol..

[2]  Moshe Y. Vardi.  The financial meltdown and computing , 2009, CACM.

[3]  Glenn D. Walters,et al.  Predicting subsequent citations to articles published in twelve crime-psychology journals: Author impact versus journal impact , 2006, Scientometrics.

[4]  Daren Yu,et al.  Mining typical features for highly cited papers , 2011, Scientometrics.

[5]  D. Aksnes.  CHARACTERISTICS OF HIGHLY CITED PAPERS , 2003 .

[6]  P. Dalgaard,et al.  Rates and Poisson regression , 2008 .

[7]  Mike Thelwall,et al.  Regression for citation data: An evaluation of different methods , 2014, J. Informetrics.

[8]  Daniel Lemire,et al.  Measuring academic influence: Not all citations are equal , 2015, J. Assoc. Inf. Sci. Technol..

[9]  Massimo Franceschet,et al.  The role of conference publications in CS , 2010, Commun. ACM.

[10]  J. Guzmán.  Regression Models for Categorical Dependent Variables Using Stata , 2013 .

[11]  Pravin K. Trivedi,et al.  Regression Analysis of Count Data , 1998 .

[12]  Jonathan J. H. Zhu,et al.  Where you publish matters most: A multilevel analysis of factors affecting citations of internet studies , 2012, J. Assoc. Inf. Sci. Technol..

[13]  Jie Tang,et al.  ArnetMiner: extraction and mining of academic social networks , 2008, KDD.

[14]  Mike Thelwall,et al.  The influence of time and discipline on the magnitude of correlations between citation counts and quality scores , 2015, J. Informetrics.

[15]  Bela Gipp,et al.  Academic Search Engine Spam and Google Scholar's Resilience Against it , 2010 .

[16]  Ricardo Arencibia-Jorge,et al.  Comparison of SCImago journal rank indicator with journal impact factor , 2008, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[17]  Mike Thelwall,et al.  More precise methods for national research citation impact comparisons , 2015, J. Informetrics.

[18]  Zi-Lin He.  International collaboration does not have greater epistemic authority , 2009, J. Assoc. Inf. Sci. Technol..

[19]  Association Information , 2000 .

[20]  Hendrik P. van Dalen,et al.  What makes a scientific article influential? The case of demographers , 2001, Scientometrics.

[21]  J. S. Long,et al.  Regression models for categorical dependent variables using Stata, 2nd Edition , 2005 .

[22]  Lance Fortnow,et al.  ViewpointTime for computer science to grow up , 2009, Commun. ACM.

[23]  R. Berk,et al.  Overdispersion and Poisson Regression , 2008 .

[24]  Lutz Bornmann,et al.  Selecting manuscripts for a high-impact journal through peer review: A citation analysis of communications that were accepted by Angewandte Chemie International Edition, or rejected but published elsewhere , 2008, J. Assoc. Inf. Sci. Technol..

[25]  John Rigby,et al.  Looking for the impact of peer review: does count of funding acknowledgements really predict research impact? , 2012, Scientometrics.

[26]  Jacques Wainer,et al.  Relationship between high-quality journals and conferences in computer vision , 2012, Scientometrics.

[27]  Daniele Fanelli.  Positive results receive more citations, but only in some disciplines , 2012, Scientometrics.

[28]  Daren Yu,et al.  Discovery of factors influencing citation impact based on a soft fuzzy rough set model , 2012, Scientometrics.

[29]  Declan Butler,et al.  Free journal-ranking tool enters citation market , 2008, Nature.

[30]  E. Garfield.  The history and meaning of the journal impact factor. , 2006, JAMA.

[31]  Tx Station.  Stata Statistical Software: Release 7. , 2001 .

[32]  魏屹东,et al.  Scientometrics , 2018, Encyclopedia of Big Data.

[33]  Albert-László Barabási,et al.  Quantifying Long-Term Scientific Impact , 2013, Science.

[34]  K. Henkens,et al.  Signals in Science - on the Importance of Signaling in Gaining Attention in Science , 2004 .

[35]  Lawrence J. Smolinsky.  Expected number of citations and the crown indicator , 2016, J. Informetrics.

[36]  Stephen J. Bensman,et al.  Mean citation rate per article in mathematics journals: Differences from the scientific model , 2010, J. Assoc. Inf. Sci. Technol..

[37]  Moshe Y. Vardi.  Conferences vs. journals in computing research , 2009, CACM.

[38]  Michel Zitt,et al.  The journal impact factor: angel, devil, or scapegoat? A comment on J.K. Vanclay’s article 2011 , 2012, Scientometrics.

[39]  Javier Ruiz-Castillo,et al.  The effect on citation inequality of differences in citation practices at the web of science subject category level , 2014, J. Assoc. Inf. Sci. Technol..

[40]  Mike Thelwall,et al.  Determinants of research citation impact in nanoscience and nanotechnology , 2013, J. Assoc. Inf. Sci. Technol..

[41]  A. Cameron,et al.  Regression Analysis of Count Data by A. Colin Cameron , 2013 .

[42]  Mark Sanderson,et al.  Conferences versus journals in computer science , 2015, J. Assoc. Inf. Sci. Technol..

[43]  Lutz Bornmann,et al.  On the causes of subject-specific citation rates in Web of Science , 2014, Scientometrics.

[44]  Iman Tahamtan,et al.  Factors affecting number of citations: a comprehensive review of the literature , 2016, Scientometrics.

[45]  Lutz Bornmann,et al.  What factors determine citation counts of publications in chemistry besides their quality? , 2012, J. Informetrics.

[46]  Andreas Thor,et al.  Citation analysis of database publications , 2005, SGMD.

[47]  Per Ottar Seglen,et al.  Causal relationship between article citedness and journal impact , 1994 .

[48]  Fuyuki Yoshikane,et al.  Factors affecting citation rates of research articles , 2015, J. Assoc. Inf. Sci. Technol..

[49]  Joseph A. Konstan,et al.  Conference paper selectivity and impact , 2010, Commun. ACM.

[50]  Lior Shamir,et al.  The effect of conference proceedings on the scholarly communication in Computer Science and Engineering , 2010 .

[51]  Padraig Cunningham,et al.  Relative status of journal and conference publications in computer science , 2010, Commun. ACM.

[52]  J. Koricheva,et al.  What determines the citation frequency of ecological papers? , 2005, Trends in ecology & evolution.