Where you publish matters most: A multilevel analysis of factors affecting citations of internet studies

This study explores the factors influencing citations to Internet studies by assessing the relative explanatory power of three perspectives: normative theory, the social constructivist approach, and a natural growth mechanism. Using data on 7,700+ articles of Internet studies published in 100+ Social Sciences Citation Index (SSCI)-listed journals in 2000–2009, the study adopted a multilevel model to disentangle the impact between article- and journal-level factors on citations. This research strategy resulted in a number of both expected and surprising findings. The primary determinants for citations are found to be journal-level factors, accounting for 14% of the variances in citations of Internet studies. The impact of some, if not all, article-level factors on citations are moderated by journal-level factors. Internet studies, like studies in other areas (e.g., management, demography, and ecology), are cited more for rhetorical purposes, as suggested by the social constructivist approach, rather than as a form of reward, as argued by normative theory. The impact of time on citations varies across journals, which creates a growing “citation gap” for Internet studies published in journals with different characteristics. © 2012 Wiley Periodicals, Inc.

[1]  David A. Hofmann,et al.  Centering Decisions in Hierarchical Linear Models: Implications for Research in Organizations , 1998 .

[2]  William H. Starbuck,et al.  How Much Better are the Most Prestigious Journals? The Statistics of Academic Publication , 2005, Organ. Sci..

[3]  J. J. Cronin,et al.  Assessing the effects of quality, value, and customer satisfaction on consumer behavioral intentions in service environments , 2000 .

[4]  Günter Krampen,et al.  Acceleration of citing behavior after the millennium? Exemplary bibliometric reference analyses for psychology journals , 2010, Scientometrics.

[5]  Blaise Cronin,et al.  Hyperauthorship: A postmodern perversion or evidence of a structural shift in scholarly communication practices? , 2001, J. Assoc. Inf. Sci. Technol..

[6]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[7]  K. Henkens,et al.  Signals in Science - on the Importance of Signaling in Gaining Attention in Science , 2004 .

[8]  W. Shadish,et al.  Author Judgements about Works They Cite: Three Studies from Psychology Journals , 1995 .

[9]  Sam Wilson,et al.  What makes an article influential? Predicting impact in social and personality psychology , 2008, Scientometrics.

[10]  Henk F. Moed,et al.  In basic science the percentage of “authoritative” references decreases as bibliographies become shorter , 2004, Scientometrics.

[11]  A. F. J. Van Raan,et al.  On determinants of citation scores: a case study in chemical engineering , 1994 .

[12]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[13]  J. A. Stewart,et al.  Achievement and Ascriptive Processes in the Recognition of Scientific Articles , 1983 .

[14]  D. Bloor,et al.  Knowledge and Social Imagery , 1977 .

[15]  Naomi S. Baron.  Who Wants to Be a Discipline? , 2005, Inf. Soc..

[16]  Lutz Bornmann,et al.  What do citation counts measure? A review of studies on citing behavior , 2008, J. Documentation.

[17]  Kevin W. Boyack,et al.  Predicting the importance of current papers. , 2005 .

[18]  B. Latour.  Science in action : how to follow scientists and engineers through society , 1989 .

[19]  Lun Zhang,et al.  Mapping the landscape of Internet Studies: Text mining of social science journal articles 2000–2009 , 2013, New Media Soc..

[20]  Thed N. van Leeuwen,et al.  Towards appropriate indicators of journal impact , 1999, Scientometrics.

[21]  K. Klein,et al.  Levels Issues in Theory Development, Data Collection, and Analysis , 1994 .

[22]  A. Paraskeva,et al.  Self-citations in six anaesthesia journals and their significance in determining the impact factor. , 2000, British journal of anaesthesia.

[23]  Susan E. Cozzens,et al.  What do citations count? the rhetoric-first model , 1989, Scientometrics.

[24]  I. Simonson,et al.  Choice Based on Reasons: The Case of Attraction and Compromise Effects , 1989 .

[25]  T. Judge,et al.  What Causes a Management Article to be Cited—Article, Author, or Journal? , 2007 .

[26]  Stephen Cole,et al.  Social Stratification in Science. , 1973 .

[27]  P. Lazarsfeld,et al.  Friendship as Social process: a substantive and methodological analysis , 1964 .

[28]  G. Gilbert.  Referencing as Persuasion , 1977 .

[29]  R. Merton,et al.  The Sociology of Science: Theoretical and Empirical Investigations , 1975, Journal for the Scientific Study of Religion.

[30]  A. E. Cawkell,et al.  CITATIONS, OBSOLESCENCE, ENDURING ARTICLES, AND MULTIPLE AUTHORSHIPS , 1976 .

[31]  Valerie E. Lee,et al.  Using Hierarchical Linear Modeling to Study Social Contexts: The Case of School Effects , 2000 .

[32]  Hendrik P. van Dalen,et al.  What makes a scientific article influential? The case of demographers , 2001, Scientometrics.

[33]  J. Koricheva,et al.  What determines the citation frequency of ecological papers? , 2005, Trends in ecology & evolution.

[34]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[35]  Wolfgang Glänzel,et al.  A bibliometric study on ageing and reception processes of scientific literature , 1995, J. Inf. Sci..

[36]  C. Judd,et al.  Data analysis: continuing issues in the everyday analysis of psychological data. , 1995, Annual review of psychology.

[37]  Jonathan Furner,et al.  Scholarly communication and bibliometrics , 2005, Annu. Rev. Inf. Sci. Technol..

[38]  Craig K. Enders,et al.  Centering predictor variables in cross-sectional multilevel models: a new look at an old issue. , 2007, Psychological methods.

[39]  Dag W. Aksnes,et al.  Does self-citation pay? , 2007, Scientometrics.

[40]  Douglas N. Arnold,et al.  Nefarious Numbers , 2010, ArXiv.

[41]  Anthony G. Greenwald,et al.  An ethnic bias in scientific citations. , 1994 .

[42]  S. Woolgar,et al.  The Manufacture of Knowledge: an Essay on the Constructivist and Contextual Nature of Science , 1982 .

[43]  Juan Miguel Campanario,et al.  Large increases and decreases in journal impact factors in only one year: The effect of journal self-citations , 2011, J. Assoc. Inf. Sci. Technol..

[44]  S. Baldi.  Normative versus social constructivist processes in the allocation of citations : A network-analytic model , 1998 .

[45]  Peter Vinkler,et al.  An attempt of surveying and classifying bibliometric indicators for scientometric purposes , 1988, Scientometrics.

[46]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[47]  Debora Shaw,et al.  Citation, funding acknowledgement and author nationality relationships in four information science journals , 1999, J. Documentation.