Weak evidence for determinants of citation frequency in ecological articles

Citation frequency has been considered a biased surrogate of publication merit. However, previous studies on this subject were based on small sample sizes and were entirely based on null-hypothesis significance testing. Here we evaluated the relative effects of different predictors on citation frequency of ecological articles using an information theory framework designed to evaluate multiple competing hypotheses. Supposed predictors of citation frequency (e.g., number of authors, length of articles) accounted for a low fraction of the total variation. We argue that biases concerning citation are minor in ecology and further studies that attempt to quantify the scientific relevance of an article, aiming to make further relationships with citation, are needed to advance our understanding of why an article is cited.

[1]  Dag W. Aksnes,et al.  Citation rates and perceptions of scientific contribution , 2006 .

[2]  Birger Hjørland,et al.  Practical potentials of Bradford's law: a critical examination of the received view , 2007, J. Documentation.

[3]  Glenn D. Walters,et al.  Predicting subsequent citations to articles published in twelve crime-psychology journals: Author impact versus journal impact , 2006, Scientometrics.

[4]  Wolfgang Glänzel,et al.  What are highly cited publications? A method applied to German scientific papers, 1980–1989 , 1992 .

[5]  E CheckHayden.  Gene chips unmask cryptic diseases. , 2008 .

[6]  Gerard Pasterkamp,et al.  Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles , 2007, Scientometrics.

[7]  Jerald B. Johnson,et al.  Model selection in ecology and evolution. , 2004, Trends in ecology & evolution.

[8]  Thiago F. Rangel,et al.  Towards an integrated computational tool for spatial analysis in macroecology and biogeography , 2006 .

[9]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[10]  J. H. Zar,et al.  Biostatistical Analysis (5th Edition) , 1984 .

[11]  S Celayir,et al.  The Most Commonly Cited Articles in Pediatric Surgical Journals , 2008, European journal of pediatric surgery : official journal of Austrian Association of Pediatric Surgery ... [et al] = Zeitschrift fur Kinderchirurgie.

[12]  D. Aksnes.  CHARACTERISTICS OF HIGHLY CITED PAPERS , 2003 .

[13]  P. Killeen,et al.  An Alternative to Null-Hypothesis Significance Tests , 2005, Psychological science.

[14]  Henk F. Moed,et al.  The effect of 'Open Access' upon citation impact: An analysis of ArXiv's Condensed Matter Section , 2006, ArXiv.

[15]  Karl H. Müller,et al.  China: The end of the science superpowers , 2008, Nature.

[16]  S. Levin.  The problem of pattern and scale in ecology , 1992 .

[17]  Anil Kumar,et al.  Research and citation impact of publications by the Chemistry Division at Bhabha Atomic Research Centre , 2007, Scientometrics.

[18]  R. Macarthur.  The Problem of Pattern and Scale in Ecology: The Robert H. MacArthur Award Lecture , 2005 .

[19]  Jean-François Gehanno,et al.  Citation classics in occupational medicine journals. , 2007, Scandinavian journal of work, environment & health.

[20]  J. Shaffer.  Multiple Hypothesis Testing , 1995 .

[21]  K. A. McKibbon,et al.  Prediction of citation counts for clinical articles at two years using data available within three weeks of publication: retrospective cohort study , 2008, BMJ : British Medical Journal.

[22]  M. Swiontkowski,et al.  Factors associated with citation rates in the orthopedic literature. , 2007, Canadian journal of surgery. Journal canadien de chirurgie.

[23]  Henk F. Moed,et al.  The effect of "open access" on citation impact: An analysis of ArXiv's condensed matter section , 2006, J. Assoc. Inf. Sci. Technol..

[24]  Imre Lakatos,et al.  Criticism and the Growth of Knowledge , 1972 .

[25]  J. Koricheva,et al.  What determines the citation frequency of ecological papers? , 2005, Trends in ecology & evolution.

[26]  Michael S. Patterson,et al.  The relationship between reviewers’ quality-scores and number of citations for papers published in the journal Physics in Medicine and Biology from 2003–2005 , 2009, Scientometrics.

[27]  Amber E. Budden,et al.  Publication bias and merit in ecology , 2007 .

[28]  Ronald N. Kostoff,et al.  The difference between highly and poorly cited medical articles in the journal Lancet , 2007, Scientometrics.

[29]  Yijun Li,et al.  Parameter identification of the observed citation distribution , 2007, Scientometrics.

[30]  E. Garfield.  Citation analysis as a tool in journal evaluation. , 1972, Science.

[31]  T. Broadbent,et al.  Criticism and the Growth of Knowledge , 1972 .

[32]  Dag W. Aksnes,et al.  A macro study of self-citation , 2003, Scientometrics.

[33]  Martin Schumacher,et al.  Statistically significant papers in psychiatry were cited more often than others. , 2007, Journal of clinical epidemiology.

[34]  Hendrik P. van Dalen,et al.  What makes a scientific article influential? The case of demographers , 2001, Scientometrics.

[35]  E. Garfield.  The history and meaning of the journal impact factor. , 2006, JAMA.

[36]  Philip M. Davis,et al.  Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? , 2006, Scientometrics.

[37]  J. Koricheva,et al.  Does Scientific Collaboration Increase the Impact of Ecological Articles? , 2005 .

[38]  Amber E. Budden,et al.  The Influence of Author Gender, National Language and Number of Authors on Citation Rate in Ecology , 2009 .