Zero impact: a large-scale study of uncitedness

This paper presents a large-scale study of the phenomenon ‘uncitedness’. A literature review indicates that uncitedness is related to at least three factors: Field, document type, and time. To explore these factors and their mutual influence further, and at much larger scale than previous studies, the paper focuses on seven subject areas (arts and humanities; social sciences; computer science; mathematics; engineering; medicine; physics and astronomy), seven document types (articles; reviews; notes; letters; conference papers; books; book chapters), and a 20-year publication window (1996–2015). Documents are searched in Scopus, and retrieved year-by-year, discipline-by-discipline, and for each individual document type (total: 29,472,184 documents; 7,508,741 uncited documents). The results show great variance in uncitedness ratios between subject areas and document types. This is probably caused by a somewhat tacitly agreed upon genre hierarchy existing in all subject areas, yet with important local traits and differences. The importance of the time-dimension is documented. Time to first citation varies a great deal between subject areas, and the uncitedness ratio is consequently shown to be quite sensitive to the length of citation windows.

[1]  David P. Hamilton.  Publishing by--and for?--the numbers. , 1990, Science.

[2]  Rajan Sen,et al.  Citation Rates of Award-Winning ASCE Papers , 2012 .

[3]  F. Crick,et al.  Molecular Structure of Nucleic Acids: A Structure for Deoxyribose Nucleic Acid , 1974, Nature.

[4]  Vincent Larivière,et al.  Is Paper Uncitedness a Function of the Alphabet? , 2015, ISSI.

[5]  Ronald Rousseau,et al.  Meeting abstracts : a waste of space? , 2013 .

[6]  Nan Lin,et al.  Research studies in patterns of scientific communication: II. The role of the national meeting in scientific and technical communication , 1972, Inf. Storage Retr..

[7]  Quentin L. Burrell,et al.  A stochastic approach to the relation between the impact factor and the uncitedness factor , 2013, J. Informetrics.

[8]  Rong Tang.  Citation Characteristics and Intellectual Acceptance of Scholarly Monographs , 2008 .

[9]  D J PRICE,et al.  NETWORKS OF SCIENTIFIC PAPERS. , 1965, Science.

[10]  Belver C. Griffith,et al.  Communication and information processing within scientific disciplines: Empirical findings for Psychology , 1972, Inf. Storage Retr..

[11]  R. Law,et al.  Which Journal Articles are Uncited? The Case of the Asia Pacific Journal of Tourism Research and the Journal of Travel and Tourism Marketing , 2013 .

[12]  R. E. Burton,et al.  The “half‐life” of some scientific and technical literatures , 1960 .

[13]  Kène Henkens,et al.  Demographers and Their Journals: Who Remains Uncited After Ten Years? , 2004 .

[14]  Uncited Research Articles in Popular United States General Radiology Journals. , 2019, Academic radiology.

[15]  Petr Heneberg,et al.  Supposedly uncited articles of Nobel laureates and Fields medalists can be prevalently attributed to the errors of omission and commission , 2013, J. Assoc. Inf. Sci. Technol..

[16]  M. Carl Drott,et al.  Reexamining the Role of Conference Papers in Scholarly Communication , 1995, J. Am. Soc. Inf. Sci..

[17]  J. Tainer.  Science, citation, and funding. , 1991, Science.

[18]  Tony Becher.  Academic Tribes And Territories , 1989 .

[19]  W. Tansey,et al.  Letter to the editor. Chemical-genetic strategy for inhibiting proteasome function in Saccharomyces cerevisiae. , 2012, Yeast.

[20]  Blaise Cronin,et al.  Disciplinary Discourses: Social Interactions in Academic Writing , 2002, J. Documentation.

[21]  Ding-wei Huang,et al.  A scaling between Impact Factor and uncitedness , 2012 .

[22]  Tina Nane.  Time to First Citation Estimation in the Presence of Additional Information , 2015, ISSI.

[23]  Quentin L. Burrell.  Alternative thoughts on uncitedness , 2012, J. Assoc. Inf. Sci. Technol..

[24]  Yasuhiro Yamashita,et al.  Influence of researchers’ international mobilities on publication: a comparison of highly cited and uncited papers , 2014, Scientometrics.

[25]  Maria do Carmo Avamilano Alvarez,et al.  Uncited articles in Brazilian public health journals , 2017, Revista de saude publica.

[26]  I. Scott MacKenzie.  Citedness, uncitedness, and the murky world between , 2009, CHI Extended Abstracts.

[27]  David P. Hamilton.  Research papers: who's uncited now? , 1991, Science.

[28]  Yuh-Shan Ho,et al.  Sleeping beauties in psychology , 2016, Scientometrics.

[29]  R. Danziger,et al.  Fate of conference abstracts , 1996, Nature.

[30]  Anthony F. J. van Raan,et al.  Dormitory of Physical and Engineering Sciences: Sleeping Beauties May Be Sleeping Innovations. , 2015, 1506.01540.

[31]  Vincent Larivière,et al.  Modeling a century of citation distributions , 2008, J. Informetrics.

[32]  Wen Lou,et al.  Does author affiliation reputation affect uncitedness? , 2015, ASIST.

[33]  Zhen Zhong,et al.  Uncited papers, uncited authors and uncited topics: A case study in library and information science , 2015, J. Informetrics.

[34]  Leo Egghe,et al.  Thoughts on uncitedness: Nobel laureates and Fields medalists as case studies , 2011, J. Assoc. Inf. Sci. Technol..

[35]  S. Bandyopadhyay,et al.  Rao Versus Murthy Debate , 2015 .

[36]  J. Swales.  Research Genres: Explorations and Applications , 2004 .

[37]  Leo Egghe,et al.  The functional relation between the impact factor and the uncitedness factor revisited , 2013, J. Informetrics.

[38]  Mike Thelwall,et al.  Are there too many uncited articles? Zero inflated variants of the discretised lognormal and hooked power law distributions , 2016, J. Informetrics.

[39]  Michael E. D. Koenig,et al.  Bibliometric indicators versus expert opinion in assessing research performance , 1983, J. Am. Soc. Inf. Sci..

[40]  Tove Faber Frandsen,et al.  Rejoinder: Noble prize effects in citation networks , 2017, J. Assoc. Inf. Sci. Technol..

[41]  Yishan Wu,et al.  Regularity in the time-dependent distribution of the percentage of never-cited papers: An empirical pilot study based on the six journals , 2014, J. Informetrics.

[42]  M. Tamizhchelvan,et al.  Uncited Publications in MEMS Literature: A Bibliometric Study , 2015 .

[43]  Thed N. van Leeuwen,et al.  Characteristics of journal impact factors: The effects of uncitedness and citation distribution on the understanding of journal impact factors , 2005, Scientometrics.

[44]  A. Mavrogenis,et al.  Citations, non-citations and visibility of International Orthopaedics in 2017 , 2018, International Orthopaedics.

[45]  R. Alizadeh-Navaei,et al.  Comparing the Levels of Non-citation of Iranian Journals on Health in Persian and English in Scopus Database , 2017 .