Reflections on how to evaluate the professional value of scientific papers and their corresponding citations

It is inevitable that the ´publish or perish´ paradigm has implications for the quality of research published because this leads to scientific output being evaluated based on quantity and not preferably on quality. The pressure to continually publish results in the creation of predatory journals acting without quality peer review. Moreover the citation records of papers do not reflect their scientific quality but merely increase the impact of their quantity. The growth of sophisticated ´push -button´ technologies allows for easier preparation of publications while facilitating ready-to-publish data. Articles can thus be compiled merely through combining various measurements, usually without thought to their significance and to what purpose they may serve. Moreover any deep-rooted theory which contravenes mainstream assumptions is not welcomed because it challenges often long-established practice. The driving force for the production of an ever growing number of scientific papers is the need for authors to be recognised in order to be seriously considered when seeking financial support. Funding and fame are distributed to scientists according to their publication and citation scores. While the number of publications is clearly a quantitative criterion, much hope has been placed on citation analysis, which promised to serve as an adequate measure of genuine scientific value, i.e. of the quality of the scientific work.

[1]  J. Fiala Powder diffraction analysis of a three-component sample , 1980 .

[2]  C Scully,et al.  Impact factors and their significance; overrated or misused? , 2005, British Dental Journal.

[3]  A. D. Jackson,et al.  Measures for measures , 2006, Nature.

[4]  J. Šesták Citation records and some forgotten anniversaries in thermal analysis , 2012, Journal of Thermal Analysis and Calorimetry.

[5]  David Adam,et al.  Citation analysis: The counting house , 2002, Nature.

[6]  S. Ylä-Herttuala From the impact factor to DORA and the scientific content of articles. , 2015, Molecular therapy : the journal of the American Society of Gene Therapy.

[7]  J. Crawford,et al.  The impact of review articles , 2007, Laboratory Investigation.

[8]  J. Fiala A New Method for Powder Diffraction Phase Analysis , 1982 .

[9]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[10]  E GARFIELD,et al.  Citation indexes for science; a new dimension in documentation through association of ideas. , 2006, Science.

[11]  C. Cleverdon Citation Indexing , 1965, Nature.

[12]  Mingguo Liu,et al.  [Natural regeneration of Pinus sylvestris var. mongolica plantation on sandy land]. , 1976, Ying yong sheng tai xue bao = The journal of applied ecology.

[13]  J. Šesták,et al.  Some aspects of composite inorganic polysialates , 2012, Journal of Thermal Analysis and Calorimetry.

[14]  Nei Yoshihiro Soma,et al.  An analysis of bibliometric indicators to JCR according to Benford’s law , 2016, Scientometrics.

[15]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[16]  E. Garfield Citation indexes for science. A new dimension in documentation through association of ideas. 1955. , 1955, International journal of epidemiology.

[17]  Edmund R. Malinowski,et al.  Factor Analysis in Chemistry , 1980 .

[18]  J. Burnham Scopus database: a review , 2006, Biomedical digital libraries.

[19]  P. Seglen,et al.  Education and debate , 1999, The Ethics of Public Health.

[20]  L. Egghe,et al.  Theory and practise of the g-index , 2006, Scientometrics.

[21]  Beware the impact factor. , 2013, Nature materials.

[22]  Lutz Bornmann,et al.  A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants , 2011, J. Informetrics.

[23]  B. Frey,et al.  Do Rankings Reflect Research Quality? , 2008, SSRN Electronic Journal.

[24]  魏屹东,et al.  Scientometrics , 2018, Encyclopedia of Big Data.

[25]  V. Trimble,et al.  Affirmative action and women in science: Post hoc, ergo propter hoc? , 1996 .

[26]  Nan Jiang,et al.  Citation regression analysis of computer science publications in different ranking categories and subfields , 2017, Scientometrics.

[27]  Catherine M Ketcham,et al.  Predicting impact factor one year in advance , 2007, Laboratory Investigation.

[28]  E. Garfield Journal impact factor: a brief review. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[29]  J. Šesták,et al.  Heat inertia and its role in thermal analysis , 2015, Journal of Thermal Analysis and Calorimetry.

[30]  K. Noone,et al.  Beware the impact factor , 2016, Ambio.

[31]  Daniel Teodorescu,et al.  Beyond the Impact Factor: measuring the international visibility of Romanian social sciences journals , 2016, Scientometrics.

[32]  Perspective on Citation Analysis of Scientists , 1999 .