Improving Metrics to Rank the Research Performance

Citations are increasingly used to consider research performance. Subsequently, the mathematical and statistical approach by developing metrics are applied to ease the performance measurement. However, almost all the existing metrics only calculate the quantity, not the quality of the citation. This approach is considered unfair. Hence, this study aims to explore the other variables influencing the quality of the research performance ranking. This paper conducted a literature survey finding the citation patterns, which is assumed fairer. Next, the patterns of the citation time window, in-text citation, and citation exclusivity to improve the metrics are suggested. This paper discussed the opportunities and the challenges in combining those patterns in one metric, especially for measuring the research performance in Indonesia.

[1]  Mike Thelwall,et al.  The most highly cited Library and Information Science articles: Interdisciplinarity, first authors and citation patterns , 2007, Scientometrics.

[2]  Nathan Schneider,et al.  Association for Computational Linguistics: Human Language Technologies , 2011 .

[3]  Tindaro Cicero,et al.  Assessing the varying level of impact measurement accuracy as a function of the citation window length , 2011, J. Informetrics.

[4]  J. Geddes,et al.  Comparison of systematic and narrative reviews: the example of the atypical antipsychotics , 2003, Epidemiologia e Psichiatria Sociale.

[5]  Chaomei Chen,et al.  The Effects of Co-citation Proximity on Co-citation Analysis , 2011 .

[6]  A. Tahai,et al.  An Alternative View of Citation Patterns of Quantitative Literature Cited by Business and Economic Researchers , 1996 .

[7]  Simone Teufel,et al.  Robust Argumentative Zoning for Sensemaking in Scholarly Documents , 2009, NLP4DL/AT4DL.

[8]  Mike Thelwall,et al.  Patterns of annual citation of highly cited articles and the prediction of their citation ranking: A comparison across subjects , 2008, Scientometrics.

[9]  Muhammad Abdul Qadir,et al.  Lessons Learned: The Complexity of Accurate Identification of in-Text Citations , 2015, Int. Arab J. Inf. Technol..

[10]  Michael Schreiber.  Restricting the h-index to a publication and citation time window: A case study of a timed Hirsch index , 2015, J. Informetrics.

[11]  Ali Daud,et al.  MuICE: Mutual Influence and Citation Exclusivity Author Rank , 2016, Inf. Process. Manag..

[12]  Simone Teufel,et al.  Context-Enhanced Citation Sentiment Detection , 2012, NAACL.

[13]  K. Hyland,et al.  Changing patterns of self-citation: cumulative inquiry or self-promotion? , 2018 .

[14]  D. Hicks.  Performance-based university research funding systems , 2012 .

[15]  Wolfgang Glänzel,et al.  A bibliometric study on ageing and reception processes of scientific literature , 1995, J. Inf. Sci..

[16]  Panayiotis Bozanis,et al.  The f index: Quantifying the impact of coterminal citations on scientists' ranking , 2009, J. Assoc. Inf. Sci. Technol..

[17]  Tindaro Cicero,et al.  A sensitivity analysis of researchers' productivity rankings to the time of citation observation , 2012, J. Informetrics.

[18]  Carl T. Bergstrom,et al.  Assessing citations with the Eigenfactor™ Metrics , 2008, Neurology.

[19]  B. Green,et al.  Writing narrative literature reviews for peer-reviewed journals: secrets of the trade. , 2006, Journal of chiropractic medicine.

[20]  Mike Thelwall,et al.  The metric tide: report of the independent review of the role of metrics in research assessment and management , 2015 .

[21]  Ernesto Roldan-Valadez,et al.  Current concepts on bibliometrics: a brief review about impact factor, Eigenfactor score, CiteScore, SCImago Journal Rank, Source-Normalised Impact per Paper, H-index, and alternative metrics , 2018, Irish Journal of Medical Science (1971 -).

[22]  Jagoda Spaventi,et al.  Citation Context Versus the Frequency Counts of Citation Histories , 1998, J. Am. Soc. Inf. Sci..

[23]  Fernando Fernandez-Llimos,et al.  Differences and similarities between Journal Impact Factor and CiteScore , 2018, Pharmacy practice.

[24]  Riaz Ahmad,et al.  Pattern Analysis of Citation-Anchors in Citing Documents for Accurate Identification of In-Text Citations , 2017, IEEE Access.