Seasonal Entropy, Diversity and Inequality Measures of Submitted and Accepted Papers Distributions in Peer-Reviewed Journals

This paper presents a novel method for finding features in the analysis of variable distributions stemming from time series. We apply the methodology to the case of submitted and accepted papers in peer-reviewed journals. We provide a comparative study of editorial decisions for papers submitted to two peer-reviewed journals: the Journal of the Serbian Chemical Society (JSCS) and this MDPI Entropy journal. We cover three recent years for which the fate of submitted papers—about 600 papers to JSCS and 2500 to Entropy—is completely determined. Instead of comparing the number distributions of these papers as a function of time with respect to a uniform distribution, we analyze the relevant probabilities, from which we derive the information entropy. It is argued that such probabilities are indeed more relevant for authors than the actual number of submissions. We tie this entropy analysis to the so called diversity of the variable distributions. Furthermore, we emphasize the correspondence between the entropy and the diversity with inequality measures, like the Herfindahl-Hirschman index and the Theil index, itself being in the class of entropy measures; the Gini coefficient which also measures the diversity in ranking is calculated for further discussion. In this sample, the seasonal aspects of the peer review process are outlined. It is found that the use of such indices, non linear transformations of the data distributions, allow us to distinguish features and evolutions of the peer review process as a function of time as well as comparing the non-uniformity of distributions. Furthermore, t- and z-statistical tests are applied in order to measure the significance (p-level) of the findings, that is, whether papers are more likely to be accepted if they are submitted during a few specific months or during a particular “season”; the predictability strength depends on the journal.

[1]  L. Jost Entropy and diversity , 2006 .

[2]  A. Rényi On Measures of Entropy and Information , 1961 .

[3]  Claude E. Shannon,et al.  A Mathematical Theory of Communications , 1948 .

[4]  Olgica Nedic,et al.  Peer Review of Reviewers: The Author's Perspective , 2018, Publ..

[5]  Marcel Ausloos,et al.  Efficiency in managing peer-review of scientific manuscripts - editors' perspective , 2019, ArXiv.

[6]  M. Ausloos,et al.  Statistical assessment of regional wealth inequalities: the Italian case , 2015 .

[7]  A. Atkinson,et al.  NH Handbook of Income Distribution , volume 2 B , 2014 .

[8]  Carsten K. W. De Dreu,et al.  Write when hot — submit when not: seasonal bias in peer review or acceptance? , 2010, Learn. Publ..

[9]  Ismael Rafols,et al.  Indicators of the interdisciplinarity of journals: Diversity, centrality, and citations , 2010, J. Informetrics.

[10]  A. Hirschman THE PATERNITY OF AN INDEX , 1964 .

[11]  Michael Schreiber,et al.  Seasonal bias in editorial decisions for a physics journal: you should write when you like, but submit in July , 2012, Learn. Publ..

[12]  Anthony B. Atkinson,et al.  Handbook of Income Distribution , 2000 .

[13]  Hadi Alizadeh Noughabi,et al.  Entropy-based tests of uniformity: A Monte Carlo power comparison , 2017, Commun. Stat. Simul. Comput..

[14]  Claude E. Shannon,et al.  Prediction and Entropy of Printed English , 1951 .

[15]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[16]  Henri Theil,et al.  Economics and information theory , 1967 .

[17]  D. Pirjol,et al.  Extremal properties of the Theil and Gini measures of inequality , 2018, Quality & Quantity.

[18]  M. Hill Diversity and Evenness: A Unifying Notation and Its Consequences , 1973 .

[19]  Ronald Rousseau Concentration and Diversity of Availability and Use in Information Systems: A Positive Reinforcement Model , 1992, J. Am. Soc. Inf. Sci..

[20]  Marcel Ausloos,et al.  Review time in peer review: quantitative analysis and modelling of editorial workflows , 2016, Scientometrics.

[21]  Marcel Ausloos,et al.  Benford’s law and Theil transform of financial data , 2012, 1208.5896.

[22]  L. Györfi,et al.  Nonparametric entropy estimation. An overview , 1997 .

[23]  M. Ausloos,et al.  Socio-economical analysis of Italy: The case of hagiotoponym cities , 2015, 1503.06104.

[24]  Domingo Morales,et al.  A comparison of uniformity tests , 2005 .

[25]  Claudiu Herteliu,et al.  Day of the week submission effect for accepted papers in Physica A, PLOS ONE, Nature and Cell , 2018, Scientometrics.

[26]  Marcel Ausloos,et al.  Artificial intelligence in peer review: How can evolutionary computation support journal editors? , 2017, PloS one.

[27]  L. Campbell,et al.  Exponential entropy as a measure of extent of a distribution , 1966 .

[28]  Marcel Ausloos,et al.  Correlations between submission and acceptance of papers in peer review journals , 2019, Scientometrics.