Language and socioeconomics predict geographic variation in peer review outcomes at an ecology journal

Papers submitted by scientists located in western nations generally fare better in the peer review process than do papers submitted by scientists from elsewhere. This paper examines geographic variation in peer review outcomes (whether a manuscript is sent for review, review scores obtained, and final decisions by editors) for 3529 submissions over a 4.5 year period at the journal Functional Ecology. In particular, we test whether geographic variation in language and socioeconomics are adequate to explain most or are all of this variation. There was no relationship between the geographic regions of handling editors and the decisions to send papers for review or invite revision, but there was substantial variation among author geographic locations; generally papers from first authors located in Oceania, the United States, and the United Kingdom fared better, and papers from first authors located in Africa, Asia, and Latin America fared worst. Language and the Human Development Index (HDI) explained the geographic variation in the proportion of papers sent for review, but socioeconomics alone (HDI) was the best predictor of mean review scores obtained by papers and whether authors were invited to submit a revision. Though we cannot exclude a role for editor and reviewer biases against authors based on their geographic location, variation in socioeconomics and language explain much of the variation in manuscript editorial and peer review outcomes among authors from different regions of the world.

[1]  David R. Anderson,et al.  AIC model selection and multimodel inference in behavioral ecology: some background, observations, and comparisons , 2011, Behavioral Ecology and Sociobiology.

[2]  Jason W. Osborne,et al.  Bringing balance and technical accuracy to reporting odds ratios and the results of logistic regression analyses , 2006 .

[3]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[4]  C. Sean Burns,et al.  Editor and reviewer gender influence the peer review process but not peer review outcomes at an ecology journal , 2016 .

[5]  Brian D. Ripley,et al.  Modern applied statistics with S, 4th Edition , 2002, Statistics and computing.

[6]  T. Opthof,et al.  The significance of the peer review process against the background of bias: priority ratings of reviewers and editors and the prediction of citation, the role of geographical bias. , 2002, Cardiovascular research.

[7]  Marcel Tanner,et al.  Representation of authors and editors from countries with different human development indexes in the leading literature on tropical medicine: survey of current evidence , 2004, BMJ : British Medical Journal.

[8]  M. Burgman,et al.  Decreasing geographic bias in Conservation Biology , 2015, Conservation biology : the journal of the Society for Conservation Biology.

[9]  Timothy H. Vines,et al.  Recruitment of reviewers is becoming harder at some journals: a test of the influence of reviewer fatigue at six journals in ecology and evolution , 2017, Research integrity and peer review.

[10]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[11]  Anna D. Muncy,et al.  Gender differences in patterns of authorship do not affect peer review outcomes at an ecology journal , 2016 .

[12]  Elizabeth R. Ellwood,et al.  Do gender, nationality, or academic age affect review decisions? An analysis of submissions to the journal Biological Conservation , 2009 .

[13]  Alexandra Witze,et al.  Research gets increasingly international , 2016, Nature.

[14]  Hadley Wickham,et al.  Reshaping Data with the reshape Package , 2007 .

[15]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[16]  C. Wiysonge,et al.  Increasing the value of health research in the WHO African Region beyond 2015—reflecting on the past, celebrating the present and building the future: a bibliometric analysis , 2015, BMJ Open.

[17]  Blaise Cronin,et al.  Vernacular and vehicular language , 2009, J. Assoc. Inf. Sci. Technol..

[18]  E. Pedhazur Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .

[19]  Tom Tregenza,et al.  Gender bias in the refereeing process , 2002 .

[20]  Xiangyi Zhang,et al.  Effect of reviewer's origin on peer review: China vs. non‐China , 2012, Learn. Publ..

[21]  Xavier Robin,et al.  pROC: an open-source package for R and S+ to analyze and compare ROC curves , 2011, BMC Bioinformatics.

[22]  Lutz Bornmann,et al.  Gatekeepers of science - Effects of external reviewers' attributes on the assessments of fellowship applications , 2007, J. Informetrics.

[23]  Charles W Fox,et al.  The relationship between manuscript title structure and success: editorial decisions and citation performance for an ecological journal , 2015, Ecology and evolution.

[24]  Gautam Naik,et al.  Peer-review activists push psychology journals towards open data , 2017, Nature.

[25]  John Flowerdew,et al.  Attitudes of Journal Editors to Nonnative Speaker Contributions , 2001 .

[26]  Cassidy R. Sugimoto,et al.  Bias in peer review , 2013, J. Assoc. Inf. Sci. Technol..

[27]  M. Hakel,et al.  An Examination of Sources of Peer-Review Bias , 2006, Psychological science.

[28]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[29]  D. King The scientific impact of nations , 2004, Nature.

[30]  R. Primack,et al.  Bias in the review process , 2008 .

[31]  Manuel Martínez-Bueno,et al.  Scientific Publication Trends and the Developing World , 2000, American Scientist.

[32]  J. Macinko,et al.  Does a research article's country of origin affect perception of its quality and relevance? A national trial of US public health researchers , 2015, BMJ Open.

[33]  Blaise Cronin,et al.  Vernacular and vehicular language , 2009, J. Assoc. Inf. Sci. Technol..

[34]  A. Link US and non-US submissions: an analysis of reviewer bias. , 1998, JAMA.

[35]  S. Mohapatra,et al.  Binary Logistic Regression , 2014 .

[36]  Eduardo Zambrano,et al.  An axiomatization of the human development index , 2011, Soc. Choice Welf..

[37]  D. Rennie,et al.  Does masking author identity improve peer review quality? A randomized controlled trial. PEER Investigators. , 1998, JAMA.

[38]  C. Gross,et al.  Effect of blinded peer review on abstract acceptance. , 2006, JAMA.

[39]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[40]  Language bias in ecological journals , 2011 .

[41]  Jason W. Osborne Bringing balance and technical accuracy to reporting odds ratios and the results of logistic regression analyses , 2006 .

[42]  S. Goodman,et al.  Manuscript Quality before and after Peer Review and Editing at Annals of Internal Medicine , 1994, Annals of Internal Medicine.

[43]  S. Fletcher Guardians of Science: Fairness and Reliability of Peer Review , 1994 .

[44]  Lian Pin Koh,et al.  Reviewer recommendations and editors’ decisions for a conservation journal: Is it just a crapshoot? And do Chinese authors get a fair shot? , 2015 .

[45]  A. Fayaz-Bakhsh,et al.  Science growth and human development index in Iran , 2015, Journal of research in medical sciences : the official journal of Isfahan University of Medical Sciences.

[46]  Anna D. Muncy,et al.  Author‐suggested reviewers: gender differences and influences on the peer review process at an ecology journal , 2017 .

[47]  Jonathan P. Man,et al.  Why do Some Countries Publish More Than Others? An International Comparison of Research Funding, English Proficiency and Publication Output in Highly Ranked General Medical Journals , 2003, European Journal of Epidemiology.

[48]  Hadley Wickham,et al.  The Split-Apply-Combine Strategy for Data Analysis , 2011 .

[49]  David Hsiehchen,et al.  Detecting editorial bias in medical publishing , 2015, Scientometrics.

[50]  MARGOT O'TOOLE,et al.  Imanishi-Kari (continued) , 1991, Nature.

[51]  S. Domínguez-Almendros,et al.  Logistic regression models. , 2011, Allergologia et immunopathologia.

[52]  U. Ligges Review of An R and S-PLUS companion to applied regression by J. Fox, Sage Publications, Thousand Oaks, California 2002 , 2003 .

[53]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[54]  Sanford Weisberg,et al.  An R Companion to Applied Regression , 2010 .

[55]  A. Waheed Why Developing Countries Are Lesser Innovators , 2012 .

[56]  Caroline Geck,et al.  The World Factbook , 2017 .