Gender bias in scholarly peer review

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing. DOI: http://dx.doi.org/10.7554/eLife.21718.001

[1]  Noah Mark,et al.  Culture and Competition: Homophily and distancing Explanations for Cultural Niches , 2003, American Sociological Review.

[2]  Pamela A. Popielarz (IN) VOLUNTARY ASSOCIATION , 1999 .

[3]  Mustafa Yavas,et al.  Impact of Homophily on Diffusion Dynamics Over Social Networks , 2013, ECMS.

[4]  Sara Schroter,et al.  Why do peer reviewers decline to review? A survey , 2006, Journal of Epidemiology and Community Health.

[5]  Yu Xie,et al.  Sex differences in research productivity : New evidence about an old puzzle , 1998 .

[6]  Joseph Galaskiewicz,et al.  Professional Networks and the Institutionalization of a Single Mind Set , 1985 .

[7]  R. J. FIFIELD,et al.  Science for All , 1967, Nature.

[8]  S. Knapp A suitable job for a woman. , 2005, Trends in ecology & evolution.

[9]  Norman Kaplan,et al.  The Sociology of Science: Theoretical and Empirical Investigations , 1974 .

[10]  S. Feld The Focused Organization of Social Ties , 1981, American Journal of Sociology.

[11]  Cassidy R. Sugimoto,et al.  Bibliometrics: Global gender disparities in science , 2013, Nature.

[12]  D. Meyer,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S6 References Evidence for a Collective Intelligence Factor in the Performance of Human Groups , 2022 .

[13]  P. Bourdieu The specificity of the scientific field and the social conditions of the progress of reason , 1975 .

[14]  Richard Smith,et al.  Pros and cons of open peer review , 1999, Nature Neuroscience.

[15]  Lesley G. Campbell,et al.  Gender-Heterogeneous Working Groups Produce Higher Quality Science , 2013, PloS one.

[16]  T. Ley,et al.  The Gender Gap in NIH Grant Applications , 2008, Science.

[17]  G. Jackson Mind the (gender) gap , 2011, International journal of clinical practice.

[18]  M. Hallinan,et al.  Sex differences in children's friendships. , 1978, American sociological review.

[19]  H. Zuckerman,et al.  Marriage, motherhood and research performance in science. , 1987, Scientific American.

[20]  Claire Mathieu,et al.  Homophily and the Glass Ceiling Effect in Social Networks , 2015, ITCS.

[21]  Scott L. Feld,et al.  The Structured Use of Personal Associates , 1984 .

[22]  L. Isbell,et al.  Stag Parties Linger: Continued Gender Bias in a Female-Rich Scientific Discipline , 2012, PloS one.

[23]  Margaret E. Lloyd,et al.  Gender factors in reviewer recommendations for manuscript publication. , 1990, Journal of applied behavior analysis.

[24]  D. Sainsbury Gendering welfare states , 1994 .

[25]  Karen L. Adair,et al.  Is there gender bias in reviewer selection and publication success rates for the New Zealand Journal of Ecology , 2014 .

[26]  P. Lazarsfeld,et al.  Friendship as Social process: a substantive and methodological analysis , 1964 .

[27]  M. Mulkay Science and the sociology of knowledge , 1979 .

[28]  Shilad Sen,et al.  Gender Representation on Journal Editorial Boards in the Mathematical Sciences , 2016, PloS one.

[29]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Svein Kyvik,et al.  Motherhood and Scientific Productivity , 1990 .

[31]  Jennifer Raymond,et al.  Sexist attitudes: Most of us are biased , 2013, Nature.

[32]  R. Jackson,et al.  The Matthew Effect in Science , 1988, International journal of dermatology.

[33]  Gregory A. Caldeira,et al.  Political Friendship in the Legislature , 1987, The Journal of Politics.

[34]  Susan M. Barnett,et al.  Women's underrepresentation in science: sociocultural and biological considerations. , 2009, Psychological bulletin.

[35]  Jonathan R. Cole,et al.  Fair Science: Women in the Scientific Community , 1987 .

[36]  Miles Hewstone,et al.  European Review of Social Psychology , 2012 .

[37]  Zsófia Osváth,et al.  DOI: 10 , 2011 .

[38]  Brian A. Nosek,et al.  Pervasiveness and correlates of implicit attitudes and stereotypes , 2007 .

[39]  An examination of gender differences in the American Fisheries Society peer-review process , 2015 .

[40]  H. Ibarra Homophily and differential returns: Sex differences in network structure and access in an advertising firm. , 1992 .

[41]  Mustafa Yavas,et al.  Impact of Homophily on Diffusion Dynamics Over Social Networks , 2014 .

[42]  J. S. Long,et al.  Scientific Careers: Universalism and Particularism , 1995 .

[43]  Katherine Strasser,et al.  Preschool Children’s Beliefs about Gender Differences in Academic Skills , 2013 .

[44]  W. Shrum Friendship in School: Gender and Racial Homophily. , 1988 .

[45]  Fjalar J. de Haan Making it a science , 2019 .

[46]  Anna Yeatman Bureaucrats, Technocrats, Femocrats: Essays on the Contemporary Australian State , 1990 .

[47]  William D. Bauer,et al.  Goldberg revisited: What's in an author's name , 1983 .

[48]  J. Østergaard Mind the gap or gender?: When boys and girls get drunk at the party , 2007 .

[49]  Nature’s sexism , 2012, Nature.

[50]  Leah Blau,et al.  The Outer Circle Women In The Scientific Community , 2016 .

[51]  Damon Centola An Experimental Study of Homophily in the Adoption of Health Behavior , 2011, Science.

[52]  S. Ceci,et al.  Understanding current causes of women's underrepresentation in science , 2011, Proceedings of the National Academy of Sciences.

[53]  Jonathan R. Cole,et al.  Fair Science: Women in the Scientific Community. , 1982 .

[54]  Cassidy R. Sugimoto,et al.  The reviewer in the mirror: examining gendered and ethnicized notions of reciprocity in peer review , 2014, Scientometrics.

[55]  James N. Baron,et al.  Men and Women at Work: Sex Segregation and Statistical Discrimination , 1986, American Journal of Sociology.

[56]  H. Zuckerman,et al.  The Outer Circle: Women in the Scientific Community , 1991 .

[57]  Ian M. Handley,et al.  Quality of evidence revealing subtle gender biases in science is in the eye of the beholder , 2015, Proceedings of the National Academy of Sciences.

[58]  Mary Ann Mason,et al.  Keeping Women in the Science Pipeline , 2011 .

[59]  C. Bloch Passion and Paranoia: Emotions and the Culture of Emotion in Academia , 2012 .

[60]  A. Woodward European Gender Mainstreaming: Promises and Pitfalls of Transformative Policy1 , 2003 .

[61]  M. Duru-bellat La (re)production des rapports sociaux de sexe : quelle place pour l'institution scolaire ? , 2008 .

[62]  Jeffrey T. Polzer,et al.  Friends in High Places: The Effects of Social Networks on Discrimination in Salary Negotiations , 2000 .

[63]  Donald L. Sexton,et al.  Women-Owned Businesses , 1989 .

[64]  T. Tregenza,et al.  Double-blind review favours increased representation of female authors. , 2008, Trends in ecology & evolution.

[65]  Cassidy R. Sugimoto,et al.  Bias in peer review , 2013, J. Assoc. Inf. Sci. Technol..

[66]  Silvia Knobloch-Westerwick,et al.  The Matilda Effect in Science Communication , 2013 .

[67]  Daniel J. Brass Men's and Women's Networks: A Study of Interaction Patterns and Influence In an Organization , 1985 .

[68]  Michaela Willi-Hooper,et al.  Gender bias in scholarly peer review , 2017 .

[69]  Neven Caplar,et al.  Quantitative evaluation of gender bias in astronomical publications from citation counts , 2016, Nature Astronomy.

[70]  Howard E. Aldrich,et al.  Networking Among Women Entrepreneurs , 1989 .

[71]  Amy G. Mazur,et al.  Comparative state feminism , 1997 .

[72]  F. Godlee,et al.  Effect of open peer review on quality of reviews and on reviewers'recommendations: a randomised trial , 1999, BMJ.

[73]  C. Wennerås,et al.  Nepotism and sexism in peer-review , 1997, Nature.

[74]  Amber E. Budden,et al.  To Name or Not to Name: The Effect of Changing Author Gender on Peer Review , 2009 .

[75]  Helen Shen Inequality quantified: Mind the gender gap , 2013, Nature.

[76]  Andrei Cimpian,et al.  Gender stereotypes about intellectual ability emerge early and influence children’s interests , 2017, Science.

[77]  Molly C Dougherty,et al.  Blinding in peer review: the preferences of reviewers for nursing journals. , 2008, Journal of advanced nursing.

[78]  R. Merton The Normative Structure of Science , 1973 .

[79]  R. Morgenstern,et al.  Children and the Productivity of Academic Women , 1977 .

[80]  Mark Ware,et al.  Peer review in scholarly journals: Perspective of the scholarly community - Results from an international study , 2008, Inf. Serv. Use.

[81]  Morroe Berger,et al.  Freedom and control in modern society , 1954 .

[82]  L. Verbrugge The Structure of Adult Friendship Choices , 1977 .

[83]  Michael Szell,et al.  How women organize social networks different from men , 2012, Scientific Reports.

[84]  Svein Kyvik,et al.  Child Care, Research Collaboration, and Gender Differences in Scientific Productivity , 1996 .

[85]  M. Graham,et al.  Science faculty’s subtle gender biases favor male students , 2012, Proceedings of the National Academy of Sciences.

[86]  S. Ceci,et al.  Science Current Directions in Psychological Sex Differences in Math-intensive Fields on Behalf Of: Association for Psychological Science , 2022 .

[87]  Women in neuroscience: a numbers game , 2006, Nature Neuroscience.

[88]  J. R. Gilbert,et al.  Is there gender bias in JAMA's peer review process? , 1994, JAMA.

[89]  Brooks Hanson,et al.  Journals invite too few women to referee , 2017, Nature.

[90]  K. Gurney,et al.  Network ‘Small-World-Ness’: A Quantitative Method for Determining Canonical Network Equivalence , 2008, PloS one.

[91]  Jonathan,et al.  THE PRODUCTIVITY PUZZLE : PERSISTENCE AND CHANGE IN PATTERNS OF PUBLICATION OF MEN AND WOMEN SCIENTISTS , 2004 .

[92]  Jennifer Hickes Lundquist,et al.  The Ivory Ceiling of Service Work , 2011 .

[93]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[94]  Peter J. Fensham,et al.  Science for all: A reflective essay , 1985 .

[95]  C. Sean Burns,et al.  Editor and reviewer gender influence the peer review process but not peer review outcomes at an ecology journal , 2016 .

[96]  R. Park,et al.  Introduction to the Science of Sociology , 1921 .