Peer review: the attitudes and behaviours of Covid-19 pandemic-era early career researchers

Explores science and social science early career researchers’ (ECRs) perceptions and experiences of peer review, seeking also to identify their views of any pandemic-associated changes that have taken place. Data are drawn from the Harbingers-2 project, which investigated the impact of the pandemic on scholarly communications. Peer review, one of the activities covered, is singled out as it proved to be the activity of greatest concern to ECRs. Findings are obtained from interviews, which covered around 167 ECRs from China, France, Malaysia, Poland, Russia, Spain, UK and US, supplemented by an international survey that took the data out to a bigger and wider audience for confirmation and generalisation. Results obtained are enhanced by comparisons with pre-pandemic evidence yielded by Harbingers-1, the forerunner of the present study, and anchored in an extensive review of the literature. Main findings are: 1) most ECRs were experienced in peer review, both as reviewers and authors, but few had formal training; 2) half the ECRs had a lot or some reservations as to whether peer review vouches for the trustworthiness of research; 3) inadequate reviewers and slow processes were the main peer review associated problems; 4) there was a strong feeling that some kind of compensation, whether monetary or reputational, could help in dealing with these problems; 5) the pandemic impacted most on the speed of processing, with the majority of ECRs saying it had slowed the process; 6) nearly everyone thought that any pandemic-induced impacts would be temporary.

[1]  C. Tenopir,et al.  ‘Cracks’ in the scholarly communications system: Insights from a longitudinal international study of early career researchers , 2023, Learn. Publ..

[2]  C. Tenopir,et al.  The pandemic and changes in early career researchers’ career prospects, research and publishing practices , 2023, PloS one.

[3]  L. Waltman,et al.  An overview of innovations in the external peer review of journal manuscripts. , 2023, Wellcome open research.

[4]  A. Bonaccorsi Towards peer review as a group engagement , 2022, JLIS.it.

[5]  J. Fdez-Valdivia,et al.  The cross-subsidy and buy-one-give-one models of compensated peer review: A comparative study for mission-driven journals , 2022, Journal of Information Science.

[6]  C. Tenopir,et al.  Early career researchers in the pandemic-fashioned ‘new scholarly normality’: voices from the research frontline , 2022, El Profesional de la información.

[7]  Georgina M. Montgomery,et al.  Disproportionate impacts of COVID-19 on marginalized and minoritized early-career academic scientists , 2022, PloS one.

[8]  C. Tenopir,et al.  Early career researchers in the pandemic-fashioned ‘new scholarly normality’: a first look into the big changes and long-lasting impacts (international analysis) , 2022, El Profesional de la información.

[9]  Kelly-Ann Allen,et al.  Towards improving peer review: Crowd-sourced insights from Twitter , 2022, Journal of University Teaching and Learning Practice.

[10]  Y. Sevryugina,et al.  Publication practices during the COVID‐19 pandemic: Expedited publishing or simply an early bird effect? , 2022, Learn. Publ..

[11]  V. Trkulja,et al.  Publishing of COVID-19 preprints in peer-reviewed journals, preprinting trends, public discussion and quality issues , 2020, Scientometrics.

[12]  S. R. Shimray,et al.  Research done wrong: A comprehensive investigation of retracted publications in COVID-19 , 2021, Accountability in research.

[13]  J. A. Teixeira da Silva Challenges that Early Career Researchers Face in Academic Research and Publishing , 2021, Exchanges: The Interdisciplinary Research Journal.

[14]  Kiran Sharma,et al.  Team size and retracted citations reveal the patterns of retractions from 1981 to 2020 , 2021, Scientometrics.

[15]  Lambros Roumbanis Disagreement and Agonistic Chance in Peer Review , 2021, Science, Technology, & Human Values.

[16]  Mary K. Feeney,et al.  COVID-19 and the academy: opinions and experiences of university-based scientists in the U.S. , 2021, Humanities & Social Sciences Communications.

[17]  K. Nugent,et al.  Academic Journal Retractions and the COVID-19 Pandemic , 2021, Journal of primary care & community health.

[18]  Alec P. Christie,et al.  Reducing publication delay to improve the efficiency and impact of conservation science , 2021, bioRxiv.

[19]  Jessica K. Polka,et al.  The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape , 2021, PLoS biology.

[20]  C. Tenopir,et al.  The impact of the pandemic on early career researchers: what we already know from the internationally published literature , 2021, El profesional de la información.

[21]  N. Nasir,et al.  Voices from the field: The impact of COVID-19 on early career scholars and doctoral students , 2021 .

[22]  T. Simard,et al.  Methodological quality of COVID-19 clinical research , 2021, Nature Communications.

[23]  S. Horbach No time for that now! Qualitative changes in manuscript peer review during the Covid-19 pandemic , 2021, Research Evaluation.

[24]  Jo-ann Larkins,et al.  A survey of early-career researchers in Australia , 2020, eLife.

[25]  Samuel A. Moore,et al.  Reading Peer Review , 2020 .

[26]  Blanca Rodríguez-Bravo,et al.  How is open access publishing going down with early career researchers? An international, multi-disciplinary study , 2020 .

[27]  J. A. Teixeira da Silva,et al.  Optimizing peer review to minimize the risk of retracting COVID-19-related literature , 2020, Medicine, Health Care and Philosophy.

[28]  S. Horbach Pandemic publishing: Medical journals strongly speed up their publication process for COVID-19 , 2020, Quantitative Science Studies.

[29]  Blanca Rodríguez-Bravo,et al.  Millennial researchers in a metric-driven scholarly world: An international study , 2020 .

[30]  J. A. Helliwell,et al.  Global academic response to COVID‐19: Cross‐sectional study , 2020, medRxiv.

[31]  J. Homolak,et al.  Preliminary analysis of COVID-19 academic information patterns: a call for open science in the times of closed borders , 2020, Scientometrics.

[32]  E. Barroga Innovative Strategies for Peer Review , 2020, Journal of Korean medical science.

[33]  Elise S. Brezis,et al.  Arbitrariness in the peer review process , 2020, Scientometrics.

[34]  Abdullah Abrizah,et al.  A global questionnaire survey of the scholarly communication attitudes and behaviours of early career researchers , 2020, Learn. Publ..

[35]  Abdullah Abrizah,et al.  Early career researchers and their authorship and peer review beliefs and practices: An international study , 2019, Learn. Publ..

[36]  Abdullah Abrizah,et al.  Does the scholarly communication system satisfy the beliefs and aspirations of new researchers? Summarizing the Harbingers research , 2019, Learn. Publ..

[37]  Jonathan P. Tennant,et al.  The limitations to our understanding of peer review , 2019, Research integrity and peer review.

[38]  N. Silbiger,et al.  Unprofessional peer reviews disproportionately harm underrepresented groups in STEM , 2019, PeerJ.

[39]  Anna O'Brien,et al.  How publishers and editors can help early career researchers: Recommendations from a roundtable discussion , 2019, Learn. Publ..

[40]  Juan Pablo Alperin,et al.  Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations , 2019, bioRxiv.

[41]  Melissa Blankstein,et al.  Ithaka S+R US Faculty Survey 2018 , 2019 .

[42]  H. Murad,et al.  Bias : A Critical Review , 2022 .

[43]  Abdullah Abrizah,et al.  So, are early career researchers the harbingers of change? , 2019, Learn. Publ..

[44]  Eti Herman,et al.  Scholarly reputation building in the digital age: an activity-specific approach. Review article , 2019, El Profesional de la Información.

[45]  S. P. J. M. Horbach,et al.  The ability of different peer review procedures to flag problematic publications , 2018, Scientometrics.

[46]  S. Horbach,et al.  Correction to: The changing forms and expectations of peer review , 2018, Research integrity and peer review.

[47]  Eti Herman,et al.  Scholarly reputation. , 2018, FEMS microbiology letters.

[48]  Eti Herman,et al.  Early Career Researchers' Quest for Reputation in the Digital Age , 2018, Journal of Scholarly Publishing.

[49]  Abdullah Abrizah,et al.  What publishers can take away from the latest early career researcher research , 2018, Learn. Publ..

[50]  Min Zhang,et al.  Reviewer bias in single- versus double-blind peer review , 2017, Proceedings of the National Academy of Sciences.

[51]  Abdullah Abrizah,et al.  Peer review: The experience and views of early career researchers , 2017, Learn. Publ..

[52]  Christina K. Pikas,et al.  A multi-disciplinary perspective on emergent and future innovations in peer review , 2017, F1000Research.

[53]  Abdullah Abrizah,et al.  Early career researchers and their publishing and authorship practices , 2017, Learn. Publ..

[54]  Abdullah Abrizah,et al.  Early career researchers: Scholarly behaviour and the prospect of change , 2017, Learn. Publ..

[55]  Erik A. Borg,et al.  Challenges and coping strategies for international publication: perceptions of young scholars in China , 2017 .

[56]  Martin Reinhart,et al.  The visibility of scientific misconduct: A review of the literature on retracted journal articles , 2016, Current sociology. La Sociologie contemporaine.

[57]  Tony Ross-Hellauer,et al.  What is open peer review? A systematic review. , 2017, F1000Research.

[58]  Michael Jubb,et al.  Peer review: The current landscape and future trends , 2016, Learn. Publ..

[59]  Christoph Bartneck,et al.  Reviewers’ scores do not predict impact: bibliometric analysis of the proceedings of the human–robot interaction conference , 2016, Scientometrics.

[60]  M. HamidR.Jamali,et al.  New ways of building, showcasing, and measuring scholarly reputation , 2015, Learn. Publ..

[61]  Suzie Allard,et al.  Peer review: still king in the digital age , 2015, Learn. Publ..

[62]  Lisa Bero,et al.  Measuring the effectiveness of scientific gatekeeping , 2014, Proceedings of the National Academy of Sciences.

[63]  Cassidy R. Sugimoto,et al.  The reviewer in the mirror: examining gendered and ethnicized notions of reciprocity in peer review , 2014, Scientometrics.

[64]  Arturo Casadevall,et al.  Why Has the Number of Scientific Retractions Increased? , 2013, PloS one.

[65]  Wolfgang Glänzel,et al.  Bibliometric Evidence for a Hierarchy of the Sciences , 2013, PloS one.

[66]  Claudio Gandelli,et al.  Opening the Black-Box of Peer Review: An Agent-Based Model of Scientist Behaviour , 2013, J. Artif. Soc. Soc. Simul..

[67]  Thomas J. Madden,et al.  “If You've Seen One, You've Seen Them All!” Are Young Millennials the Same Worldwide? , 2013 .

[68]  Louise Hall,et al.  Peer review in a changing world: An international study measuring the attitudes of researchers , 2013, J. Assoc. Inf. Sci. Technol..

[69]  Cassidy R. Sugimoto,et al.  Bias in peer review , 2013, J. Assoc. Inf. Sci. Technol..

[70]  Hendrik P. van Dalen,et al.  Intended and Unintended Consequences of a Publish-or-Perish Culture: A Worldwide Survey , 2012, J. Assoc. Inf. Sci. Technol..