The Participation and Motivations of Grant Peer Reviewers: A Comprehensive Survey

Scientific peer reviewers play an integral role in the grant selection process, yet very little has been reported on the levels of participation or the motivations of scientists to take part in peer review. The American Institute of Biological Sciences (AIBS) developed a comprehensive peer review survey that examined the motivations and levels of participation of grant reviewers. The survey was disseminated to 13,091 scientists in AIBS’s proprietary database. Of the 874 respondents, 76% indicated they had reviewed grant applications in the last 3 years; however, the number of reviews was unevenly distributed across this sample. Higher review loads were associated with respondents who had submitted more grant proposals over this time period, some of whom were likely to be study section members for large funding agencies. The most prevalent reason to participate in a review was to give back to the scientific community (especially among frequent grant submitters) and the most common reason to decline an invitation to review was lack of time. Interestingly, few suggested that expectation from the funding agency was a motivation to review. Most felt that review participation positively influenced their careers through improving grantsmanship and exposure to new scientific ideas. Of those who reviewed, respondents reported dedicating 2–5% of their total annual work time to grant review and, based on their self-reported maximum review loads, it is estimated they are participating at 56–87% of their capacity, which may have important implications regarding the sustainability of the system. Overall, it is clear that participation in peer review is uneven and in some cases near capacity, and more needs to be done to create new motivations and incentives to increase the future pool of reviewers.

[1]  Stephen A. Gallo,et al.  Grant reviewer perceptions of the quality and effectiveness of panel discussion , 2019, bioRxiv.

[2]  Michèle Lamont,et al.  How Professors Think: Inside the Curious World of Academic Judgment , 2009 .

[3]  Robert E. Gropp,et al.  Peer Review: A System under Stress , 2017 .

[4]  Sara Schroter,et al.  Surveys of current status in biomedical science grant review: funding organisations' and grant reviewers' perspectives , 2010, BMC medicine.

[5]  L. Trinquart,et al.  The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise , 2016, PloS one.

[6]  Drummond Rennie,et al.  Let’s make peer review scientific , 2016, Nature.

[7]  Flaminio Squazzoni,et al.  Does incentive provision increase the quality of peer review? An experimental study , 2013 .

[8]  Martijn Arns,et al.  Open access is tiring out peer reviewers , 2014, Nature.

[9]  Philip F Stahel,et al.  Peer review for biomedical publications: we can improve the system , 2014, BMC Medicine.

[10]  Chris Woolston Salaries: Reality check , 2016 .

[11]  W. P. Wahls The NIH must reduce disparities in funding to maximize its return on investments from taxpayers , 2018, eLife.

[12]  Nicholas Graves,et al.  On the time spent preparing grant proposals: an observational study of Australian researchers , 2013, BMJ Open.

[13]  Stephen A. Gallo,et al.  Risk evaluation in peer review of grant applications , 2018, Environment Systems and Decisions.

[14]  Kellogg S. Booth,et al.  What motivates people to review articles? The case of the human‐computer interaction community , 2016, J. Assoc. Inf. Sci. Technol..