Priority criteria in peer review of scientific articles

Number of researchers, journals and articles has significantly increased in the last few years and peer review is still the most reliable instrument to sort out innovative, valuable, scientifically sound information from the pool of submitted results. Editors and publishers join their efforts to improve peer review process and to be able to do so properly, they need “field information” from contributors. Editorial board of the Journal of the Serbian Chemical Society performed its own survey to find out what reviewers recognize as priority criteria in manuscript evaluation and whether the professional background (title, number of years in research or experience in reviewing) influences these criteria. Most reviewers declared that they consider peer review as an essential component of the scientific professionalism. Scientific contribution and originality were the most important criteria in the evaluation of papers. Most reviewers preferred to see conclusions completely supported by experimental data, without additional speculations. Although there were no large differences between early stage and experienced researchers, early stage researchers and less experienced reviewers used grade 5 (indicating the highest priority) much more often in their evaluation of priority criteria than experienced researchers and/or reviewers, suggesting possible evolution of tolerance with experience.

[1]  Peter Moizer,et al.  Publishing in accounting journals: A fair game? , 2009 .

[2]  Lutz Bornmann,et al.  Do editors and referees look for signs of scientific misconduct when reviewing manuscripts? A quantitative content analysis of studies that examined review criteria and reasons for accepting and rejecting manuscripts for publication , 2008, Scientometrics.

[3]  J García Puig,et al.  [Report of the editors, 2011]. , 2012, Revista clinica espanola.

[4]  Maria Victoria Schneider,et al.  An Open Science Peer Review Oath , 2014, F1000Research.

[5]  Saudi Arabia,et al.  Accuracy of references in scholarly journals: an analysis of 450 references in ten biomedical journals , 2014 .

[6]  D. Benos,et al.  The ups and downs of peer review. , 2007, Advances in physiology education.

[7]  R. K. F. Clark Peer review: a view based on recent experience as an author and reviewer , 2012, BDJ.

[8]  Sushil Ghanshyam Kachewar,et al.  Reviewer Index: A New Proposal Of Rewarding The Reviewer , 2013, Mens sana monographs.

[9]  F. Godlee,et al.  Effect on the quality of peer review of blinding reviewers and asking them to sign their reports: a randomized controlled trial. , 1998, JAMA.

[10]  Debra Houry,et al.  Does mentoring new peer reviewers improve review quality? A randomized trial , 2012, BMC medical education.

[11]  Philip F Stahel,et al.  Peer review for biomedical publications: we can improve the system , 2014, BMC Medicine.

[12]  Peggy Hawkins,et al.  Barriers and Strategies to the Revision Process From an Editor's Perspective , 2009 .

[13]  Satrajit S. Ghosh,et al.  Learning from open source software projects to improve scientific review , 2012, Front. Comput. Neurosci..

[14]  Constance Holden Korean Cloner Admits Lying About Oocyte Donations , 2005, Science.

[15]  D. Kronick Peer review in 18th-century scientific journalism. , 1990, JAMA.

[16]  Katsiaryna Mirylenka,et al.  Alternatives to Peer Review: Novel Approaches for Research Evaluation , 2011, Front. Comput. Neurosci..

[17]  Flaminio Squazzoni,et al.  Does incentive provision increase the quality of peer review? An experimental study , 2013 .

[18]  R. Hoffmann A wiki for the life sciences where authorship matters , 2008, Nature Genetics.

[19]  Aleksandar Dekanski,et al.  A survey on the Journal of the Serbian Chemical Society publishing policies: On the occasion of the 80th volume , 2015 .

[20]  G. Casella,et al.  Report of the Editors—2011 , 2012 .

[21]  Christel Fein,et al.  Multidimensional Journal Evaluation of PLOS ONE , 2013 .

[22]  Dana R. Hermanson,et al.  An examination of the peer review process in accounting journals , 2008 .

[23]  Kehrer,et al.  Report by the editors , 2000, Toxicology letters.

[24]  魏屹东,et al.  Scientometrics , 2018, Encyclopedia of Big Data.

[25]  A. C. Atkinson,et al.  Report of the Editors , 1989 .

[26]  Gary Marchionini,et al.  Editorial: Reviewer merits and review control in an age of electronic manuscript management systems , 2008, TOIS.

[27]  E. Ernst,et al.  Reviewer bias: a blinded experimental study. , 1994, The Journal of laboratory and clinical medicine.

[28]  Constance Holden Stem cell research. Korean cloner admits lying about oocyte donations. , 2005, Science.

[29]  Lawrence Souder,et al.  The ethics of scholarly peer review: a review of the literature , 2011, Learn. Publ..

[30]  Constance Holden Stem cell research. California institute picks city by the bay. , 2005, Science.

[31]  Anthony M Vintzileos,et al.  The relationship between a reviewer's recommendation and editorial decision of manuscripts submitted for publication in obstetrics. , 2014, American journal of obstetrics and gynecology.

[32]  S. Rijcke,et al.  Bibliometrics: The Leiden Manifesto for research metrics , 2015, Nature.

[33]  Jan Oosterhaven Too many journals? Towards a theory of repeated rejections and ultimate acceptance , 2015, Scientometrics.

[34]  Maria Victoria Schneider,et al.  The open science peer review oath. , 2014, F1000Research.

[35]  K. Mak,et al.  Views on the peer review system of biomedical journals: an online survey of academics from high-ranking universities , 2013, BMC Medical Research Methodology.

[36]  Anthony N DeMaria Looking back. , 2008, Journal of the American College of Cardiology.

[37]  David M. Schultz,et al.  Quantifying the volunteer effort of scientific peer reviewing. , 2012 .

[38]  Xavier Bosch,et al.  Misconduct Policies in High-Impact Biomedical Journals , 2012, PloS one.

[39]  Lisa Bero,et al.  Measuring the effectiveness of scientific gatekeeping , 2014, Proceedings of the National Academy of Sciences.

[40]  R. Yalow,et al.  Radioimmunoassay: A Probe for Fine Structure of Biologic Systems , 1992, Journal of the American Medical Women's Association.

[41]  R. Yalow,et al.  Radioimmunoassay: A Probe for Fine Structure of Biologic Systems , 1992 .

[42]  Richard G. Baraniuk,et al.  Peer Review Anew: Three Principles and a Case Study in Postpublication Quality Assurance , 2008, Proceedings of the IEEE.

[43]  Molly C Dougherty,et al.  Experience, time investment, and motivators of nursing journal peer reviewers. , 2008, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[44]  B. Björk,et al.  Anatomy of open access publishing: a study of longitudinal development and internal structure , 2012, BMC Medicine.

[45]  Theodore Eugene Day,et al.  The big consequences of small biases: A simulation of peer review , 2015 .

[46]  Ofer H. Azar,et al.  The Review Process in Economics: Is it Too Fast? , 2005 .

[47]  Bettina Neunteufl,et al.  Peer review versus editorial review and their role in innovative science , 2012, Theoretical medicine and bioethics.