Peer Review Anew: Three Principles and a Case Study in Postpublication Quality Assurance

Over the last 15 years, the Internet has enabled new modes of authorship, new forms of open licensing and distribution, and new forms of collaboration and peer production to flourish. But in turn, new anxieties have arisen, especially concerning quality assurance, peer review, reuse, and modification. New innovations are appearing in peer review, endorsement, the measurement of trust, and the understanding of reputation, but without any systematic analysis of the general principles of quality assurance and peer review in this new era. In this paper, we propose a general set of principles for understanding what peer review was in the past and how it should be applied today to different kinds of content and in new platforms for managing quality. The principles stress an analysis not only on the content in materials but also on their context of use. Our focus is on open educational resources, and we present a case study of the open education project Connexions' lens system for quality assurance and review. However, the principles can be applied across multiple levels of knowledge production, including scholarship in engineering and science and reference materials in addition to educational publishing.

[1]  C. Sidney Burrus Connexions: An open educational resource for the 21st century , 2007 .

[2]  C. Sommerville,et al.  The Nature of the Book: Print and Knowledge in the Making , 1999 .

[3]  John M. Silvester,et al.  The Social Life of Information: Brown, J.S., & Duguid, P. (2000). Cambridge, MA: Harvard Business School Publishing. ISBN 0-87584-762-5. 320 pages , 2000, Internet High. Educ..

[4]  C. Oppenheim,et al.  The Access/Impact Problem and the Green and Gold Roads to Open Access , 2004 .

[5]  Peter Suber Open access to the scientific journal literature , 2002, Journal of biology.

[6]  Andrew M. St. Laurent Understanding Open Source and Free Software Licensing , 2004 .

[7]  Jock Given,et al.  The wealth of networks: How social production transforms markets and freedom , 2007, Inf. Econ. Policy.

[8]  Les Carr,et al.  The Access/Impact Problem and the Green and Gold Roads to Open Access: An Update , 2008 .

[9]  John Seely Brown,et al.  Book Reviews : The Social Life of Information By John Seely Brown and Paul Duguid. Boston: Harvard Business School Press, 2000. 320 pages , 2000 .

[10]  Don Tapscott,et al.  Wikinomics: How Mass Collaboration Changes Everything , 2006 .

[11]  Dr. Jan Hylén Open Educational Resources: Opportunities and Challenges , 2008 .

[12]  Eric A. von Hippel,et al.  How Open Source Software Works: 'Free' User-to-User Assistance? , 2000 .

[13]  Stevan Harnad,et al.  Rational Disagreement in Peer Review , 1985 .

[14]  R Smith,et al.  Opening up BMJ peer review , 1999, BMJ.

[15]  M. Jensen The New Metrics of Scholarly Authority. , 2007 .

[16]  J. Giles Internet encyclopaedias go head to head , 2005, Nature.

[17]  Richard G. Landon The nature of the book: Print and knowledge in the making , 1999 .

[18]  Christopher Kelty,et al.  Two Bits: The Cultural Significance of Free Software , 2008 .

[19]  Tim O'Reilly,et al.  What is Web 2.0: Design Patterns and Business Models for the Next Generation of Software , 2007 .

[20]  M. Castells The rise of the network society , 1996 .

[21]  Alfred O. Hero,et al.  Connexions: DSP education for a networked world , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[22]  M. Castells The Power of Identity , 1997 .

[23]  D.L. Jones,et al.  Sharing knowledge and building communities in signal processing , 2004, IEEE Signal Processing Magazine.

[24]  P. David Clio and the Economics of QWERTY , 1985 .

[25]  Daniel E. Atkins and John Seely Brown and Allen L. Hammond,et al.  A Review of the Open Educational Resources (OER) Movement: Achievements, Challenges, and New Opportunities , 2007 .

[26]  Danny Miller,et al.  Two Bits: The Cultural Significance of Free Software by Christopher Kelty , 2009 .

[27]  Peter Suber Removing the Barriers to Research: An Introduction to Open Access for Librarians , 2003 .

[28]  Paul M. Dholakia What Makes an Open Education Program Sustainable , 2006 .