Reform peer review: The Peters and Ceci study in the context of other current studies of scientific evaluation

[1]  J. R. Cole,et al.  The Ortega Hypothesis , 1972, Science.

[2]  R. Hill.  The relevance of physics , 1979 .

[3]  R. Herrnstein.  Doing What Comes Naturally: A Reply to Professor Skinner. , 1977 .

[4]  J. Scott Armstrong,et al.  Advocacy as a Scientific Strategy: The Mitroff Myth , 1980 .

[5]  W. Broad.  Congress told fraud issue "exaggerated". , 1981, Science.

[6]  W. M. Wolff.  Publication problems in psychology and an explicit evaluation schema for manuscripts. , 1973 .

[7]  Robert Perloff,et al.  IMPROVING MANUSCRIPT EVALUATION PROCEDURES , 1972 .

[8]  Marley W. Watkins,et al.  Chance and interrater agreement on manuscripts. , 1979 .

[9]  W. Broad.  Imbroglio at yale (I): emergence of a fraud. , 1980, Science.

[10]  W. Miles Cox,et al.  Productivity Ratings of Graduate Programs in Psychology Based on Publication in the Journals of the American Psychological Association. , 1977 .

[11]  D. Lazarus.  Changes in The Physical Review and Physical Review Letters , 1980 .

[12]  Stephen D. Gottfredson,et al.  Evaluating psychological research reports: Dimensions, reliability, and correlates of quality judgments. , 1978 .

[13]  J. Gibbs.  The meaning of ecologically oriented inquiry in contemporary psychology. , 1979 .

[14]  W. D. Garvey,et al.  SCIENTIFIC INFORMATION EXCHANGE IN PSYCHOLOGY. , 1964, Science.

[15]  C. Patterson.  Evaluation of manuscripts submitted for publication. , 1969 .

[16]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[17]  A Trafford,et al.  Behind the scandals in science labs. , 1981, U.S. news & world report.

[18]  D. S. Dennison,et al.  `Phycomyces: Interference Between the Light Growth Response and the Avoidance Response , 1979, Science.

[19]  Thomas J. Zenisek,et al.  Manuscript characteristics influencing reviewers' decisions. , 1980 .

[20]  P. Abelson.  Problems of science faculties. , 1979, Science.

[21]  J. Scott Armstrong,et al.  Research on Scientific Journals: Implications for Editors and Authors , 2005 .

[22]  M. White,et al.  Citation analysis of psychology journals. , 1977 .

[23]  W. D. Garvey,et al.  Communication in the Physical and the Social Sciences , 1970, Science.

[24]  Hanna Levenson,et al.  Are Women Still Prejudiced against Women? A Replication and Extension of Goldberg's Study. , 1975 .

[25]  R. Crandall,et al.  How qualified are editors , 1977 .

[26]  D. Lindsey,et al.  Behind the Editorial Curtain@@@The Scientific Publication System in Social Science. , 1979 .

[27]  S. Kerr,et al.  Manuscript Characteristics Which Influence Acceptance for Management and Social Science Journals , 1977 .

[28]  S. Ceci,et al.  A Manuscript Masquerade , 1980 .

[29]  Donald B. Rubin,et al.  Interpersonal expectancy effects: the first 345 studies , 1978, Behavioral and Brain Sciences.

[30]  D. Eckberg,et al.  The Paradigm Concept and Sociology: A Critical Review , 1979 .

[31]  G. William Walster,et al.  A Proposal for a New Editorial Policy in the Social Sciences , 1970 .

[32]  B. Martin.  The Bias of Science , 1979 .

[33]  W. Mcguire.  The Yin and Yang of Progress in Social Psychology: Seven Koan. , 1973 .

[34]  Mark Oromaner,et al.  Professional Age and the Reception of Sociological Publications: A Test of the Zuckerman-Merton Hypothesis , 1977 .

[35]  C. H. Patterson.  Competence Is Not Enough , 1973 .

[36]  D. L. Schaeffer.  Do APA journals play professional favorites , 1970 .

[37]  Harriet Zuckerman,et al.  Stratification in American Science , 1970 .

[38]  W. Hagstrom.  Competition in Science , 1974 .

[39]  C. Holden.  Ethics in social science research. , 1979, Science.

[40]  R. Weiss.  The use and abuse of deception. , 1980, American journal of public health.

[41]  W. Broad.  Would-be academician pirates papers. , 1980, Science.

[42]  Tefko Saracevic,et al.  RELEVANCE: A review of and a framework for the thinking on the notion in information science , 1997, J. Am. Soc. Inf. Sci..

[43]  R. G. Hawkins,et al.  What Economists Think of Their Journals , 1973, Journal of Political Economy.

[44]  Belver C. Griffith,et al.  Scientific communication: Its role in the conduct of research and creation of knowledge. , 1971 .

[45]  J. P. Rushton,et al.  An evaluation of 80 psychology journals based on the Science Citation Index.. , 1978 .

[46]  Charles E. Bidwell,et al.  The Review Process and Its Consequences in the Major Sociology Journals@@@American Journal of Sociology, 1975-1977.@@@American Sociological Review, 1975-1977.@@@Social Forces, 1975-1977. , 1979 .

[47]  F. Ingelfinger.  Peer review in biomedical publication. , 1974, The American journal of medicine.

[48]  H. Tuckman,et al.  What Is an Article Worth? , 1975, Journal of Political Economy.

[49]  Daryl E. Chubin,et al.  Competence is Not Enough@@@Peer Review in the National Science Foundation: Phase one of a Study. , 1980 .

[50]  Henry L. Roediger,et al.  Productivity and scholarly impact (citations) of British, Canadian, and U.S. departments of psychology (1975). , 1978 .

[51]  L. Lewis.  Research: Academic Freedom Cases And Their Disposition , 1972 .

[52]  C. Holden.  Not What You Know but Where You're from. , 1980, Science.

[53]  R. Crandall,et al.  Determining Authorships of Scientific Papers , 1978 .

[54]  John J. Siegfried,et al.  A First Lesson in Econometrics , 1970, Journal of Political Economy.

[55]  M. Moore,et al.  Discrimination or Favoritism? Sex Bias in Book Reviews. , 1978 .

[56]  Paul McReynolds,et al.  Reliability of ratings of research papers. , 1971 .

[57]  U. Bronfenbrenner.  Toward an Experimental Ecology of Human Development. , 1977 .

[58]  W. D. Carey.  Peer review revisited. , 1975, Science.

[59]  Jeffrey Pfeffer,et al.  Paradigm Development and Particularism: Journal Publication in Three Scientific Disciplines , 1977 .

[60]  J. Bartko.  The Intraclass Correlation Coefficient as a Measure of Reliability , 1966, Psychological reports.

[61]  J. Scott Armstrong,et al.  Unintelligible Management Research and Academic Prestige , 1980 .

[62]  Daryl E. Chubin,et al.  Research Trails and Science Policies: Local and Extra-Local Negotiation of Scientific Work , 1982 .

[63]  R. Mccall.  Challenges to a science of developmental psychology. , 1977 .

[64]  Daryl E. Chubin,et al.  Peer Review at the NSF: A Dialectical Policy Analysis , 1979 .

[65]  Domenic V. Cicchetti,et al.  Reliability of reviews for the American Psychologist: A biostatistical assessment of the data. , 1980 .

[66]  I. Lakatos,et al.  Criticism and the Growth of Knowledge: Falsification and the Methodology of Scientific Research Programmes , 1970 .

[67]  J. R. Cole,et al.  Chance and consensus in peer review. , 1981, Science.

[68]  R. Crandall.  Interrater agreement on manuscript is not so badp. , 1978 .

[69]  Y. Brackbill,et al.  Journal reviewing practices: Authors' and APA members' suggestions for revision. , 1970 .

[70]  D. Zinberg.  Education Through Science: The Early Stages of Career Development in Chemistry , 1976 .

[71]  R. Roy.  An alternative funding mechanism. , 1981, Science.

[72]  Rick Crandall,et al.  Ps B Lication Notes , 1978 .

[73]  W J Broad,et al.  Fraud and the structure of science. , 1981, Science.

[74]  Leonard D. Goodstein,et al.  Psychology of Scientist: XXX. Credibility of Psychologists: An Empirical Study , 1970 .

[75]  Judith A. Hall.  Author review of reviewers. , 1979 .

[76]  B. Fischhoff,et al.  On the Psychology of Experimental Surprises. , 1977 .

[77]  W. A. Scott,et al.  Interreferee agreement on some characteristics of manuscripts submitted to the Journal of Personality and Social Psychology. , 1974 .

[78]  Janice M. Beyer,et al.  Editorial Policies and Practices Among Leading Journals in Four Scientific Fields , 1977 .

[79]  Leroy Wolins,et al.  Responsibility for Raw Data. , 1962 .

[80]  J. Armstrong.  Advocacy and Objectivity in Science , 1979 .

[81]  S. Kiesler,et al.  Evaluation of the Performance of Women as a Function of Their Sex, Achievement, and Personal History. , 1971 .

[82]  A. Leopold.  The Act of Creation: Creative Processes in Science , 1978 .

[83]  James E. Lovelock,et al.  The View from Mars and Venus , 1977 .

[84]  J. R. Cole,et al.  Peer review and the support of science. , 1977, Scientific American.

[85]  Robert F. Rich,et al.  Who Is Making Science Policy , 1979 .

[86]  C. K. Kumar.  Mark Twain's black hole , 1979 .

[87]  W. Broad.  The publishing game: getting more for less. , 1981, Science.

[88]  L. Debakey,et al.  Letter: Impartial signed reviews. , 1976, The New England journal of medicine.

[89]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[90]  S. Scarr,et al.  The reliability of reviews for the American Psychologist. , 1978 .

[91]  R. Over,et al.  Representation of women on the editorial boards of psychology journals. , 1981 .

[92]  D F Horrobin,et al.  Referees and research administrators: barriers to scientific research? , 1974, British medical journal.

[93]  H. Keselman,et al.  Ratings of psychology journals by members of the American Psychological Association. , 1975 .

[94]  C. Baker,et al.  Commentary: The Double Helix: Science and Myth in the Act of Creation , 1979 .

[95]  W. Yoels.  The Structure of Scientific Fields and the Allocation of Editorships on Scientific Journals: Some Observations on the Politics of Knowledge* , 1974 .

[96]  M. Mahoney,et al.  Review Paper : Psychology of the Scientist: An Evaluative Review , 1979 .

[97]  Julie A. C. Virgo,et al.  A Statistical Procedure for Evaluating the Importance of Scientific Papers , 1977, The Library Quarterly.

[98]  Stuart A. Kirk,et al.  Recognition of Authors in Blind Review of Manuscripts , 1981 .

[99]  Domenic V. Cicchetti,et al.  A Statistical Analysis of Reviewer Agreement and Bias in Evaluating Medical Abstracts 1 , 1976, The Yale journal of biology and medicine.

[100]  R. Merton.  The Matthew Effect in Science , 1968, Science.

[101]  H. M. Collins,et al.  Stages in the Empirical Programme of Relativism , 1981 .

[102]  Timothy D. Wilson,et al.  The halo effect: Evidence for unconscious alteration of judgments. , 1977 .