Teaching Replication

Replication is held as the gold standard for ensuring the reliability of published scientific literature. But conducting direct replications is expensive, time-consuming, and unrewarded under current publication practices. So who will do them? The authors argue that students in laboratory classes should replicate recent findings as part of their training in experimental methods. In their own courses, the authors have found that replicating cutting-edge results is exciting and fun; it gives students the opportunity to make real scientific contributions (provided supervision is appropriate); and it provides object lessons about the scientific process, the importance of reporting standards, and the value of openness.

[1]  C. B. Colby The weirdest people in the world , 1973 .

[2]  A. Newell You can't play 20 questions with nature and win : projective comments on the papers of this symposium , 1973 .

[3]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[4]  Avi Hofstein,et al.  The Role of the Laboratory in Science Teaching: Neglected Aspects of Research , 1982 .

[5]  James W. Neuliep,et al.  Editorial bias against replication research. , 1990 .

[6]  James W. Neuliep,et al.  Reviewer bias against replication research. , 1993 .

[7]  Jacob Cohen The earth is round (p < .05) , 1994 .

[8]  Charles S. Madden,et al.  How Journal Editors View Replication Research , 1995 .

[9]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[10]  J. Ridley Studies of Interference in Serial Verbal Reactions , 2001 .

[11]  Rex B. Kline,et al.  Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research , 2004 .

[12]  Michael C. Frank,et al.  Cross-situational Word Learning Respects Mutual Exclusivity , 2009 .

[13]  E. Wagenmakers,et al.  Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011). , 2011, Journal of personality and social psychology.

[14]  Axel Cleeremans,et al.  Behavioral Priming: It's All in the Mind, but Whose Mind? , 2012, PloS one.

[15]  Joshua K. Hartshorne,et al.  Tracking Replicability as a Method of Post-Publication Open Evaluation , 2011, Front. Comput. Neurosci..

[16]  James McHale,et al.  Introduction to the special section. , 2012, Family process.

[17]  Michael C. Frank,et al.  Verbal interference suppresses exact numerical representation , 2011, Cognitive Psychology.

[18]  Stuart J. Ritchie,et al.  Failing the Future: Three Unsuccessful Attempts to Replicate Bem's ‘Retroactive Facilitation of Recall’ Effect , 2012, PloS one.