Replication in Economics

This examination of the role and potential for replication in economics points out the paucity of both pure replication -- checking on others' published papers using their data -- and scientific replication -- using data representing different populations in one's own work or in a Comment. Several controversies in empirical economics illustrate how and how not to behave when replicating others' work. The incentives for replication facing editors, authors and potential replicators are examined. Recognising these incentives, I advance proposals aimed at journal editors that will increase the supply of replication studies, and I propose a way of generating more scientific replication that will make empirical economic research more credible.

[1]  Jerry G. Thursby,et al.  Replication in Empirical Economics: The Journal of Money, Credit and Banking Project , 1986 .

[2]  Jesse M. Rothstein.  Does Competition Among Public Schools Benefit Students and Taxpayers? A Comment on Hoxby (2000) , 2004 .

[3]  B. Bernanke,et al.  Conducting Monetary Policy at Very Low Short-Term Interest Rates , 2004 .

[4]  Edward E. Leamer,et al.  Let's Take the Con Out of Econometrics , 1983 .

[5]  David Card,et al.  Minimum Wages and Employment: A Case Study of the Fast Food Industry in New Jersey and Pennsylvania , 1993 .

[6]  James B. Boyer,et al.  Editorial statement , 2003, Nature.

[7]  D. Hamermesh.  Some thoughts on replications and reviews , 1997 .

[8]  C. Hoxby,et al.  Appendices to : “ Does Competition among Public Schools Benefit Students and Taxpayers ? , 2004 .

[9]  D. Leimer,et al.  Social Security and Private Saving: New Time-Series Evidence , 1982, Journal of Political Economy.

[10]  D. Hamermesh,et al.  Beauty and the Labor Market , 1993 .

[11]  David Roodman,et al.  Aid, Policies, and Growth: Comment , 2004 .

[12]  F. Steele.  The Baltimore Case , 1999, Nature Medicine.

[13]  Kevin Lang,et al.  Are all Economic Hypotheses False? , 1992, Journal of Political Economy.

[14]  M. Feldstein,et al.  Social Security, Induced Retirement, and Aggregate Capital Accumulation , 1974, Journal of Political Economy.

[15]  J. Behrman,et al.  Does Increasing Women's Schooling Raise the Schooling of the Next Generation? , 2005 .

[16]  Glenn Ellison.  The Slowdown of the Economics Publishing Process , 2000 .

[17]  Peter Schmidt,et al.  The determinants of econometric society fellows elections , 2003 .

[18]  H. Vinod,et al.  Verifying the Solution from a Nonlinear Solver: A Case Study , 2004 .

[19]  R. Lensink,et al.  Aid, policies, and growth: Reply , 2004 .

[20]  D. Dollar,et al.  Aid, Policies, and Growth , 1997 .

[21]  Jesse Rothstein.  Does Competition Among Public Schools Benefit Students and Taxpayers? Comment , 2007 .

[22]  John E. Hunter,et al.  The Desperate Need for Replications , 2001 .

[23]  M. Feldstein,et al.  Social Security and Private Saving: Reply , 1982, Journal of Political Economy.