Should you choose to do so...: A replication paradigm

This note introduces the concept of the replication paradigm, a framework that can (and should) be followed in every replication attempt. The paradigm expands, in part, on Bruce McCullough's well-known paraphrase of Berkeley computer scientist Jon Claerbout's insight - "An applied economics article is only the advertising for the data and code that produced the results" - and on the view that the primary social and scientific value of replication is to measure the scientific contribution of the inferences in an empirical study. The paradigm has four steps. First, in the "candidate study," identify and state clearly the hypotheses advanced by the study's authors. Second, provide a clear statement of the authors' econometric methods. Third, discuss the data. Fourth, discuss the authors' statistical inference. The author's purpose in this ordering is to reverse the too-frequent focus in the replication literature on "data." The correct data, of course, are critical to the replication. But "replication" as a scientific endeavor will never achieve respectability unless and until it abandons a narrow focus on data and expands its focus to the underlying scientific inferences.

[1]  G. Waters,et al.  Interest rate pass through and asymmetric adjustment: evidence from the federal funds rate operating target period , 2008 .

[2]  D. Hamermesh Viewpoint: Replication in Economics , 2007 .

[3]  D. Hamermesh Replication in Labor Economics: Evidence from Data, and What it Suggests , 2017, SSRN Electronic Journal.

[4]  J. Brooks Why most published research findings are false: Ioannidis JP, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece , 2008 .

[5]  Campbell R. Harvey,et al.  Presidential Address: The Scientific Outlook in Financial Economics , 2017 .

[6]  Marjorie Moulet A Symbolic Algorithm for Computing Coefficients' Accuracy in Regression , 1992, ML.

[7]  Peter Schmidt,et al.  The Theory and Practice of Econometrics , 1985 .

[8]  Janice M. Morse,et al.  The Role of Data , 1999 .

[9]  E. Miguel,et al.  Transparency, Reproducibility, and the Credibility of Economics Research , 2016, Journal of Economic Literature.

[10]  E. Lehmann Testing Statistical Hypotheses , 1960 .

[11]  W. Robert Reed,et al.  What Is Meant by "Replication" and Why Does It Encounter Resistance in Economics? , 2016 .

[12]  James W. Longley An Appraisal of Least Squares Programs for the Electronic Computer from the Point of View of the User , 1967 .

[13]  Paul J. Gertler,et al.  Incentives for Replication in Economics , 2017 .

[14]  Donald B. Rubin,et al.  THE ACCEPTABILITY OF REGRESSION SOLUTIONS: ANOTHER LOOK AT COMPUTATIONAL ACCURACY , 1972 .

[15]  Hrishikesh D. Vinod,et al.  The Role of Data and Program Code Archives in the Future of Economic Research , 2005 .

[16]  A. Saunders,et al.  The Growth of Organizational Forms of Foreign Banks in the U.S.: A Note , 1981 .

[17]  Bruce E. Hansen,et al.  Residual-based tests for cointegration in models with regime shifts , 1996 .