The Design of Replicated Studies

Abstract Replication is little discussed in the statistical literature nor practiced widely by statistically minded researchers. It is needed not merely to validate one's findings, but more importantly, to establish the increasing range of radically different conditions under which the findings hold, and the predictable exceptions. This article describes how to design highly differentiated replications. The irrelevance and/or impossibility of identical replications are also discussed. Practical illustrations of the success and failure of replicated studies are given.

[1]  K. Popper,et al.  The Logic of Scientific Discovery , 1960 .

[2]  R. A. Fisher,et al.  Design of Experiments , 1936 .

[3]  E. S. Pearson.  WILLIAM SEALY GOSSET, 1876-1937(2) “STUDENT” AS STATISTICIAN , 1939 .

[4]  E. S. Pearson.  "Student" as Statistician , 1939 .

[5]  W. Edwards Deming,et al.  Some Theory of Sampling , 1950 .

[6]  W. Edwards Deming.  Some theory of sampling , 1951 .

[7]  Frank Yates,et al.  The Influence of Statistical Methods for Research Workers on the Development of the Science of Statistics , 1951 .

[8]  R. Mack.  The Need for Replication Research in Sociology , 1951 .

[9]  M. Kendall,et al.  The Logic of Scientific Discovery. , 1959 .

[10]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[11]  Andrew Ehrenberg.  LAWS IN MARKETING: A TAIL-PIECE* , 1966 .

[12]  D. Lykken.  Statistical significance in psychological research. , 1968, Psychological bulletin.

[13]  D. Campbell.  Reforms as experiments , 1969 .

[14]  TESTS OF SIGNIFICANCE—II , 1969 .

[15]  G. William Walster,et al.  A Proposal for a New Editorial Policy in the Social Sciences , 1970 .

[16]  Nathaniel C. Smith.  Replication studies: A neglected aspect of psychological research. , 1970 .

[17]  J. Ravetz.  Scientific Knowledge and Its Social Problems , 2020 .

[18]  Bernard M. Finifter.  The Generation of Confidence: Evaluating Research Findings by Random Subsample Replication , 1972 .

[19]  A. Hopwood.  An Empirical Study of the Role of Accounting Data in Performance Evaluation , 1972 .

[20]  Robert Rosenthal,et al.  Experimenter effects in behavioral research, Enlarged ed. , 1976 .

[21]  W E Deming,et al.  On probability as a basis for action. , 1975, Methods of information in medicine. Supplement.

[22]  S. Kerr,et al.  Manuscript Characteristics Which Influence Acceptance for Management and Social Science Journals , 1977 .

[23]  R. Rosenthal,et al.  Experimenter effects in behavioral research , 1968 .

[24]  O Kempthorne,et al.  Logical, epistemological and statistical aspects of nature-nurture data interpretation. , 1978, Biometrics.

[25]  D. Otley.  BUDGET USE AND MANAGERIAL PERFORMANCE , 1978 .

[26]  N. Denzin,et al.  The Research Act , 1978 .

[27]  R. P. Carver.  The Case Against Statistical Significance Testing , 1978 .

[28]  Thomas J. Zenisek,et al.  Manuscript characteristics influencing reviewers' decisions. , 1980 .

[29]  J. Z. Young,et al.  Great scientific experiments , 1982, Medical History.

[30]  D. Cox,et al.  Statistical significance tests. , 1982, British journal of clinical pharmacology.

[31]  M. Hirst.  RELIANCE ON ACCOUNTING PERFORMANCE-MEASURES, TASK UNCERTAINTY, AND DYSFUNCTIONAL BEHAVIOR - SOME EXTENSIONS , 1983 .

[32]  Harold Maurice Collins,et al.  When do scientists prefer to vary their experiments , 1984 .

[33]  V. Govindarajan.  Appropriateness of accounting data in performance evaluation: An empirical examination of environmental uncertainty as an intervening variable☆ , 1984 .

[34]  Susan Leigh Star,et al.  Changing Order: Replication and Induction in Scientific Practice by H. M. Collins (review) , 1988, Technology and Culture.

[35]  M. Mahoney,et al.  Open exchange and epistemic progress. , 1985 .

[36]  Peter. Brownell.  Budgetary Systems And The Control Of Functionally Differentiated Organizational Activities , 1985 .

[37]  Louis Guttman,et al.  The Illogic of Statistical Inference for Cumulative Science , 1984 .

[38]  D. Johnstone,et al.  Tests of Significance in Theory and Practice , 1986 .

[39]  J. A. Nelder,et al.  Statistics, Science and Technology , 1986 .

[40]  M. Mulkay,et al.  Replication and Mere Replication , 1986 .

[41]  M. Oakes.  Statistical Inference: A Commentary for the Social and Behavioural Sciences , 1986 .

[42]  Peter Brownell,et al.  Reliance on Accounting Information, Budgetary Participation, and Task Uncertainty: Tests of a Three-Way Interaction , 1986 .

[43]  Gerd Gigerenzer,et al.  Probabilistic thinking and the fight against subjectivity , 1987 .

[44]  John Beatty,et al.  The Empire of Chance: How Probability Changed Science and Everyday Life , 1989 .

[45]  Andrew Ehrenberg,et al.  A Hope for the Future of Statistics: MSOD , 1990 .

[46]  A S C Ehrenberg,et al.  Generalising a Pricing Effect , 1990 .

[47]  Kenneth W. Wachter,et al.  The Future of Meta-Analysis , 1991 .

[48]  M. Hersen.  Single case experimental designs , 1992 .

[49]  A. Ehrenberg,et al.  Predictability and prediction , 1993 .

[50]  M. Uncles,et al.  A replication study of two brand-loyalty measures , 1994 .