Model Specification: The Views of Fisher and Neyman, and Later Developments

Since Fisher’s formulation in 1922 of a framework for theoretical statistics, statistical theory has been concerned primarily with the derivation and properties of suitable statistical procedures on the basis of an assumed statistical model (including sensitivity to deviations from this model). Until relatively recently, the theory has paid little attention to the question of how such a model should be chosen. In the present paper, we consider first what Fisher and Neyman had to say about this problem and in Section 2 survey some contributions statistical theory has made to it. In Section 3 we study a distinction between two types of models (empirical and explanatory) which has been discussed by Neyman, Box, and others. A concluding section considers some lines of further work.

[1]  P. Laplace A Philosophical Essay On Probabilities , 1902 .

[2]  Zur Logik und Naturphilosophie der Wahrscheinlichkeitslehre : ein umfassender Lösungsversuch , 1911 .

[3]  Die Iterationen : ein Beitrag zur Wahrscheinlichkeitstheorie , 1917 .

[4]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[5]  Die philosophischen Grundlagen der Wahrscheinlichkeitsrechnung , 1923 .

[6]  Student Errors of Routine Analysis , 1927 .

[7]  Jerzy Neyman,et al.  On a New Class of "Contagious" Distributions, Applicable in Entomology and Bacteriology , 1939 .

[8]  吉原 友吉,et al.  J. Neyman : On a new class of "contagious" distributions applicable in Entomology and Bacteriology, Ann. Math. Statistics, 10(1939) 35-57. , 1941 .

[9]  W. Feller On a General Class of "Contagious" Distributions , 1943 .

[10]  K. Maccorquodale,et al.  On a distinction between hypothetical constructs and intervening variables. , 1948, Psychological review.

[11]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[12]  J. Neyman,et al.  Stochastic models of population dynamics. , 1959, Science.

[13]  Jerzy Neyman,et al.  Stochastic Models of Population Dynamics A few simple chance mechanisms may combine to reproduce many manifestations of a complex phenomenon , 1959 .

[14]  S. Toulmin,et al.  Foresight And Understanding , 1961 .

[15]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[16]  K. Popper,et al.  Conjectures and Refutations , 1963 .

[17]  K. Popper,et al.  Conjectures and refutations;: The growth of scientific knowledge , 1972 .

[18]  W. G. Hunter,et al.  The Experimental Study of Physical Mechanisms , 1965 .

[19]  Robert Olby,et al.  Origins of Mendelism , 1966 .

[20]  William J. Hill,et al.  Discrimination Among Mechanistic Models , 1967 .

[21]  P. A. P. Moran,et al.  An introduction to probability theory , 1968 .

[22]  W. G. Cochran Errors of Measurement in Statistics , 1968 .

[23]  J. Dobrzycki,et al.  "Three Copernican Treatises", Edward Rosen, New York 1971 : [recenzja] / Jerzy Dobrzycki. , 1973 .

[24]  Kepler : four hundred years : proceedings of conferences held in honour of Johannes Kepler , 1975 .

[25]  N. Singpurwalla,et al.  Methods for Statistical Analysis of Reliability and Life Data. , 1975 .

[26]  H. Tong Determination of the order of a Markov chain by Akaike's information criterion , 1975, Journal of Applied Probability.

[27]  E. Aiton 10.5. The elliptical orbit and the area law , 1975 .

[28]  Curtis A. Wilson 10.7. Kepler's ellipse and area rule—their derivation from fact and conjecture , 1975 .

[29]  R. Goldstein Reality and Models: Difficulties Associated with Applying General Ecological Models to Specific Situations , 1977 .

[30]  Daniel L. Solomon,et al.  Mathematical models in biological discovery. , 1977 .

[31]  S. Addelman Statistics for experimenters , 1978 .

[32]  M. J. R. Healy,et al.  Is Statistics a Science , 1978 .

[33]  J. Kingman Uses of Exchangeability , 1978 .

[34]  R. Shibata An optimal selection of regression variables , 1981 .

[35]  Gérard Letac Isotropy and Sphericity: Some Characterisations of the Normal Distribution , 1981 .

[36]  R. Katz On Some Criteria for Estimating the Order of a Markov Chain , 1981 .

[37]  N. Cartwright How the laws of physics lie , 1984 .

[38]  D. Freedman,et al.  How Many Variables Should Be Entered in a Regression Equation , 1983 .

[39]  J. Ghosh,et al.  Statistics : applications and new directions , 1984 .

[40]  O. D. Anderson,et al.  The Forecasting accuracy of major time series methods , 1984 .

[41]  Stanley Lieberson,et al.  Making It Count: The Improvement of Social Research and Theory , 1987 .

[42]  Alexander Rosenberg,et al.  The structure of biological science , 1986 .

[43]  Jozef W.M. van Doorn BookForecasting accuracy of major time series methods: S. Makridakis, A. Andersen, R. Carbone, R. Fildes et al 301 pages, £19.50 (Chichester, John Wiley, 1984) , 1985 .

[44]  David A. Freedman,et al.  Statistics and the Scientific Method , 1985 .

[45]  A. Tversky,et al.  The hot hand in basketball: On the misperception of random sequences , 1985, Cognitive Psychology.

[46]  Robert L. Winkler,et al.  The Forecasting accuracy of major time series methods , 1986 .

[47]  I. Hacking,et al.  Representing and Intervening. , 1986 .

[48]  N. Jardine The fortunes of inquiry , 1986 .

[49]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[50]  J. A. Nelder,et al.  Statistics, Science and Technology , 1986 .

[51]  A modified Hannan—Rissanen strategy for mixed autoregressive-moving average order determination , 1987 .

[52]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[53]  D. Edwards,et al.  A fast model selection procedure for large families of models , 1987 .

[54]  R. M. Wallace,et al.  The Genesis of the Copernican World. , 1987 .

[55]  Stephen M. Stigler The History of Statistics: The Measurement of Uncertainty before 1900 , 1986 .

[56]  D. Freedman As Others See Us: A Case Study in Path Analysis , 1987 .

[57]  Herbert A. Simon,et al.  Scientific discovery: compulalional explorations of the creative process , 1987 .

[58]  William Kruskal,et al.  Miracles and Statistics: The Casual Assumption of Independence , 1988 .

[59]  Robert Hooke,et al.  Basketball, Baseball, and the Null Hypothesis , 1989 .

[60]  Thomas Gilovich,et al.  The Cold Facts about the “Hot Hand” in Basketball , 1989 .

[61]  Joseph B. Kadane,et al.  It's Okay to Believe in the “Hot Hand” , 1989 .

[62]  Thomas Gilovich,et al.  The “Hot Hand”: Statistical Reality or Cognitive Illusion? , 1989 .

[63]  Alan J. Miller How many variables , 1990 .