Learning from Data: the Role of Error in Statistical Modeling and Inference ∗

A widely held view in economics is that the current untrustworthiness of empirical evidence and the inability to forecast economic phenomena is largely due to the fact that the economy is too complicated and the resulting data are too heterogeneous to be amenable to statistical modeling. The primary objective of this paper is to argue that whether economic data are amenable to statistical modeling is largely an empirical issue and the current untrustworthiness is mainly due to an inadequate implementation of statistical modeling and inference. The latter stems from two main sources: (i) commingling the statistical and substantive premises of inference, and (ii) neglecting the validation of the latter the secures the reliability of inference. It is argued that error statistics, ar efined/extended frequentist perspective, attains learning from data about phenomena of interest by employing reliable and effective procedures to establish trustworthy evidence.

[1]  C. Sims MACROECONOMICS AND REALITY , 1977 .

[2]  Allen S. Mandel Comment … , 1978, British heart journal.

[3]  D. Ricardo On the Principles of Political Economy and Taxation , 1891 .

[4]  David R. Cox,et al.  Role of Models in Statistical Analysis , 1990 .

[5]  M. S. Morgan The History of Econometric Ideas , 1990 .

[6]  Alessandro Roncaglia Statistics and Economics: A Complex Relationship , 2014 .

[7]  Aris Spanos,et al.  Akaike-type criteria and the reliability of inference: Model selection versus statistical model specification , 2010 .

[8]  I. Pen,et al.  Sex Ratios - Concepts and Research Methods , 2002 .

[9]  Aris Spanos,et al.  The simultaneous-equations model revisited: Statistical adequacy and identification , 1990 .

[10]  A. W. Coats,et al.  The Principles of Political Economy and Taxation. , 1935 .

[11]  O. Morgenstern,et al.  On the Accuracy of Economic Observations. , 1950 .

[12]  J. Neyman Outline of a Theory of Statistical Estimation Based on the Classical Theory of Probability , 1937 .

[13]  A. Spanos Econometrics in Retrospect and Prospect , 2005 .

[14]  Statistics for Economists. , 1949 .

[15]  Geert Dhaene,et al.  Probability Theory and Statistical Inference: Econometric Modeling With Observational Data , 2001 .

[16]  A. Spanos Where do statistical models come from? Revisiting the problem of specification , 2006, math/0610849.

[17]  Aris Spanos,et al.  Probability theory and statistical inference: econometric modelling with observational data , 1999 .

[18]  F. C. Mills,et al.  Statistical Methods , 1973 .

[19]  A. Spanos Statistical Misspecification and the Reliability of Inference: The Simple T-Test in the Presence of Markov Dependence , 2009 .

[20]  F. Guala The Methodology of Experimental Economics: Bibliography , 2005 .

[21]  Deborah G. Mayo,et al.  Error and Inference: Recent Exchanges on Experimental Reasoning, Reliability, and the Objectivity and Rationality of Science , 2009 .

[22]  Aris Spanos,et al.  Statistical Foundations of Econometric Modelling , 1986 .

[23]  Deborah G. Mayo,et al.  Methodology in Practice: Statistical Misspecification Testing , 2004, Philosophy of Science.

[24]  J. Mill Principles of Political Economy , 2011, Forerunners of Realizable Values Accounting in Financial Reporting.

[25]  John Stuart Mill,et al.  Essays on Some Unsettled Questions of Political Economy , 1952 .

[26]  Aris Spanos,et al.  The Model Specification Problem from a Probabilistic Reduction Perspective , 2001 .

[27]  Jan Tinbergen,et al.  Statistical testing of business-cycle theories , 1968 .

[28]  E. Fama,et al.  Multifactor Explanations of Asset Pricing Anomalies , 1996 .

[29]  David F. Hendry,et al.  The Foundations of Econometric Analysis , 1995 .

[30]  T. Lai,et al.  Statistical Models and Methods for Financial Markets , 2008 .

[31]  Aris Spanos,et al.  On Rereading Haavelmo: A Retrospective View of Econometric Modeling , 1989, Econometric Theory.

[32]  L. Robbins,et al.  An Essay on the Nature and Significance of Economic Science. , 1934 .

[33]  Deborah G. Mayo,et al.  Error Statistics and Learning from Error: Making a Virtue of Necessity , 1997, Philosophy of Science.

[34]  E. Lehmann Model Specification: The Views of Fisher and Neyman, and Later Developments , 1990 .

[35]  Robert Lundrigan,et al.  What is this thing called OPT , 1986 .

[36]  Aris Spanos,et al.  On theory testing in econometrics : Modeling with nonexperimental data , 1995 .

[37]  Deborah G. Mayo,et al.  Error and the Growth of Experimental Knowledge , 1996 .

[38]  Deborah G. Mayo,et al.  Novel Evidence and Severe Tests , 1991, Philosophy of Science.

[39]  Deborah G. Mayo,et al.  PHILOSOPHY OF STATISTICS. , 1979 .

[40]  A. F. Chalmers,et al.  What Is This Thing Called Science , 1976 .

[41]  A. Spanos The Pre-Eminence of Theory versus the European CVAR Perspective in Macroeconometric Modeling , 2009 .

[42]  A. Spanos Revisiting data mining: ‘hunting’ with or without a license , 2000 .

[43]  T. Haavelmo,et al.  The Probability Approach in Econometrics , 1944 .

[44]  Rory A. Fisher,et al.  Theory of Statistical Estimation , 1925, Mathematical Proceedings of the Cambridge Philosophical Society.

[45]  Daniel M. Hausman,et al.  The Inexact and Separate Science of Economics , 1993 .

[46]  R. Allen,et al.  Statistical Confluence Analysis by means of Complete Regression Systems , 1935 .

[47]  U. Mäki The Methodology of Positive Economics: Reflections On The Milton Friedman Legacy , 2009 .

[48]  B. M. Pötscher,et al.  MODEL SELECTION AND INFERENCE: FACTS AND FICTION , 2005, Econometric Theory.

[49]  E. S. Pearson,et al.  On the Problem of the Most Efficient Tests of Statistical Hypotheses , 1933 .

[50]  H. Levy The Capital Asset Pricing Model in the 21st Century: Analytical, Empirical, and Behavioral Perspectives , 2011 .

[51]  Ivan A. Boldyrev,et al.  Economic methodology: understanding economics as a science , 2011 .

[52]  D. Mayo,et al.  Severe Testing as a Basic Concept in a Neyman–Pearson Philosophy of Induction , 2006, The British Journal for the Philosophy of Science.

[53]  R. Frisch Statistical confluence analysis by means of complete regression systems , 1934 .

[54]  Jeffrey M. Wooldridge,et al.  Introductory Econometrics: A Modern Approach , 1999 .

[55]  Aris Spanos,et al.  Revisiting the omitted variables argument: Substantive vs. statistical adequacy , 2006 .

[56]  Uskali Mäki The Methodology of Positive Economics , 2009 .

[57]  J. Keynes Professor Tinbergen’s Method , 2007 .

[58]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[60]  Aris Spanos,et al.  A frequentist interpretation of probability for model-based inductive inference , 2011, Synthese.

[61]  Richmond Mayo-Smith Statistics and Economics , 2009 .

[62]  A. N. Kolmogorov,et al.  Foundations of the theory of probability , 1960 .

[63]  David F. Hendry,et al.  Econometrics-Alchemy or Science? , 1980 .

[64]  Aris Spanos,et al.  Curve Fitting, the Reliability of Inductive Inference, and the Error‐Statistical Approach , 2007, Philosophy of Science.

[65]  J. Doob Stochastic processes , 1953 .

[66]  A. Spanos Error and Inference: Theory Testing in Economics and the Error-Statistical Perspective , 2009 .

[67]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[68]  E. Lehmann Testing Statistical Hypotheses , 1960 .