Settable Systems: An Extension of Pearl's Causal Model with Optimization, Equilibrium, and Learning

Judea Pearl's Causal Model is a rich framework that provides deep insight into the nature of causal relations. As yet, however, the Pearl Causal Model (PCM) has had a lesser impact on economics or econometrics than on other disciplines. This may be due in part to the fact that the PCM is not as well suited to analyzing structures that exhibit features of central interest to economists and econometricians: optimization, equilibrium, and learning. We offer the settable systems framework as an extension of the PCM that permits causal discourse in systems embodying optimization, equilibrium, and learning. Because these are common features of physical, natural, or social systems, our framework may prove generally useful for machine learning. Important features distinguishing the settable system framework from the PCM are its countable dimensionality and the use of partitioning and partition-specific response functions to accommodate the behavior of optimizing and interacting agents and to eliminate the requirement of a unique fixed point for the system. Refinements of the PCM include the settable systems treatment of attributes, the causal role of exogenous variables, and the dual role of variables as causes and responses. A series of closely related machine learning examples and examples from game theory and machine learning with feedback demonstrates some limitations of the PCM and motivates the distinguishing features of settable systems.

[1]  Michael Eichler,et al.  Causal Reasoning in Graphical Time Series Models , 2007, UAI.

[2]  R. Gibbons Game theory for applied economists , 1992 .

[3]  Daphne Koller,et al.  Multi-Agent Influence Diagrams for Representing and Solving Games , 2001, IJCAI.

[4]  Bill Shipley,et al.  Cause and Correlation in Biology: A User''s Guide to Path Analysis , 2016 .

[5]  A. Dawid Influence Diagrams for Causal Modelling and Inference , 2002 .

[6]  H. Robbins A Stochastic Approximation Method , 1951 .

[7]  Halbert White,et al.  Time-series estimation of the effects of natural experiments , 2006 .

[8]  Y. Sergeyev,et al.  Parallel Asynchronous Global Search and the Nested Optimization Scheme , 2001 .

[9]  P. Kumar,et al.  Theory and practice of recursive identification , 1985, IEEE Transactions on Automatic Control.

[10]  F. Fisher A Correspondence Principle for Simultaneous Equation Models , 1970 .

[11]  H. White,et al.  Independence and Conditional Independence in Causal Systems , 2007 .

[12]  S. Huffel,et al.  Total Least Squares and Errors-in-Variables Modeling : Analysis, Algorithms and Applications , 2002 .

[13]  P. Holland Statistics and Causal Inference , 1985 .

[14]  Illtyd Trethowan Causality , 1938 .

[15]  Michael I. Jordan Constrained supervised learning , 1992 .

[16]  Xiaohong Chen,et al.  Nonparametric Adaptive Learning with Feedback , 1998 .

[17]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[18]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[19]  R. H. Strotz,et al.  RECURSIVE VS. NONRECURSIVE SYSTEMS: AN ATTEMPT AT SYNTHESIS (PART I OF A TRIPTYCH ON CAUSAL CHAIN SYSTEMS) , 1960 .

[20]  Ross D. Shachter,et al.  Decision-Theoretic Foundations for Causal Reasoning , 1995, J. Artif. Intell. Res..

[21]  Bill Shipley,et al.  Book Review of Causality: Models, Reasoning, and Inference , 2000 .

[22]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[23]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[24]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[25]  Joseph Y. Halpern Axiomatizing Causal Reasoning , 1998, UAI.

[26]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[28]  H. White Retrospective Estimation of Causal E¤ects Through Time , 2007 .

[29]  Dan Geiger,et al.  Identifying independence in bayesian networks , 1990, Networks.

[30]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[31]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[32]  David Cox,et al.  Applied Statistics - Principles and Examples , 1981 .

[33]  Kurt Hornik,et al.  A Convergence Result for Learning in Recurrent Neural Networks , 1994, Neural Computation.

[34]  H. White,et al.  An Extended Class of Instrumental Variables for the Estimation of Causal Effects , 2011 .

[35]  Susanne M. Schennach,et al.  Estimating average marginal effects in nonseparable structural systems , 2007 .

[36]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[37]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[38]  H. White Asymptotic theory for econometricians , 1985 .

[39]  M. Peruggia Total Least Squares and Errors-in-Variables Modeling: Analysis, Algorithms and Applications , 2003 .