Long-term causal effects of interventions in multiagent economic mechanisms

The effect of an intervention in an economic mechanism, for example an increase in the reserve price of an auction, is causal if the observed effect is better than the counterfactual, i.e., the effect that would be observed under no intervention. As mechanisms are populated by dynamical systems of interacting agents, their response to an intervention fluctuates until the system reaches a new equilibrium. Effects measured in the new equilibrium, the long-term causal effects, are more representative of the value of interventions. However, the statistical estimation of long-term causal effects is difficult because it has to rely, for practical reasons, on data observed before the new equilibrium is reached. Furthermore, agent actions do not only depend on the mechanism that the agents are situated in but also on the behavior of others, which complicates the causal evaluation. In this paper, we formalize this problem of estimating long-term causal effects under the potential outcomes framework of causal inference \cite{neyman1923, rubin74}. We develop an estimation method that relies on a data augmentation strategy, where agents are assumed to adopt, at each timepoint, a behavior that is latent. This allows us to leverage existing work in behavioral game theory and time-series analysis of compositional data. Our method identifies the long-term causal effects under a set of assumptions that we formulate explicitly. We illustrate our method on a dataset from a real-world behavioral experiment, and discuss open problems to stimulate future research.

[1]  Jon M. Kleinberg,et al.  Graph cluster randomization: network exposure to multiple universes , 2013, KDD.

[2]  J. I The Design of Experiments , 1936, Nature.

[3]  Denver Dash,et al.  Restructuring Dynamic Causal Systems in Equilibrium , 2005, AISTATS.

[4]  Kevin Leyton-Brown,et al.  Beyond equilibrium: predicting human behaviour in normal form games , 2010, AAAI.

[5]  A. Rapoport,et al.  Mixed strategies in strictly competitive games: A further test of the minimax hypothesis , 1992 .

[6]  Stephen G. Donald,et al.  Inference with Difference-in-Differences and Other Panel Data , 2007, The Review of Economics and Statistics.

[7]  Jonathan Lawry,et al.  Symbolic and Quantitative Approaches to Reasoning with Uncertainty , 2009 .

[8]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[9]  John Aitchison,et al.  The Statistical Analysis of Compositional Data , 1986 .

[10]  David Card,et al.  Minimum Wages and Employment: A Case Study of the Fast Food Industry in New Jersey and Pennsylvania , 1993 .

[11]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[12]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .

[13]  Jonathan D. Levin,et al.  Comparing Open and Sealed Bid Auctions: Evidence from Timber Auctions , 2008 .

[14]  T. Speed,et al.  On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9 , 1990 .

[15]  Steven L. Scott,et al.  Inferring causal impact using Bayesian structural time-series models , 2015, 1506.00356.

[16]  Joaquin Quiñonero Candela,et al.  Counterfactual reasoning and learning systems: the example of computational advertising , 2012, J. Mach. Learn. Res..

[17]  D. Stahl,et al.  Experimental evidence on players' models of other players , 1994 .

[18]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[19]  A. Raftery,et al.  Time Series of Continuous Proportions , 1993 .

[20]  Edward K. Kao,et al.  Estimation of Causal Peer Influence Effects , 2013, ICML.

[21]  Marek J. Druzdzel,et al.  Caveats for Causal Reasoning with Equilibrium Models , 2001, ECSQARU.

[22]  J. Holland,et al.  Artificial Adaptive Agents in Economic Theory , 1991 .

[23]  Alberto Abadie Semiparametric Difference-in-Differences Estimators , 2005 .

[24]  Lance Lochner,et al.  General Equilibrium Treatment Effects: A Study of Tuition Policy , 1998 .

[25]  Michael Ostrovsky,et al.  Reserve Prices in Internet Advertising Auctions: A Field Experiment , 2009, Journal of Political Economy.