Complementarity and Diagonal Dominance in Discounted Stochastic Games

We consider discounted stochastic games characterized by monotonicity, supermodularity and diagonal dominance assumptions on the reward functions and the transition law. A thorough novel discussion of the scope and limitations of this class of games is provided. Existence of a Markov-stationary equilibrium for the infinite-horizon game, proved by Curtat (1996), is summarized. Uniqueness of Markov equilibrium and dominance solvability of the finite-horizon game are established. In both cases, the equilibrium strategies and the corresponding value functions are nondecreasing Liptschitz-continuous functions of the state vector. Some specific economic applications are discussed.

[1]  Rabah Amir,et al.  Strategic intergenerational bequests with stochastic convex production , 1996 .

[2]  Susan Athey,et al.  Characterizing Properties of Stochastic Objective Functions , 1998 .

[3]  Annie P. Chittenden,et al.  Substitutes , 1920 .

[4]  Paul R. Milgrom,et al.  Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities , 1990 .

[5]  William R. Perkins,et al.  One-Sector Nonclassical Optimal Growth: Optimality Conditions and Comparative Dynamics , 1991 .

[6]  M. J. Sobel,et al.  Capital accumulation and the optimization of renewable resource models , 1980 .

[7]  Rabah Amir,et al.  Sensitivity analysis of multisector optimal economic dynamics , 1991 .

[8]  Paul R. Milgrom,et al.  Monotone Comparative Statics , 1994 .

[9]  Leonard J. Mirman,et al.  The great fish war: an example using a dynamic Cournot-Nash solution , 2020, Fisheries Economics.

[10]  E. Prescott,et al.  Stochastic Monotonicity and Stationary Distributions for Dynamic Economies , 1992 .

[11]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[12]  Wolfgang Leininger,et al.  The Existence of Perfect Equilibria in a Model of Growth with Altruism between Generations , 1986 .

[13]  Daniel P. Heyman,et al.  Stochastic models in operations research , 1982 .

[14]  A. Federgruen.  On N-person stochastic games by denumerable state space , 1978, Advances in Applied Probability.

[15]  L. Shapley,et al.  Stochastic Games* , 1953, Proceedings of the National Academy of Sciences.

[16]  Leonard J. Mirman,et al.  Optimal economic growth and uncertainty: The discounted case , 1972 .

[17]  R. Sundaram,et al.  Markovian equilibrium in a class of stochastic games: existence theorems for discounted and undiscounted models , 1992 .

[18]  Edwin Hewitt,et al.  Real And Abstract Analysis , 1967 .

[19]  Leonard J. Mirman,et al.  The Compleat Fish Wars: Biological and Dynamic Interactions , 1996 .

[20]  T. Parthasarathy,et al.  Equilibria for discounted stochastic games , 2003 .

[21]  Donald M. Topkis,et al.  Minimizing a Submodular Function on a Lattice , 1978, Oper. Res..

[22]  R. Amir,et al.  Some structured dynamic programs arising in economics , 1992 .

[23]  Leonard J. Mirman,et al.  Externalities, Market Power, and Resource Extraction , 1999 .

[24]  D. M. Topkis.  Equilibrium Points in Nonzero-Sum n-Person Submodular Games , 1979 .

[25]  X. Vives.  Nash equilibrium with strategic complementarities , 1990 .

[26]  Andrzej S. Nowak,et al.  Existence of equilibrium stationary strategies in discounted noncooperative stochastic games with uncountable state space , 1985 .

[27]  김재신,et al.  Externalities , 2022, Managerial Economics.

[28]  On Stochastic Games with Uncountable State and Action Spaces , 1991 .

[29]  Laurent O. Curtat.  Markov Equilibria of Stochastic Games with Complementarities , 1996 .

[30]  Peter A. Diamond,et al.  Aggregate Demand Management in Search Equilibrium , 1982, Journal of Political Economy.

[31]  W. Whitt.  Representation and Approximation of Noncooperative Sequential Games , 1980 .

[32]  Frieda Granot,et al.  Substitutes, Complements and Ripples in Network Flows , 1985, Math. Oper. Res..

[33]  A. Tarski.  A LATTICE-THEORETICAL FIXPOINT THEOREM AND ITS APPLICATIONS , 1955 .

[34]  Debraj Ray,et al.  Economic Growth with Intergenerational Altruism , 1987 .

[35]  S. Athey.  Monotone Comparative Statics under Uncertainty , 2002 .

[36]  D. M. Topkis.  Supermodularity and Complementarity , 1998 .

[37]  Richard F. Serfozo,et al.  Monotone optimal policies for Markov decision processes , 1976 .

[38]  J. Goodman.  Note on Existence and Uniqueness of Equilibrium Points for Concave N-Person Games , 1965 .

[39]  Rabah Amir,et al.  Continuous Stochastic Games of Capital Accumulation with Convex Transitions , 1996 .