Two-Sided Learning in an Agent Economy for Information Bundles

Commerce in information goods is one of the earliest emerging applications for intelligent agents in commerce. However, the fundamental characteristics of information goods mean that they can and likely will be offered in widely varying configurations. Participating agents will need to deal with uncertainty about both prices and location in multi-dimensional product space. Thus, studying the behavior of learning agents is central to understanding and designing for agent-based information economies. Since uncertainty will exist on both sides of transactions, and interactions between learning agents that are negotiating and transacting with other learning agents may lead to unexpected dynamics, it is important to study two-sided learning. We present a simple but powerful model of an information bundling economy with a single producer and multiple consumer agents. We explore the pricing and purchasing behavior of these agents when articles can be bundled. In this initial exploration, we study the dynamics of this economy when consumer agents are uninformed about the distribution of article values. We discover that a reasonable albeit nave consumer learning strategy can lead to disastrous market behavior. We find a simple explanation for this market failure, and develop a simple improvement to the producer agent's strategy that largely ameliorates the problem. But in the process we learn an important lesson: dynamic market interactions when there is substantial uncertainty can lead to pathological outcomes if agents are designed with "reasonable" but not sufficiently adaptive strategies. Thus, in programmed agent environments it may be essential to dramatically increase our understanding of adaptivity and learning if we want to obtain good aggregate outcomes.

[1]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[2]  W. Oi A Disneyland Dilemma: Two-Part Tariffs for a Mickey Mouse Monopoly , 1971 .

[3]  Y. Shilony Mixed pricing in oligopoly , 1977 .

[4]  J. Stiglitz,et al.  Bargains and Ripoffs: A Model of Monopolistically Competitive Price Dispersion , 1977 .

[5]  H. Varian A Model of Sales , 1980 .

[6]  William H. Press,et al.  Numerical Recipes in FORTRAN - The Art of Scientific Computing, 2nd Edition , 1987 .

[7]  N. L. Johnson,et al.  Continuous Univariate Distributions. , 1995 .

[8]  A. Mas-Colell,et al.  Microeconomic Theory , 1995 .

[9]  Jeffrey K. MacKie-Mason,et al.  Some Economics of the Internet , 2007 .

[10]  Margaret H. Wright,et al.  Direct search methods: Once scorned, now respectable , 1996 .

[11]  Ilya Segal,et al.  Solutions manual for Microeconomic theory : Mas-Colell, Whinston and Green , 1997 .

[12]  Virginia Torczon,et al.  On the Convergence of Pattern Search Algorithms , 1997, SIAM J. Optim..

[13]  Yannis Bakos,et al.  Bundling Information Goods: Pricing, Profits and Efficiency , 1998 .

[14]  James E. Hanson,et al.  Price-war dynamics in a free-market economy of software agents , 1998 .

[15]  James E. Hanson,et al.  Spontaneous Specialization in a Free-Market Economy of Agents , 1998 .

[16]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[17]  Jeffrey O. Kephart,et al.  Price and Niche Wars in a Free-Market Economy of Software Agents , 1997, Artificial Life.

[18]  K. I. M. McKinnon,et al.  Convergence of the Nelder-Mead Simplex Method to a Nonstationary Point , 1998, SIAM J. Optim..

[19]  Edmund H. Durfee,et al.  Learning nested agent models in an information economy , 1998, J. Exp. Theor. Artif. Intell..

[20]  Edmund H. Durfee,et al.  The moving target function problem in multi-agent learning , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[21]  Jeffrey O. Kephart,et al.  Dynamics of an Information-Filtering Economy , 1998, CIA.

[22]  Jeffrey K. MacKie-Mason,et al.  Competition Between Firms that Bundle Information Goods , 1999 .

[23]  Edmund H. Durfee,et al.  Automated strategy searches in an electronic goods market: learning and complex price schedules , 1999, EC '99.

[24]  Paul Tseng,et al.  Fortified-Descent Simplicial Search Method: A General Approach , 1999, SIAM J. Optim..

[25]  H. Varian,et al.  Network Delivery of Information Goods: Optimal Pricing of Articles and Subscriptions , 2000 .