Market-based recommendation: Agents that compete for consumer attention

The amount of attention space available for recommending suppliers to consumers on e-commerce sites is typically limited. We present a competitive distributed recommendation mechanism based on adaptive software agents for efficiently allocating the "consumer attention space," or banners. In the example of an electronic shopping mall, the task is delegated to the individual shops, each of which evaluates the information that is available about the consumer and his or her interests (e.g. keywords, product queries, and available parts of a profile). Shops make a monetary bid in an auction where a limited amount of "consumer attention space" for the arriving consumer is sold. Each shop is represented by a software agent that bids for each consumer. This allows shops to rapidly adapt their bidding strategy to focus on consumers interested in their offerings. For various basic and simple models for on-line consumers, shops, and profiles, we demonstrate the feasibility of our system by evolutionary simulations as in the field of agent-based computational economics (ACE). We also develop adaptive software agents that learn bidding-strategies, based on neural networks and strategy exploration heuristics. Furthermore, we address the commercial and technological advantages of this distributed market-based approach. The mechanism we describe is not limited to the example of the electronic shopping mall, but can easily be extended to other domains.

[1]  J. A. Poutré,et al.  The influence of evolutionary selection schemes on the iterated prisoner's dilemma , 2001 .

[2]  D. Peppers,et al.  Is your company ready for one-to-one marketing? , 1999, Harvard business review.

[3]  S. Steward,et al.  Multi-agent Trading Environment , 1999 .

[4]  Robert Gellman,et al.  Disintermediation and the internet , 1996 .

[5]  Giorgos Zacharia,et al.  Agent-Mediated Electronic Commerce: An MIT Media Laboratory Perspective , 2000, Int. J. Electron. Commer..

[6]  Alfred Kobsa,et al.  Tailoring Privacy to Users' Needs , 2001, User Modeling.

[7]  Z. John Zhang,et al.  Competitive One-to-One Promotions , 2002, Manag. Sci..

[8]  Nicholas R. Jennings,et al.  Market-Based Call Routing in Telecommunications Networks Using Adaptive Pricing and Real Bidding , 1999, IATA.

[9]  Pattie Maes,et al.  Agent-mediated Electronic Commerce : A Survey , 1998 .

[10]  S. Haeckel About the Nature and Future of Interactive Marketing , 1998 .

[11]  Sander M. Bohte,et al.  An Extensible Agent Architecture for a Competitive Market-Based Allocation of Consumer Attention Space , 2002, AMEC.

[12]  D.D.B. van Bragt,et al.  Generating efficient automata for negotiations – an exploration with evolutionary algorithms , 2001 .

[13]  Michael P. Wellman,et al.  The WALRAS Algorithm: A Convergent Distributed Implementation of General Equilibrium Outcomes , 1998 .

[14]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[15]  Hans M. Amman,et al.  Intermediaries in an Electronic Trade Network , 2003 .

[16]  John Riedl,et al.  Recommender systems in e-commerce , 1999, EC '99.

[17]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[18]  Hal R. Varian,et al.  Economic Mechanism Design for Computerized Agents , 1995, USENIX Workshop on Electronic Commerce.

[19]  William Vickrey,et al.  Counterspeculation, Auctions, And Competitive Sealed Tenders , 1961 .

[20]  S. Clearwater Market-based control: a paradigm for distributed resource allocation , 1996 .

[21]  Leigh Tesfatsion,et al.  Introduction to the CE Special Issue on Agent-Based Computational Economics , 2001 .

[22]  E. H. Gerding,et al.  Equilibrium selection in alternating-offers bargaining models -- the evolutionary computing approach , 2000 .

[23]  Bhpj Bas Vermeer,et al.  Data quality and data alignment in E-business , 2001 .

[24]  Robert J. Kauffman,et al.  Strategies for Internet Middlemen in the Intermediation/Disintermediation/Reintermediation Cycle , 1999, Electron. Mark..

[25]  K. Srinivasan,et al.  Learning About Customers Without Asking , 2002 .

[26]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[27]  Enrico Gerding,et al.  Multi-Issue Negotiation Processes by Evolutionary Simulation, Validation and Social Extensions , 2003 .

[28]  Nicolaas J. Vriend,et al.  Evolving market structure: An ACE model of price dispersion and loyalty , 2001 .

[29]  Sander M. Bohte,et al.  Competitive market-based allocation of consumer attention space , 2001, EC '01.

[30]  Mark E. Nissen,et al.  Agent‐based supply chain disintermediation versus re‐intermediation: economic and technological perspectives , 2000 .

[31]  Nicolaas J. Vriend,et al.  Self-organization of markets: An example of a computational approach , 1995 .

[32]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[33]  Alan L. Montgomery,et al.  Special Issue: OR/MS and E-Business: Applying Quantitative Marketing Techniques to the Internet , 2001, Interfaces.

[34]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[35]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[36]  Jeffrey O. Kephart,et al.  Shopbots and Pricebots , 1999, IJCAI.

[37]  Tom Heskes,et al.  Practical Confidence and Prediction Intervals , 1996, NIPS.

[38]  Robert C. Blattberg,et al.  Interactive Marketing: Exploiting the Age of Addressability , 1991 .

[39]  Hyacinth S. Nwana,et al.  2 Multi-Agent Systems : Promises and Reality , 1999 .

[40]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[41]  Jeffrey O. Kephart,et al.  Dynamic pricing by software agents , 2000, Comput. Networks.

[42]  Jing Zhou,et al.  A Market-Based Recommender System , 2002, AOIS@AAMAS.

[43]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[44]  Hans M. Amman,et al.  Intermediaries in an electronic trade network [Extended Abstract] , 2003, EC '03.

[45]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .