Autonomic Query Allocation based on Microeconomics Principles

In large federations of autonomous database systems, automatic distribution of the query workload to those systems is a critical issue. We examine this problem under the perspective of microeconomics theory and show how the latter can be used to construct an efficient decentralized mechanism that maximizes system throughput. In particular, we introduce a solution that is based on the notion of query markets. We examine the properties of these markets and show that they result in Pareto-optimal allocations of resources to queries. An extensive set of experiments with both a simulator and an actual implementation on top of a commercial DBMS demonstrate significant improvements in the overall system throughput when our technique is used.

[1]  Roger Barga,et al.  Proceedings of the 22nd International Conference on Data Engineering Workshops, ICDE 2006, 3-7 April 2006, Atlanta, GA, USA , 2006, ICDE Workshops.

[2]  Michael Mitzenmacher,et al.  How Useful Is Old Information? , 2000, IEEE Trans. Parallel Distributed Syst..

[3]  Donald Francis Ferguson,et al.  The application of microeconomics to the design of resource allocation and control algorithms , 1989 .

[4]  Yannis E. Ioannidis,et al.  Query optimization in distributed networks of autonomous database systems , 2006, TODS.

[5]  E. J. Smith,et al.  Stochastic query optimization in distributed databases , 1993, TODS.

[6]  Hongjun Lu,et al.  Load Balancing in a Locally Distributed Database System , 1986, SIGMOD Conference.

[7]  Katharine Rockett Microeconomics, 3rd edition, David Besanko, Ronald R. Braeutigam, Study guide , 2008 .

[8]  Yannis E. Ioannidis,et al.  Distributed Query Optimization by Query Trading , 2004, EDBT.

[9]  A. Mukherji Competitive Equilibria: Convergence, Cycles or Chaos , 2003 .

[10]  Hongjun Lu,et al.  Dynamic Task Allocation in a Distributed Database System , 1985, ICDCS.

[11]  Michael Stonebraker,et al.  Mariposa: a wide-area distributed database system , 1996, The VLDB Journal.

[12]  Donald F. Ferguson,et al.  Economic models for allocating resources in computer systems , 1996 .

[13]  Hirofumi Yamaki,et al.  Market-Based Network Resource Allocation with Non-tâtonnement Process , 2000, PRIMA.

[14]  A. Mas-Colell,et al.  Microeconomic Theory , 1995 .

[15]  Gerhard Weikum,et al.  Rethinking Database System Architecture: Towards a Self-Tuning RISC-Style Database System , 2000, VLDB.