Overlay network resource allocation using a decentralized market-based approach

We present a decentralized market-based approach to resource allocation in a heterogeneous overlay network. This resource allocation strategy dynamically assigns resources in an overlay network to requests for service based on current system utilization, thus enabling the system to accommodate fluctuating demand for its resources. Our approach is based on a mathematical model of this resource allocation environment that treats the allocation of system resources as a constrained optimization problem. From the solution to the dual of this optimization problem, we derive a simple decentralized algorithm that is extremely efficient. Our results show the near optimality of the proposed approach through extensive simulation of this overlay network environment. The simulation study utilizes components taken from a real-world middleware application environment and clearly demonstrates the practicality of the approach in a realistic setting.

[1]  Rajkumar Buyya,et al.  A taxonomy of market‐based resource management systems for utility‐driven cluster computing , 2006, Softw. Pract. Exp..

[2]  Viktor K. Prasanna,et al.  Heterogeneous computing: challenges and opportunities , 1993, Computer.

[3]  鈴木 昭二,et al.  Reliable Distributed Systems , 1998 .

[4]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[5]  George Coulouris,et al.  Distributed systems - concepts and design , 1988 .

[6]  Derong Liu.  The Mathematics of Internet Congestion Control , 2005, IEEE Transactions on Automatic Control.

[7]  A. A. Maciejewski,et al.  Heterogeneous Computing , 2002 .

[8]  Anthony A. Maciejewski,et al.  Stochastic robustness metric and its use for static resource allocations , 2008, J. Parallel Distributed Comput..

[9]  Matt Welsh,et al.  Decentralized, adaptive resource allocation for sensor networks , 2005, NSDI.

[10]  Kenneth P. Birman,et al.  Reliable Distributed Systems: Technologies, Web Services, and Applications , 2005 .

[11]  Li Zhang,et al.  Tycoon: An implementation of a distributed, market-based resource allocation system , 2004, Multiagent Grid Syst..

[12]  Anthony A. Maciejewski,et al.  Decentralized market-based resource allocation in a heterogeneous computing system , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[13]  Martin Arlitt,et al.  A workload characterization study of the 1998 World Cup Web site , 2000, IEEE Netw..

[14]  Ladislau Bölöni,et al.  Robust scheduling of metaprograms , 2002 .

[15]  Y. A. Korilis,et al.  A market-based architecture for management of geographically dispersed, replicated Web servers , 1998, ICE '98.

[16]  R. F. Freund,et al.  Guest Editor's Introduction: Heterogeneous Processing , 1993 .

[17]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[18]  David Abramson,et al.  Economic models for resource management and scheduling in Grid computing , 2002, Concurr. Comput. Pract. Exp..

[19]  Guillaume Pierre,et al.  Globule: a User-Centric Content Delivery Network , 2004 .

[20]  Guillaume Pierre,et al.  Globule: a collaborative content delivery network , 2006, IEEE Communications Magazine.

[21]  Marc-Thomas Schmidt,et al.  The Enterprise Service Bus: Making service-oriented architecture real , 2005, IBM Syst. J..

[22]  Edwin K. P. Chong,et al.  Decentralized rate control for tracking and surveillance networks , 2007, Ad Hoc Networks.

[23]  Hoong Chuin Lau,et al.  Decentralized Resource Allocation and Scheduling via Walrasian Auctions with Negotiable Agents , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[24]  Rajkumar Buyya,et al.  A case for cooperative and incentive-based federation of distributed clusters , 2008, Future Gener. Comput. Syst..

[25]  Anthony A. Maciejewski,et al.  Measuring the Robustness of Resource Allocations in a Stochastic Dynamic Environment , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[26]  Chaki Ng,et al.  Mirage: a microeconomic resource allocation system for sensornet testbeds , 2005, The Second IEEE Workshop on Embedded Networked Sensors, 2005. EmNetS-II..

[27]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[28]  Rayadurgam Srikant,et al.  The Mathematics of Internet Congestion Control (Systems and Control: Foundations and Applications) , 2004 .

[29]  J. Famaey,et al.  Content Delivery Networks , 2012 .

[30]  Carrie Grimes,et al.  Using a market economy to provision compute resources across planet-wide clusters , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[31]  Ariel Orda,et al.  A market-based architecture for management of geographically dispersed, replicated Web servers , 2000, Decis. Support Syst..

[32]  Michal Feldman,et al.  A price-anticipating resource allocation mechanism for distributed shared clusters , 2005, EC '05.

[33]  Ladislau Bölöni,et al.  A macroeconomic model for resource allocation in large-scale distributed systems , 2008, J. Parallel Distributed Comput..