Resource Assignment for Large-Scale Computing Utilities using Mathematical Programming

In this paper, we describe a resource assignment problem (RAP) for a large-scale computing utility, such as an Internet data center. The problem is defined as follows: For a given topology of a network consisting of switches and servers with varying capabilities, and for a given application with a distributed architecture, decide which server from the physical network should be assigned to each application component, such that the trafficweighted average inter-server distance is minimized, and the application’s processing, communication and storage requirements are satisfied without exceeding network capacity limits. This problem is first formulated as a nonlinear combinatorial optimization problem. We then describe three mixed integer programming formulations, RAP-LINI, RAP-LINII, and RAP-MCFM, as the result of different linearization techniques. These models were numerically tested using CPLEX on a number of examples, ranging from a 125-server utility data center to a set of hypothetical data centers with increasing size. In all cases and for all three models, the CPELX solver was able to find an optimal solution within reasonable amount of time. RAP-LINII is the most efficient and required the minimum solution time. RAP-MCFM has the highest complexity but is the most general in terms of its applicability to any network topology.

[1]  Donald L. Kreher,et al.  Combinatorial algorithms: generation, enumeration, and search , 1998, SIGA.

[2]  Xiaoyun Zhu,et al.  A Mathematical Optimization Approach for Resource Allocation in Large Scale Data Centers , 2002 .

[3]  Lawrence W. Dowdy,et al.  Comparative Models of the File Assignment Problem , 1982, CSUR.

[4]  G. Nemhauser,et al.  Integer Programming , 2020 .

[5]  Biswanath Mukherjee,et al.  Heuristic algorithms for constructing optimized structures of linear multihop lightwave networks , 1994, IEEE Trans. Commun..

[6]  J. Rolia,et al.  Adaptive Internet Data Centers , 2000 .

[7]  Radia Perlman,et al.  Interconnections: Bridges, Routers, Switches, and Internetworking Protocols , 1999 .

[8]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[9]  Elwood S. Buffa,et al.  A Heuristic Algorithm and Simulation Approach to Relative Location of Facilities , 1963 .

[10]  Xiaoyun Zhu,et al.  Resource access management for a utility hosting enterprise applications , 2003, IFIP/IEEE Eighth International Symposium on Integrated Network Management, 2003..

[11]  Ram Swaminathan,et al.  Ergastulum: Quickly fi nding near-optimal storage system designs , 2001 .

[12]  Xiaoyun Zhu,et al.  Optimal resource assignment in Internet data centers , 2001, MASCOTS 2001, Proceedings Ninth International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[13]  F. J. Corbató,et al.  Multics: the first seven years , 1972, AFIPS '72 (Spring).

[14]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .