A Survey of the State-of-the-Art in Fair Multi-Resource Allocations for Data Centers

Multi-resource allocation in data centers determines a network and service management task of crucial importance. While, traditionally computing systems are shared based on a single resource, it was shown that in data centers this simplification often impedes overall efficiency and fairness. Therefore, newer approaches consider data center resource allocations as a multi-resource allocation problem. However, the capability of these approaches to reach overall fairness or efficiency is limited due to theoretical assumptions they make or due to practical means they deploy to control resources. This survey: 1) details all steps necessary to allocate data center resources and puts these steps in relation to each other; 2) highly relevant concepts in support of fair data center resource allocations, such as utility functions and allocation characteristics, are discussed and compared; and 3) in turn, major approaches to allocate multiple data center resources in a fair manner are outlined, mapped to practical steps and economically driven-targets, and compared with respect to their suitability of being applied in today’s data centers.

[1]  Ramakrishnan Rajamony,et al.  An updated performance comparison of virtual machines and Linux containers , 2015, 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS).

[2]  Xuejie Zhang,et al.  Dynamic fair allocation of multiple resources with bounded number of tasks in cloud computing systems , 2015, Multiagent Grid Syst..

[3]  Jae C. Oh,et al.  An Approach to Dominant Resource Fairness in Distributed Environment , 2015, IEA/AIE.

[4]  Wei Wang,et al.  Multi-Resource Fair Allocation in Heterogeneous Cloud Computing Systems , 2015, IEEE Transactions on Parallel and Distributed Systems.

[5]  Xiaoying Zheng,et al.  Fair multi-node multi-resource allocation and task scheduling in datacenter , 2012, 2012 IEEE Asia Pacific Cloud Computing Congress (APCloudCC).

[6]  Benjamin C. Lee,et al.  REF: resource elasticity fairness with sharing incentives for multiprocessors , 2014, ASPLOS.

[7]  Ariel D. Procaccia,et al.  No agent left behind: dynamic fair division of multiple resources , 2013, AAMAS.

[8]  Li Zhang,et al.  Multi-resource Fair Sharing for Multiclass Workflows , 2015, PERV.

[9]  Thomas Bonald,et al.  Enhanced cluster computing performance through proportional fairness , 2014, Perform. Evaluation.

[10]  Baochun Li,et al.  Dominant resource fairness in cloud computing systems with heterogeneous servers , 2013, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[11]  Weidong Li,et al.  Discrete Interior Search Algorithm for Multi-resource Fair Allocation in Heterogeneous Cloud Computing Systems , 2016, ICIC.

[12]  Burkhard Stiller,et al.  Cloud Flat Rates Enabled via Fair Multi-resource Consumption , 2016, AIMS.

[13]  Xuejie Zhang,et al.  A note on dynamic fair division of multiple resources , 2015, ArXiv.

[14]  Dalibor Klusácek,et al.  Multi Resource Fairness: Problems and Challenges , 2013, JSSPP.

[15]  Dror G. Feitelson,et al.  A global scheduling framework for virtualization environments , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[16]  Bingsheng He,et al.  Reciprocal Resource Fairness: Towards Cooperative Multiple-Resource Fair Sharing in IaaS Clouds , 2014, SC14: International Conference for High Performance Computing, Networking, Storage and Analysis.

[17]  Burkhard Stiller,et al.  The Design and Evaluation of a Heaviness Metric for Cloud Fairness and Correct Virtual Machine Configurations , 2016, GECON.

[18]  Shanshan Li,et al.  Multi-resource Aware Congestion Control in Data Centers , 2013, 2013 International Conference on Parallel and Distributed Systems.

[19]  Randy H. Katz,et al.  Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center , 2011, NSDI.

[20]  Baochun Li,et al.  Multi-resource Fair Sharing for Datacenter Jobs with Placement Constraints , 2016, SC16: International Conference for High Performance Computing, Networking, Storage and Analysis.

[21]  Loris Marchal,et al.  A Fair Decentralized Scheduler for Bag-of-Tasks Applications on Desktop Grids , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[22]  Benjamin Hindman,et al.  Dominant Resource Fairness: Fair Allocation of Multiple Resource Types , 2011, NSDI.

[23]  Wentong Cai,et al.  On dynamic bin packing for resource allocation in the cloud , 2014, SPAA.

[24]  Gerhard J. Woeginger,et al.  There is no Asymptotic PTAS for Two-Dimensional Vector Packing , 1997, Inf. Process. Lett..

[25]  Ashutosh Sabharwal,et al.  An Axiomatic Theory of Fairness in Network Resource Allocation , 2009, 2010 Proceedings IEEE INFOCOM.

[26]  Dalibor Klusácek,et al.  Multi-resource Aware Fairsharing for Heterogeneous Systems , 2014, JSSPP.

[27]  Christos-Alexandros Psomas,et al.  Beyond Beyond Dominant Resource Fairness : Indivisible Resource Allocation In Clusters , 2012 .

[28]  Jin Li,et al.  Egalitarian division under Leontief Preferences , 2013 .

[29]  Dror G. Feitelson,et al.  On-line fair allocations based on bottlenecks and global priorities , 2013, ICPE '13.

[30]  Randy H. Katz,et al.  Heterogeneity and dynamicity of clouds at scale: Google trace analysis , 2012, SoCC '12.

[31]  Randy H. Katz,et al.  Heterogeneity-Aware Resource Allocation and Scheduling in the Cloud , 2011, HotCloud.

[32]  Nathan Linial,et al.  No justified complaints: on fair sharing of multiple resources , 2011, ITCS '12.

[33]  Gagan Goel,et al.  Mechanism design for fair division: allocating divisible items without payments , 2013, EC.

[34]  Eric J. Friedman,et al.  Strategyproof allocation of discrete jobs on multiple machines , 2014, EC.

[35]  Burkhard Stiller,et al.  Virtual machine priority adaption to enforce fairness among cloud users , 2016, 2016 12th International Conference on Network and Service Management (CNSM).

[36]  Mung Chiang,et al.  Multiresource Allocation: Fairness–Efficiency Tradeoffs in a Unifying Framework , 2012, IEEE/ACM Transactions on Networking.

[37]  Ariel D. Procaccia,et al.  Beyond Dominant Resource Fairness , 2015, ACM Trans. Economics and Comput..

[38]  Xuejie Zhang,et al.  Dynamic Fair Division of Multiple Resources with Satiable Agents in Cloud Computing Systems , 2015, 2015 IEEE Fifth International Conference on Big Data and Cloud Computing.

[39]  Yann Chevaleyre,et al.  Issues in Multiagent Resource Allocation , 2006, Informatica.

[40]  Baochun Li,et al.  On Fairness-Efficiency Tradeoffs for Multi-resource Packet Processing , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems Workshops.

[41]  Xin Li,et al.  Low-complexity multi-resource packet scheduling for network function virtualization , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[42]  Vyas Sekar,et al.  Multi-resource fair queueing for packet processing , 2012, CCRV.

[43]  David E. Culler,et al.  Hierarchical scheduling for diverse datacenter workloads , 2013, SoCC.

[44]  Donald F. Ferguson,et al.  Economic models for allocating resources in computer systems , 1996 .

[45]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[46]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[47]  Raouf Boutaba,et al.  On Cloud computational models and the heterogeneity challenge , 2011, Journal of Internet Services and Applications.

[48]  Chris Arney Mathematics and Democracy: The Case for Quantitative Literacy , 2002 .

[49]  Baochun Li,et al.  Multi-Resource Round Robin: A low complexity packet scheduler with Dominant Resource Fairness , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[50]  Thomas Bonald,et al.  Multi-Resource Fairness , 2014, SIGMETRICS.

[51]  Srikanth Kandula,et al.  Multi-resource packing for cluster schedulers , 2014, SIGCOMM.

[52]  Carlos Arango,et al.  Performance Evaluation of Container-based Virtualization for High Performance Computing Environments , 2017, Revista UIS Ingenierías.

[53]  Peter J. Varman,et al.  Balancing fairness and efficiency in tiered storage systems with bottleneck-aware allocation , 2014, FAST.

[54]  M. Zukerman,et al.  Efficiency-fairness tradeoff in telecommunications networks , 2005, IEEE Communications Letters.

[55]  Noam Nisan,et al.  Fair allocation without trade , 2012, AAMAS.

[56]  Mahmut T. Kandemir,et al.  MROrchestrator: A Fine-Grained Resource Orchestration Framework for MapReduce Clusters , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[57]  Xuejie Zhang,et al.  Multi-resource Fair Allocation with Bounded Number of Tasks in Cloud Computing Systems , 2014, NCTCS.

[58]  Sally Floyd,et al.  Metrics for the Evaluation of Congestion Control Mechanisms , 2008, RFC.

[59]  Raj Jain,et al.  A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems , 1998, ArXiv.

[60]  Keqiu Li,et al.  ATFQ: A Fair and Efficient Packet Scheduling Method in Multi-Resource Environments , 2015, IEEE Transactions on Network and Service Management.

[61]  Kamesh Munagala,et al.  Competitive algorithms from competitive equilibria: non-clairvoyant scheduling under polyhedral constraints , 2014, STOC.

[62]  Hervé Moulin,et al.  Fair division and collective welfare , 2003 .

[63]  Baochun Li,et al.  Towards Multi-Resource Fair Allocation with Placement Constraints , 2016, SIGMETRICS.

[64]  Ion Stoica,et al.  FairCloud: sharing the network in cloud computing , 2011, SIGCOMM '12.

[65]  Scott Shenker,et al.  Choosy: max-min fair sharing for datacenter jobs with constraints , 2013, EuroSys '13.