Evolutionary game for task mapping in resource constrained heterogeneous environments

Abstract Power-aware computing is becoming popular using heterogeneous ecosystem. For recent execution units, the heterogeneity is exhibited via the hybrid cores, as well as via virtual and physical asymmetric cores. The inherent performance disparity between different types of execution units at their different clock frequencies offers a great resources scheduling challenge. Multiple metrics (such as throughput, latency, energy cost) are used to decide whether the scheduling is an optimal solution or not. However, in heterogeneous ecosystem, tasks distribution aiming at optimizing costs is not trivial. During the task mapping, one of the primary challenges is to dynamically identify and map the inherent advantages/features of the heterogeneous or hybrid architectures for each individual task. In this work we deal with the task mapping problem using a multi-objective formulation based on evolutionary game theory to optimize a suitable payoff function. This payoff accounts for the power, workload imbalance, task resource affinity and data offloading costs (from host to accelerator). Here, we report that in a very restrictive resource usage scenario (supporting both over and under subscription), the proposed formulation based on Evolutionary Games on Network equation (EGN) can outperform the traditional resource allocation heuristics (such as best-fit, first-fit). Using an extensive set of simulations, we show that our proposed model can outperform first-fit algorithm from more than 5% up to 34.6% and best-fit algorithm from 4% up to 35.7%.

[1]  Paul W. Goldberg,et al.  The Complexity of Computing a Nash Equilibrium , 2009, SIAM J. Comput..

[2]  H. Varian Equity, Envy and Efficiency , 1974 .

[3]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[4]  J. E. Rodrigues,et al.  A GRAPH MODEL FOR PARALLEL COMPUTATIONS , 1969 .

[5]  Cong Liu,et al.  Task mapping in heterogeneous embedded systems for fast completion time , 2014, 2014 International Conference on Embedded Software (EMSOFT).

[6]  Houbing Song,et al.  Imperfect Information Dynamic Stackelberg Game Based Resource Allocation Using Hidden Markov for Cloud Computing , 2018, IEEE Transactions on Services Computing.

[7]  Emiliano Santarnecchi,et al.  An Evolutionary Game Theory Model of Spontaneous Brain Functioning , 2017, Scientific Reports.

[8]  Dario Madeo,et al.  Game Interactions and Dynamics on Networked Populations , 2015, IEEE Transactions on Automatic Control.

[9]  Ishfaq Ahmad,et al.  A Cooperative Game Theoretical Technique for Joint Optimization of Energy Consumption and Response Time in Computational Grids , 2009, IEEE Transactions on Parallel and Distributed Systems.

[10]  A. Barrat,et al.  Consensus formation on adaptive networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[12]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[13]  Walid Saad,et al.  An Online Optimization Framework for Distributed Fog Network Formation With Minimal Latency , 2017, IEEE Transactions on Wireless Communications.

[14]  Volker Stix,et al.  Approximating the maximum weight clique using replicator dynamics , 2000, IEEE Trans. Neural Networks Learn. Syst..

[15]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[16]  Walid Saad,et al.  Caching in the Sky: Proactive Deployment of Cache-Enabled Unmanned Aerial Vehicles for Optimized Quality-of-Experience , 2016, IEEE Journal on Selected Areas in Communications.

[17]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines , 2009, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.

[18]  David Filani Dynamic Data Center Power Management Trends, Issues, and Solutions , 2008 .

[19]  Fei Teng,et al.  A New Game Theoretical Resource Allocation Algorithm for Cloud Computing , 2010, GPC.

[20]  Anthony T. Chronopoulos,et al.  Noncooperative load balancing in distributed systems , 2005, J. Parallel Distributed Comput..

[21]  Indrani Paul,et al.  Achieving Exascale Capabilities through Heterogeneous Computing , 2015, IEEE Micro.

[22]  John D. Davis,et al.  BLAS Comparison on FPGA, CPU and GPU , 2010, 2010 IEEE Computer Society Annual Symposium on VLSI.

[23]  Michael E. Theologou,et al.  Dynamic Backhaul Resource Allocation: An Evolutionary Game Theoretic Approach , 2014, IEEE Transactions on Communications.

[24]  Albert Y. Zomaya,et al.  Game-Theoretic Approach for Load Balancing in Computational Grids , 2008, IEEE Transactions on Parallel and Distributed Systems.

[25]  Athanasios V. Vasilakos,et al.  Cielo: An Evolutionary Game Theoretic Framework for Virtual Machine Placement in Clouds , 2014, 2014 International Conference on Future Internet of Things and Cloud.

[26]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..

[27]  Ming Mao,et al.  A Performance Study on the VM Startup Time in the Cloud , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[28]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[29]  Benjamin C. Lee,et al.  Computational Sprinting , 2017, ACM Trans. Comput. Syst..

[30]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[31]  Somnath Mazumdar,et al.  Power efficient server consolidation for Cloud data center , 2017, Future Gener. Comput. Syst..

[32]  Asuman E. Ozdaglar,et al.  Opinion Dynamics and Learning in Social Networks , 2010, Dyn. Games Appl..

[33]  Anthony A. Maciejewski,et al.  Dynamically mapping tasks with priorities and multiple deadlines in a heterogeneous environment , 2007, J. Parallel Distributed Comput..

[34]  Satoshi Matsuoka,et al.  Hybrid Map Task Scheduling for GPU-Based Heterogeneous Clusters , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[35]  Sajal K. Das,et al.  A game theory based pricing strategy for job allocation in mobile grids , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[36]  Sun Shi-xin,et al.  Scheduling algorithm based on critical tasks in heterogeneous environments , 2008 .

[37]  Oscar H. Ibarra,et al.  Heuristic Algorithms for Scheduling Independent Tasks on Nonidentical Processors , 1977, JACM.

[38]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[39]  Dario Madeo,et al.  The role of self-loops and link removal in evolutionary games on networks. , 2019, Mathematical biosciences and engineering : MBE.

[40]  Jianmin Jiang,et al.  A solution of dynamic VMs placement problem for energy consumption optimization based on evolutionary game theory , 2015, J. Syst. Softw..

[41]  Tammo H. A. Bijmolt,et al.  Will It Spread or Not? The Effects of Social Influences and Network Topology on Innovation Diffusion , 2010 .

[42]  J. Nash NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[43]  Naixue Xiong,et al.  A game-theoretic method of fair resource allocation for cloud computing services , 2010, The Journal of Supercomputing.

[44]  Laurence T. Yang,et al.  A game theory-based dynamic resource allocation strategy in Geo-distributed Datacenter Clouds , 2017, Future Gener. Comput. Syst..

[45]  Jason Maassen,et al.  Performance Models for CPU-GPU Data Transfers , 2014, 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[46]  Marcello Pelillo,et al.  Replicator Equations, Maximal Cliques, and Graph Isomorphism , 1998, Neural Computation.

[47]  Barbara Panicucci,et al.  A game theoretic formulation of the service provisioning problem in cloud systems , 2011, WWW.

[48]  Andres Pantoja,et al.  Distributed optimization using population dynamics with a local replicator equation , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[49]  Dean M. Tullsen,et al.  Harnessing ISA diversity: Design of a heterogeneous-ISA chip multiprocessor , 2014, 2014 ACM/IEEE 41st International Symposium on Computer Architecture (ISCA).

[50]  Pradeep Dubey,et al.  Debunking the 100X GPU vs. CPU myth: an evaluation of throughput computing on CPU and GPU , 2010, ISCA.

[51]  G. Iacobelli,et al.  Lumping evolutionary game dynamics on networks. , 2016, Journal of theoretical biology.

[52]  H. Ohtsuki,et al.  The replicator equation on graphs. , 2006, Journal of theoretical biology.

[53]  Greg Brown,et al.  A performance and energy comparison of FPGAs, GPUs, and multicores for sliding-window applications , 2012, FPGA '12.

[54]  Norman P. Jouppi,et al.  Single-ISA heterogeneous multi-core architectures for multithreaded workload performance , 2004, Proceedings. 31st Annual International Symposium on Computer Architecture, 2004..