Power and performance optimization in FPGA‐accelerated clouds

Energy management has become increasingly necessary in data centers to address all energy‐related costs, including capital costs, operating expenses, and environmental impacts. Heterogeneous systems with mixed hardware architectures provide both throughput and processing efficiency for different specialized application types and thus have a potential for significant energy savings. However, the presence of multiple and different processing elements increases the complexity of resource assignment. In this paper, we propose a system for efficient resource management in heterogeneous clouds. The proposed approach maps applications' requirement to different resources reducing power usage with minimum impact on performance. A technique that combines the scheduling of custom hardware accelerators, in our case, Field‐Programmable Gate Arrays (FPGAs) and optimized resource allocation technique for commodity servers, is proposed. We consider an energy‐aware scheduling technique that uses both the applications' performance and their deadlines to control the assignment of FPGAs to applications that would consume the most energy. Once the scheduler has performed the mapping between a VM and an FPGA, an optimizer handles the remaining VMs in the server, using vertical scaling and CPU frequency adaptation to reduce energy consumption while maintaining the required performance. Our evaluation using interactive and data‐intensive applications compare the effectiveness of the proposed solution in energy savings as well as maintaining applications performance, obtaining up to a 32% improvement in the performance‐energy ratio on a mix of multimedia and e‐commerce applications.

[1]  Margaret Martonosi,et al.  Dynamic-Compiler-Driven Control for Microprocessor Energy and Performance , 2006, IEEE Micro.

[2]  Kang G. Shin,et al.  Automated control of multiple virtualized resources , 2009, EuroSys '09.

[3]  Wayne Luk,et al.  HARNESS Project: Managing Heterogeneous Computing Resources for a Cloud Platform , 2014, ARC.

[4]  Rajkumar Buyya,et al.  Energy-Efficient Management of Data Center Resources for Cloud Computing: A Vision, Architectural Elements, and Open Challenges , 2010, PDPTA.

[5]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[6]  Steven Hand,et al.  Self-adaptive and self-configured CPU resource provisioning for virtualized servers using Kalman filters , 2009, ICAC '09.

[7]  Andreas Herkersdorf,et al.  Enabling FPGAs in Hyperscale Data Centers , 2015, 2015 IEEE 12th Intl Conf on Ubiquitous Intelligence and Computing and 2015 IEEE 12th Intl Conf on Autonomic and Trusted Computing and 2015 IEEE 15th Intl Conf on Scalable Computing and Communications and Its Associated Workshops (UIC-ATC-ScalCom).

[8]  Alberto Leon-Garcia,et al.  FPGAs in the Cloud: Booting Virtualized Hardware Accelerators with OpenStack , 2014, 2014 IEEE 22nd Annual International Symposium on Field-Programmable Custom Computing Machines.

[9]  Omer F. Rana,et al.  International Journal of Parallel, Emergent and Distributed Systems Cosmos: towards an Integrated and Scalable Service for Analysing Social Media on Demand Cosmos: towards an Integrated and Scalable Service for Analysing Social Media on Demand , 2022 .

[10]  Mohammad Banikazemi,et al.  PAM: A novel performance/power aware meta-scheduler for multi-core systems , 2008, 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis.

[11]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[12]  Hiroshi Nakamura,et al.  Improving fairness, throughput and energy-efficiency on a chip multiprocessor through DVFS , 2007, CARN.

[13]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[14]  Erik Elmroth,et al.  Service Level and Performance Aware Dynamic Resource Allocation in Overbooked Data Centers , 2016, 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid).

[15]  Alberto Leon-Garcia,et al.  Enabling Flexible Network FPGA Clusters in a Heterogeneous Cloud Data Center , 2017, FPGA.

[16]  Xue Liu,et al.  Dynamic Voltage Scaling in Multitier Web Servers with End-to-End Delay Control , 2007, IEEE Transactions on Computers.

[17]  W. Luk,et al.  Axel: a heterogeneous cluster with FPGAs and GPUs , 2010, FPGA '10.

[18]  Hong Yu,et al.  Heterogeneous Cloud Framework for Big Data Genome Sequencing , 2015, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[19]  Ze-Nian Li,et al.  Fundamentals of Multimedia , 2014, Texts in Computer Science.

[20]  María Blanca Caminero,et al.  An Open-Source Framework for Integrating Heterogeneous Resources in Private Clouds , 2014, CLOSER.

[21]  Vyacheslav S. Kharchenko,et al.  The concept of green Cloud infrastructure based on distributed computing and hardware accelerator within FPGA as a Service , 2014, Proceedings of IEEE East-West Design & Test Symposium (EWDTS 2014).

[22]  Bin Wang,et al.  Quality of service aware power management for virtualized data centers , 2013, J. Syst. Archit..

[23]  Anees Shaikh,et al.  Are clouds ready for large distributed applications? , 2010, OPSR.

[24]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[25]  Heng Li,et al.  A statistical framework for SNP calling, mutation discovery, association mapping and population genetical parameter estimation from sequencing data , 2011, Bioinform..

[26]  Johan Tordsson,et al.  Autonomic Resource Management for Optimized Power and Performance in Multi-tenant Clouds , 2016, 2016 IEEE International Conference on Autonomic Computing (ICAC).

[27]  Tajana Simunic,et al.  Dynamic voltage frequency scaling for multi-tasking systems using online learning , 2007, Proceedings of the 2007 international symposium on Low power electronics and design (ISLPED '07).

[28]  Hari Angepat,et al.  A cloud-scale acceleration architecture , 2016, 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO).

[29]  Christoph Meinel,et al.  Elastic Virtual Machine for Fine-Grained Cloud Resource Provisioning , 2011 .

[30]  María Blanca Caminero,et al.  On the Provision of SaaS-Level Quality of Service within Heterogeneous Private Clouds , 2014, 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing.

[31]  Yu Zhang,et al.  Enabling FPGAs in the cloud , 2014, Conf. Computing Frontiers.

[32]  Erik Elmroth,et al.  Performance-Based Service Differentiation in Clouds , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[33]  Yong Wang,et al.  SDA: Software-defined accelerator for large-scale DNN systems , 2014, 2014 IEEE Hot Chips 26 Symposium (HCS).

[34]  Greg Brown,et al.  A performance and energy comparison of FPGAs, GPUs, and multicores for sliding-window applications , 2012, FPGA '12.

[35]  N.H. Hamid,et al.  Performance analysis of FPGA based Sobel edge detection operator , 2008, 2008 International Conference on Electronic Design.

[36]  E. N. Elnozahy,et al.  Energy Conservation Policies for Web Servers , 2003, USENIX Symposium on Internet Technologies and Systems.

[37]  Omer F. Rana,et al.  Integrating acceleration devices using CometCloud , 2013, ORMaCloud '13.

[38]  Yu Wang,et al.  Online scheduling for FPGA computation in the Cloud , 2014, 2014 International Conference on Field-Programmable Technology (FPT).

[39]  Bruce Jacob,et al.  A control-theoretic approach to dynamic voltage scheduling , 2003, CASES '03.

[40]  Venkatesh Pallipadi,et al.  The Ondemand Governor Past, Present, and Future , 2010 .

[41]  Ryan Kastner,et al.  RIFFA 2.0: A reusable integration framework for FPGA accelerators , 2013, 2013 23rd International Conference on Field programmable Logic and Applications.

[42]  Zhenhuan Gong,et al.  PRESS: PRedictive Elastic ReSource Scaling for cloud systems , 2010, 2010 International Conference on Network and Service Management.

[43]  Johan Tordsson,et al.  FPGA-Aware Scheduling Strategies at Hypervisor Level in Cloud Environments , 2016, Sci. Program..