Energy Efficient Cloud Control and Pricing in Geographically Distributed Data Centers

It is estimated that data centers constitute 1.5% of global electricity usage. At the same time, to serve increasing user requirements, modern cloud providers are operating multiple geographically distributed data centers. Distributed data center infrastructure changes the rules of cloud control, as energy costs depend on current regional electricity prices and temperatures that we call geotemporal inputs. Furthermore, pricing policies at which cloud providers can offer computational resources depend on the quality of service (QoS). With such pricing schemes and the increasing energy costs in data centres, balancing energy savings with performance and revenue losses is a challenging problem. Existing cloud control methods are suitable only for a single data center or do not consider all the available cloud control actions that can reduce energy costs in geographically distributed data centers. In this thesis, we propose a pervasive cloud control approach consisting of multiple methods for dynamic resource reallocation and hardware configuration adapted to volatile geotemporal inputs. The proposed methods consider the QoS impact of cloud control actions and the data quality limits of time series forecasting methods. We offer a cloud controller design that supports future extensions when new decision support components need to be added. We also propose novel pricing schemes which account for the computational resource availability and costs that arise from our cloud control approach to enable both flexible, energy-aware and high performance cloud computing. We evaluate our methods empirically and in a number of simulations using historical traces of electricity prices, temperatures, workloads and other data. Our results show that significant energy cost savings are possible without harming the QoS or service revenue in geographically distributed cloud computing.

[1]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[2]  Stefanos Kaxiras,et al.  Green governors: A framework for Continuously Adaptive DVFS , 2011, 2011 International Green Computing Conference and Workshops.

[3]  Simon Holmbacka,et al.  Energy efficiency and performance management of parallel dataflow applications , 2014, Proceedings of the 2014 Conference on Design and Architectures for Signal and Image Processing.

[4]  Qingfu Zhang,et al.  Stable Matching-Based Selection in Evolutionary Multiobjective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[5]  Rajkumar Buyya,et al.  Environment-conscious scheduling of HPC applications on distributed Cloud-oriented data centers , 2011, J. Parallel Distributed Comput..

[6]  Jie Wu,et al.  A Multi-objective Biogeography-Based Optimization for Virtual Machine Placement , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[7]  Ramesh K. Sitaraman,et al.  Using batteries to reduce the power costs of internet-scale distributed networks , 2012, SoCC '12.

[8]  Siddharth Garg,et al.  Cherry-picking: Exploiting process variations in dark-silicon homogeneous chip multi-processors , 2013, 2013 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[9]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[10]  Quanyan Zhu,et al.  Dynamic Resource Allocation for Spot Markets in Cloud Computing Environments , 2011, 2011 Fourth IEEE International Conference on Utility and Cloud Computing.

[11]  Rizos Sakellariou,et al.  Simulating Autonomic SLA Enactment in Clouds Using Case Based Reasoning , 2010, ServiceWave.

[12]  Philippe Olivier Alexandre Navaux,et al.  On the energy efficiency and performance of irregular application executions on multicore, NUMA and manycore platforms , 2015, J. Parallel Distributed Comput..

[13]  Radu Prodan,et al.  A Multi-objective Approach for Workflow Scheduling in Heterogeneous Environments , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[14]  Jean-Marc Pierson,et al.  Towards a generic power estimator , 2014, Computer Science - Research and Development.

[15]  Baochun Li,et al.  Temperature Aware Workload Managementin Geo-Distributed Data Centers , 2013, IEEE Trans. Parallel Distributed Syst..

[16]  Bruce M. Maggs,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[17]  P. Joskow,et al.  The European Union's emissions trading system in perspective , 2008 .

[18]  Stephen J. Wright,et al.  Power Awareness in Network Design and Routing , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[19]  M. Boiteux Peak-Load Pricing , 1960 .

[20]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[21]  F. Schweppe Spot Pricing of Electricity , 1988 .

[22]  Edward Curry,et al.  An Environmental Chargeback for Data Center and Cloud Computing Consumers , 2012, E2DC.

[23]  P. O'Connor,et al.  Practical Reliability Engineering , 1981 .

[24]  Vipin Chaudhary,et al.  VMeter: Power modelling for virtualized clouds , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[25]  Johan Tordsson,et al.  Modeling for Dynamic Cloud Scheduling Via Migration of Virtual Machines , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[26]  Christof Weinhardt,et al.  A multi-attribute service portfolio design problem , 2011, 2011 IEEE International Conference on Service-Oriented Computing and Applications (SOCA).

[27]  John Asker,et al.  Properties of Scoring Auctions , 2004 .

[28]  Nikolas Ioannou,et al.  Phase-Based Application-Driven Hierarchical Power Management on the Single-chip Cloud Computer , 2011, 2011 International Conference on Parallel Architectures and Compilation Techniques.

[29]  Christoph Weber,et al.  Uncertainty in the Electric Power Industry - Methods and Models for Decision Support , 2005, International series in operations research and management science.

[30]  Michael Grubb,et al.  The Kyoto Protocol: A Guide and Assessment , 1999 .

[31]  Albert Y. Zomaya,et al.  Tradeoffs Between Profit and Customer Satisfaction for Service Provisioning in the Cloud , 2011, HPDC '11.

[32]  Michela Meo,et al.  Probabilistic Consolidation of Virtual Machines in Self-Organizing Cloud Data Centers , 2013, IEEE Transactions on Cloud Computing.

[33]  Jörn Altmann,et al.  Author's Personal Copy Future Generation Computer Systems Creating Standardized Products for Electronic Markets , 2022 .

[34]  Ivona Brandic,et al.  Take a Break: Cloud Scheduling Optimized for Real-Time Electricity Pricing , 2013, 2013 International Conference on Cloud and Green Computing.

[35]  Tsan-sheng Hsu,et al.  Energy-Conscious Cloud Computing Adopting DVFS and State-Switching for Workflow Applications , 2013, 2013 International Conference on Cloud Computing and Big Data.

[36]  Bjoern Franke,et al.  Measuring QoE of interactive workloads and characterising frequency governors on mobile devices , 2014, 2014 IEEE International Symposium on Workload Characterization (IISWC).

[37]  Bo Hong,et al.  Towards Profitable Virtual Machine Placement in the Data Center , 2011, 2011 Fourth IEEE International Conference on Utility and Cloud Computing.

[38]  Feng Pan,et al.  Analyzing the Energy-Time Trade-Off in High-Performance Computing Applications , 2007, IEEE Transactions on Parallel and Distributed Systems.

[39]  Xi He,et al.  Power-aware scheduling of virtual machines in DVFS-enabled clusters , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[40]  Mateo Valero,et al.  Optimizing job performance under a given power constraint in HPC centers , 2010, International Conference on Green Computing.

[41]  Christoph Michael Flath,et al.  Flexible Demand in Smart Grids - Modeling and Coordination , 2013 .

[42]  Achim Streit,et al.  A utility-based approach for customised cloud service selection , 2015, Int. J. Comput. Sci. Eng..

[43]  Rizos Sakellariou,et al.  Performance-Based Pricing in Multi-Core Geo-Distributed Cloud Computing , 2020, IEEE Transactions on Cloud Computing.

[44]  Sandeep K. S. Gupta,et al.  Dynamic hosting management of web based applications over clouds , 2011, 2011 18th International Conference on High Performance Computing.

[45]  Ragunathan Rajkumar,et al.  Critical power slope: understanding the runtime effects of frequency scaling , 2002, ICS '02.

[46]  Wes McKinney,et al.  Data Structures for Statistical Computing in Python , 2010, SciPy.

[47]  Thomas F. Wenisch,et al.  PowerNap: eliminating server idle power , 2009, ASPLOS.

[48]  Niv Buchbinder,et al.  Online Job-Migration for Reducing the Electricity Bill in the Cloud , 2011, Networking.

[49]  Rajkumar Buyya,et al.  Workload Prediction Using ARIMA Model and Its Impact on Cloud Applications’ QoS , 2015, IEEE Transactions on Cloud Computing.

[50]  Simon Holmbacka,et al.  Thermal influence on the energy efficiency of workload consolidation in many-core architectures , 2013, 2013 24th Tyrrhenian International Workshop on Digital Communications - Green ICT (TIWDC).

[51]  Sonja Klingert,et al.  Sustainable Energy Management in Data Centers through Collaboration , 2012, E2DC.

[52]  Mateo Valero,et al.  Supercomputing with commodity CPUs: Are mobile SoCs ready for HPC? , 2013, 2013 SC - International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[53]  Rajkumar Buyya,et al.  OpenStack Neat: a framework for dynamic and energy‐efficient consolidation of virtual machines in OpenStack clouds , 2015, Concurr. Comput. Pract. Exp..

[54]  Hao Shen,et al.  Learning based DVFS for simultaneous temperature, performance and energy management , 2012, Thirteenth International Symposium on Quality Electronic Design (ISQED).

[55]  Hussein A. Abbass,et al.  Adaptive Cross-Generation Differential Evolution Operators for Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[56]  Thu D. Nguyen,et al.  Parasol and GreenSwitch: managing datacenters powered by renewable energy , 2013, ASPLOS '13.

[57]  Toni Mastelic,et al.  Energy Efficient Service Delivery in Clouds in Compliance with the Kyoto Protocol , 2012, E2DC.

[58]  Thomas Rauber,et al.  Energy-Aware Execution of Fork-Join-Based Task Parallelism , 2012, 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[59]  Jizhou Sun,et al.  Joint Scheduling of Data and Computation in Geo-Distributed Cloud Systems , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[60]  Jie Li,et al.  Towards Optimal Electric Demand Management for Internet Data Centers , 2012, IEEE Transactions on Smart Grid.

[61]  Jose Renau,et al.  Characterizing processor thermal behavior , 2010, ASPLOS XV.

[62]  Thomas Beauvisage,et al.  Computer usage in daily life , 2009, CHI.

[63]  Xue Liu,et al.  Minimizing Electricity Cost: Optimization of Distributed Internet Data Centers in a Multi-Electricity-Market Environment , 2010, 2010 Proceedings IEEE INFOCOM.

[64]  Guy Melard,et al.  Automatic ARIMA modeling including interventions, using time series expert software , 2000 .

[65]  Francieli Zanon Boito,et al.  Performance/energy trade-off in scientific computing: the case of ARM big.LITTLE and Intel Sandy Bridge , 2015, IET Comput. Digit. Tech..

[66]  Yaoxue Zhang,et al.  Aggressive Resource Provisioning for Ensuring QoS in Virtualized Environments , 2015, IEEE Transactions on Cloud Computing.

[67]  Jesús Labarta,et al.  Tools for Power-Energy Modelling and Analysis of Parallel Scientific Applications , 2012, 2012 41st International Conference on Parallel Processing.

[68]  Brian E. Granger,et al.  IPython: A System for Interactive Scientific Computing , 2007, Computing in Science & Engineering.

[69]  Chia-Ming Wu,et al.  A green energy-efficient scheduling algorithm using the DVFS technique for cloud datacenters , 2014, Future Gener. Comput. Syst..

[70]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[71]  Ben H. H. Juurlink,et al.  Low-Power High-Efficiency Video Decoding using General-Purpose Processors , 2015, ACM Trans. Archit. Code Optim..

[72]  Ulrich Kremer,et al.  The design, implementation, and evaluation of a compiler algorithm for CPU energy reduction , 2003, PLDI '03.

[73]  K. Nikolopoulos,et al.  The theta model: a decomposition approach to forecasting , 2000 .

[74]  Ada Gavrilovska,et al.  Practical Compute Capacity Management for Virtualized Datacenters , 2013, IEEE Transactions on Cloud Computing.

[75]  Fábio Coutinho,et al.  A Workflow Scheduling Algorithm for Optimizing Energy-Efficient Grid Resources Usage , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[76]  Hai Jin,et al.  Towards Optimized Fine-Grained Pricing of IaaS Cloud Platform , 2015, IEEE Transactions on Cloud Computing.

[77]  Orazio Tomarchio,et al.  A Procurement Auction Market to Trade Residual Cloud Computing Capacity , 2015, IEEE Transactions on Cloud Computing.

[78]  Rizos Sakellariou,et al.  A Cloud Controller for Performance-Based Pricing , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[79]  Deo Prakash Vidyarthi,et al.  Improved auto control ant colony optimization using lazy ant approach for grid scheduling problem , 2016, Future Gener. Comput. Syst..

[80]  Cameron Kiddle,et al.  Green cloud VM migration: Power use analysis , 2012, 2012 International Green Computing Conference (IGCC).

[81]  Yong Meng Teo,et al.  Towards Modelling Parallelism and Energy Performance of Multicore Systems , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum.

[82]  Muli Ben-Yehuda,et al.  Deconstructing Amazon EC2 Spot Instance Pricing , 2011, CloudCom.

[83]  Cameron Kiddle,et al.  Energy-cost-aware scheduling of HPC workloads , 2011, 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[84]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines , 2009, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.

[85]  Erwin Laure,et al.  Towards transparent integration of heterogeneous cloud storage platforms , 2011, DIDC '11.

[86]  Guillaume Pierre,et al.  Wikipedia workload analysis for decentralized hosting , 2009, Comput. Networks.

[87]  E. S. Gardner,et al.  Forecasting Trends in Time Series , 1985 .

[88]  Hiroshi Sasaki,et al.  Coordinated power-performance optimization in manycores , 2013, Proceedings of the 22nd International Conference on Parallel Architectures and Compilation Techniques.

[89]  Rizos Sakellariou,et al.  Enacting SLAs in Clouds Using Rules , 2011, Euro-Par.

[90]  Rongliang Zhou,et al.  Optimization and control of cooling microgrids for data centers , 2012, 13th InterSociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems.

[91]  Wen-Hua Chen,et al.  Multiairport Capacity Management: Genetic Algorithm With Receding Horizon , 2007, IEEE Transactions on Intelligent Transportation Systems.

[92]  Ivona Brandic,et al.  Pervasive Cloud Controller for Geotemporal Inputs , 2016, IEEE Transactions on Cloud Computing.

[93]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[94]  Eui-nam Huh,et al.  An Improvement of Resource Allocation for Migration Process in Cloud Environment , 2014, Comput. J..

[95]  Hai Jin,et al.  Performance and energy modeling for live migration of virtual machines , 2011, HPDC.

[96]  Paul Barford,et al.  Toward an analytic framework for the electrical power grid , 2012, 2012 Third International Conference on Future Systems: Where Energy, Computing and Communication Meet (e-Energy).

[97]  Xue Liu,et al.  Spatio-Temporal Load Balancing for Energy Cost Optimization in Distributed Internet Data Centers , 2015, IEEE Transactions on Cloud Computing.

[98]  Shaolei Ren,et al.  Provably-Efficient Job Scheduling for Energy and Fairness in Geographically Distributed Data Centers , 2012, 2012 IEEE 32nd International Conference on Distributed Computing Systems.

[99]  Kenli Li,et al.  An Efficient Energy Scheduling Algorithm for Workflow Tasks in Hybrids and DVFS-Enabled Cloud Environment , 2014, 2014 Sixth International Symposium on Parallel Architectures, Algorithms and Programming.

[100]  Michelle M. Zhu,et al.  Enhanced Weighted Round Robin (EWRR) with DVFS Technology in Cloud Energy-Aware , 2014, 2014 International Conference on Computational Science and Computational Intelligence.

[101]  Yong Zhao,et al.  Cloud Computing and Grid Computing 360-Degree Compared , 2008, GCE 2008.

[102]  Rajkumar Buyya,et al.  Energy Efficient Allocation of Virtual Machines in Cloud Data Centers , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[103]  Umesh Deshpande,et al.  Traffic-Sensitive Live Migration of Virtual Machines , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[104]  R. Buyya,et al.  Green Cloud Computing and Environmental Sustainability , 2012 .

[105]  Athanasios V. Vasilakos,et al.  Thermal-Aware Scheduling of Batch Jobs in Geographically Distributed Data Centers , 2014, IEEE Transactions on Cloud Computing.

[106]  Ching-Hsien Hsu,et al.  An Efficient Green Control Algorithm in Cloud Computing for Cost Optimization , 2015, IEEE Transactions on Cloud Computing.

[107]  Rajkumar Buyya,et al.  Revenue Maximization with Optimal Capacity Control in Infrastructure as a Service Cloud Markets , 2015, IEEE Transactions on Cloud Computing.

[108]  Yanqing Zhang,et al.  Energy-Efficient Task Scheduling Algorithms with Human Intelligence Based Task Shuffling and Task Relocation , 2011, 2011 IEEE/ACM International Conference on Green Computing and Communications.

[109]  S. W. Roberts,et al.  Control Chart Tests Based on Geometric Moving Averages , 2000, Technometrics.

[110]  Hai Jin,et al.  Towards Pay-As-You-Consume Cloud Computing , 2011, 2011 IEEE International Conference on Services Computing.

[111]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[112]  J. Koomey Worldwide electricity used in data centers , 2008 .

[113]  Erol Gelenbe,et al.  Energy-Efficient Cloud Computing , 2010, Comput. J..

[114]  Xiaomin Zhu,et al.  Real-Time Tasks Oriented Energy-Aware Scheduling in Virtualized Clouds , 2014, IEEE Transactions on Cloud Computing.

[115]  Fang Liu,et al.  A Multiobjective Evolutionary Algorithm Based on Decision Variable Analyses for Multiobjective Optimization Problems With Large-Scale Variables , 2016, IEEE Transactions on Evolutionary Computation.

[116]  Adam Wierman,et al.  Renewable and cooling aware workload management for sustainable data centers , 2012, SIGMETRICS '12.

[117]  Thu D. Nguyen,et al.  Reducing electricity cost through virtual machine placement in high performance computing clouds , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[118]  Achim Streit,et al.  Energy-Aware Cloud Management Through Progressive SLA Specification , 2014, GECON.

[119]  Christine Morin,et al.  Snooze: A Scalable and Autonomic Virtual Machine Management Framework for Private Clouds , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[120]  Adam Wierman,et al.  Data center demand response: Avoiding the coincident peak via workload shifting and local generation , 2013, Perform. Evaluation.

[121]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[122]  Brunilde Sansò,et al.  A Tabu Search Algorithm for the Location of Data Centers and Software Components in Green Cloud Computing Networks , 2013, IEEE Transactions on Cloud Computing.

[123]  Luiz Fernando Bittencourt,et al.  Towards a PaaS Architecture for Resource Allocation in IaaS Providers Considering Different Charging Models , 2013, GECON.

[124]  Rajkumar Buyya,et al.  Managing Overloaded Hosts for Dynamic Consolidation of Virtual Machines in Cloud Data Centers under Quality of Service Constraints , 2013, IEEE Transactions on Parallel and Distributed Systems.

[125]  Mohammed H. Albadi,et al.  Demand Response in Electricity Markets: An Overview , 2007, 2007 IEEE Power Engineering Society General Meeting.

[126]  Laurent Lefèvre,et al.  The GREEN-NET framework: Energy efficiency in large scale distributed systems , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[127]  Rajkumar Buyya,et al.  Multi-objective planning for workflow execution on Grids , 2007, 2007 8th IEEE/ACM International Conference on Grid Computing.

[128]  Berkant Barla Cambazoglu,et al.  Cutting Down the Energy Cost of Geographically Distributed Cloud Data Centers , 2013, EE-LSDS.

[129]  David M. Brooks,et al.  Energy characterization and instruction-level energy model of Intel's Xeon Phi processor , 2013, International Symposium on Low Power Electronics and Design (ISLPED).

[130]  Hua-Jun Hong,et al.  Placing Virtual Machines to Optimize Cloud Gaming Experience , 2015, IEEE Transactions on Cloud Computing.

[131]  Benjamín Barán,et al.  A Virtual Machine Placement Taxonomy , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[132]  Ghadir Radman,et al.  Survey on Smart Grid , 2010, Proceedings of the IEEE SoutheastCon 2010 (SoutheastCon).

[133]  Anupriya Ankolekar,et al.  Preference-based selection of highly configurable web services , 2007, WWW '07.

[134]  Robert Shorten,et al.  Stratus: Load Balancing the Cloud for Carbon Emissions Control , 2013, IEEE Transactions on Cloud Computing.

[135]  Lachlan L. H. Andrew,et al.  Online algorithms for geographical load balancing , 2012, 2012 International Green Computing Conference (IGCC).

[136]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[137]  Barry O'Sullivan,et al.  A Study of Electricity Price Features on Distributed Internet Data Centers , 2013, GECON.

[138]  P. Berndt,et al.  Towards Sustainable IaaS Pricing , 2013, GECON.

[139]  R. Weron Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach , 2006 .

[140]  Rami G. Melhem,et al.  On the Interplay of Parallelization, Program Performance, and Energy Consumption , 2010, IEEE Transactions on Parallel and Distributed Systems.

[141]  Daniel Grosu,et al.  Physical Machine Resource Management in Clouds: A Mechanism Design Approach , 2015, IEEE Transactions on Cloud Computing.

[142]  Xu Yang,et al.  Integrating dynamic pricing of electricity into energy aware scheduling for HPC systems , 2013, 2013 SC - International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[143]  Rob J Hyndman,et al.  Unmasking the Theta Method , 2003 .

[144]  Lizhe Wang,et al.  Hierarchical genetic-based grid scheduling with energy optimization , 2012, Cluster Computing.

[145]  Andreas Berl,et al.  Modelling Power Adaption Flexibility of Data Centres for Demand-Response Management , 2013, EE-LSDS.

[146]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[147]  Jörn Altmann,et al.  Maximizing Liquidity in Cloud Markets through Standardization of Computational Resources , 2013, 2013 IEEE Seventh International Symposium on Service-Oriented System Engineering.

[148]  Unfccc Kyoto Protocol to the United Nations Framework Convention on Climate Change , 1997 .

[149]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[150]  Mahmut T. Kandemir,et al.  Leakage Current: Moore's Law Meets Static Power , 2003, Computer.

[151]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[152]  Rizos Sakellariou,et al.  Cost-Efficient CPU Provisioning for Scientific Workflows on Clouds , 2015, GECON.

[153]  Godfrey Boyle,et al.  Renewable Electricity and the Grid : The Challenge of Variability , 2007 .