Online Energy Estimation of Relational Operations in Database Systems

Data centers are well known to consume a large amount of energy. As databases are one of the major applications in a data center, building energy-aware database systems has become an active research topic recently. The quantification of the energy cost of database systems is an important task in design. In this paper, we report our recent efforts on this issue, with a focus on the energy cost estimation of query plans during query optimization. We start from building a series of physical models for energy estimation of individual relational operators based on their resource consumption patterns. As the execution of a query plan is a combination of multiple relational operators, we use the physical models as a basis for a comprehensive energy model for the entire query. To address the challenge of maintaining accuracy under system and workload dynamics, we develop an online scheme that dynamically adjusts model parameters based on statistical signal modeling. Our models are implemented in a real database management system and evaluated on a physical test bed. The results show that our solution achieves a high accuracy (worst-case error 13.7 percent) despite noises. Our models also help identify query plans with significantly higher energy efficiency.

[1]  Erol Gelenbe,et al.  Energy-Efficient Cloud Computing , 2010, Comput. J..

[2]  Kai Ma,et al.  Adaptive Power Control with Online Model Estimation for Chip Multiprocessors , 2011, IEEE Transactions on Parallel and Distributed Systems.

[3]  Amin Vahdat,et al.  ECOSystem: managing energy as a first class operating system resource , 2002, ASPLOS X.

[4]  Ricardo Bianchini,et al.  Power and energy management for server systems , 2004, Computer.

[5]  Jignesh M. Patel,et al.  Rethinking Query Processing for Energy Efficiency: Slowing Down to Win the Race , 2011, IEEE Data Eng. Bull..

[6]  Sujata Banerjee,et al.  A Power Benchmarking Framework for Network Devices , 2009, Networking.

[7]  Irving L. Traiger,et al.  System R: relational approach to database management , 1976, TODS.

[8]  Margaret Martonosi,et al.  Runtime power monitoring in high-end processors: methodology and empirical data , 2003, Proceedings. 36th Annual IEEE/ACM International Symposium on Microarchitecture, 2003. MICRO-36..

[9]  Beng Chin Ooi,et al.  The Claremont report on database research , 2008, SGMD.

[10]  Feng Zhao,et al.  Virtual machine power metering and provisioning , 2010, SoCC '10.

[11]  Kushagra Vaid,et al.  Energy benchmarks: a detailed analysis , 2010, e-Energy.

[12]  Stavros Christodoulakis,et al.  Implications of certain assumptions in database performance evauation , 1984, TODS.

[13]  Xiaorui Wang,et al.  Exploring power-performance tradeoffs in database systems , 2010, 2010 IEEE 26th International Conference on Data Engineering (ICDE 2010).

[14]  Xiaoyun Zhu,et al.  Power-Efficient Response Time Guarantees for Virtualized Enterprise Servers , 2008, 2008 Real-Time Systems Symposium.

[15]  Jayant R. Haritsa,et al.  Peak power plays in database engines , 2012, EDBT '12.

[16]  Rami Melhem,et al.  Power Aware Computing , 2002, Series in Computer Science.

[17]  Sandeep K. S. Gupta,et al.  TACOMA: Server and workload management in internet data centers considering cooling-computing power trade-off and energy proportionality , 2012, TACO.

[18]  Lieven Eeckhout,et al.  Quantifying the Impact of Input Data Sets on Program Behavior and its Applications , 2003, J. Instr. Level Parallelism.

[19]  Xiaorui Wang,et al.  Dynamic Energy Estimation of Query Plans in Database Systems , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems.

[20]  Gargi Dasgupta,et al.  Server Workload Analysis for Power Minimization using Consolidation , 2009, USENIX Annual Technical Conference.

[21]  Surajit Chaudhuri,et al.  An overview of query optimization in relational systems , 1998, PODS.

[22]  Wenfei Fan,et al.  Power Based Performance and Capacity Estimation Models for Enterprise Information Systems. , 2011 .

[23]  Jignesh M. Patel,et al.  Towards Energy-Efficient Database Cluster Design , 2012, Proc. VLDB Endow..

[24]  Thomas F. Wenisch,et al.  Power management of online data-intensive services , 2011, 2011 38th Annual International Symposium on Computer Architecture (ISCA).

[25]  Guy M. Lohman,et al.  Optimizer Validation and Performance Evaluation for Distributed Queries , 1998 .

[26]  Raghunath Othayoth Nambiar,et al.  Energy cost, the key challenge of today's data centers: a power consumption analysis of TPC-C results , 2008, Proc. VLDB Endow..

[27]  Anna G. Stefanopoulou,et al.  Recursive least squares with forgetting for online estimation of vehicle mass and road grade: theory and experiments , 2005 .

[28]  Mehul A. Shah,et al.  Analyzing the energy efficiency of a database server , 2010, SIGMOD Conference.

[29]  Jignesh M. Patel,et al.  Towards Eco-friendly Database Management Systems , 2009, CIDR.

[30]  Michael Kistler,et al.  The case for power management in web servers , 2002 .

[31]  Kai Ma,et al.  Temperature-constrained power control for chip multiprocessors with online model estimation , 2009, ISCA '09.

[32]  Raghunath Othayoth Nambiar,et al.  Tuning servers, storage and database for energy efficient data warehouses , 2010, 2010 IEEE 26th International Conference on Data Engineering (ICDE 2010).

[33]  Karthick Rajamani,et al.  Designing Energy-Efficient Servers and Data Centers , 2010, Computer.

[34]  T. N. Vijaykumar,et al.  Joint optimization of idle and cooling power in data centers while maintaining response time , 2010, ASPLOS XV.

[35]  Parthasarathy Ranganathan,et al.  Energy Efficiency: The New Holy Grail of Data Management Systems Research , 2009, CIDR.

[36]  I. David Abrahams,et al.  A brief historical perspective of the Wiener–Hopf technique , 2007 .

[37]  Ricardo Bianchini,et al.  Energy conservation in heterogeneous server clusters , 2005, PPoPP.

[38]  Surajit Chaudhuri,et al.  Rethinking Query Processing for Energy Efficiency: Slowing Down to Win the Race. , 2011 .

[39]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[40]  Luca Benini,et al.  A survey of design techniques for system-level dynamic power management , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[41]  Xiao Zhang,et al.  Power containers: an OS facility for fine-grained power and energy management on multicore servers , 2013, ASPLOS '13.

[42]  Sally A. McKee,et al.  A Cost Model For Integrated Restructuring Optimizations , 2003, J. Instr. Level Parallelism.