An empirical study of performance, power consumption, and energy cost of erasure code computing for HPC cloud storage systems

Erasure code storage systems are becoming popular choices for cloud storage systems due to cost-effective storage space saving schemes and higher fault-resilience capabilities. Both erasure code encoding and decoding procedures are involving heavy array, matrix, and table-lookup compute intensive operations. Multi-core, many-core, and streaming SIMD extension are implemented in modern CPU designs. In this paper, we study the power consumption and energy efficiency of erasure code computing using traditional Intel x86 platform and Intel Streaming SIMD extension platform. We use a breakdown power consumption analysis approach and conduct power studies of erasure code encoding process on various storage devices. We present the impact of various storage devices on erasure code based storage systems in terms of processing time, power utilization, and energy cost. Finally we conclude our studies and demonstrate the Intel x86's Streaming SIMD extensions computing is a cost-effective and favorable choice for future power efficient HPC cloud storage systems.

[1]  Luigi Rizzo,et al.  On the feasibility of software FEC , 1997 .

[2]  Dennis Goeckel,et al.  An adaptive Reed-Solomon errors-and-erasures decoder , 2006, FPGA '06.

[3]  Jun Zhou,et al.  Use of SIMD Vector Operations to Accelerate Application Code Performance on Low-Powered ARM and Intel Platforms , 2013, 2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum.

[4]  Tomoya Enokido,et al.  A Power Consumption Model for Storage-based Applications , 2011, 2011 International Conference on Complex, Intelligent, and Software Intensive Systems.

[5]  Lihao Xu,et al.  An efficient XOR-scheduling algorithm for erasure codes encoding , 2009, 2009 IEEE/IFIP International Conference on Dependable Systems & Networks.

[6]  James Paul Ahrens.  Implications of Numerical and Data Intensive Technology Trends on Scientific Visualization , 2014 .

[7]  José Luis Lázaro,et al.  Power Measurement Methods for Energy Efficient Applications , 2013, Sensors.

[8]  Ethan L. Miller,et al.  Screaming fast Galois field arithmetic using intel SIMD instructions , 2013, FAST.

[9]  Hannes Payer,et al.  Tempo: Disk drive power consumption characterization and modeling , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[10]  Torsten Wilde,et al.  A power-measurement methodology for large-scale, high-performance computing , 2014, ICPE.

[11]  Fei Wu,et al.  MIND: A black-box energy consumption model for disk arrays , 2011, 2011 International Green Computing Conference and Workshops.

[12]  Jack J. Dongarra,et al.  Energy Footprint of Advanced Dense Numerical Linear Algebra Using Tile Algorithms on Multicore Architectures , 2012, 2012 Second International Conference on Cloud and Green Computing.

[13]  Yang Tang,et al.  NCCloud: applying network coding for the storage repair in a cloud-of-clouds , 2012, FAST.

[14]  Stephen W. Poole,et al.  Application Power Signature Analysis , 2014, 2014 IEEE International Parallel & Distributed Processing Symposium Workshops.

[15]  Cheng Huang,et al.  Rethinking erasure codes for cloud file systems: minimizing I/O for recovery and degraded reads , 2012, FAST.

[16]  Robert Latham,et al.  24/7 Characterization of petascale I/O workloads , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[17]  Ian Sommerville,et al.  CloudMonitor: Profiling Power Usage , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[18]  Christos Kozyrakis,et al.  Full-System Power Analysis and Modeling for Server Environments , 2006 .

[19]  Vibhore Vardhan,et al.  Power Consumption Breakdown on a Modern Laptop , 2004, PACS.

[20]  Raghunath Othayoth Nambiar,et al.  Energy cost, the key challenge of today's data centers: a power consumption analysis of TPC-C results , 2008, Proc. VLDB Endow..

[21]  Catherine D. Schuman,et al.  A Performance Evaluation and Examination of Open-Source Erasure Coding Libraries for Storage , 2009, FAST.

[22]  Giovanni Giuliani,et al.  A methodology to predict the power consumption of servers in data centres , 2011, e-Energy.

[23]  Courtenay T. Vaughan,et al.  Topics on measuring real power usage on high performance computing platforms , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[24]  Zhichao Li,et al.  Power consumption in enterprise-scale backup storage systems , 2012, FAST.

[25]  Stephen W. Poole,et al.  Power measurement for high performance computing: State of the art , 2011, 2011 International Green Computing Conference and Workshops.