Pan, Feng Exploring Energy-time Tradeoff in High Performance Computing. (under the Direc- Tion of Vincent W. Freeh). Exploring Energy-time Tradeoff in High Performance Computing Contents

Recently, energy has become an important issue in high-performance computing. For example, low power/energy supercomputers, such as Green Destiny, have been built; the idea is to increase the energy efficiency of nodes. However, these clusters tend to save energy at the expense of performance. Our approach is instead to use high-performance cluster nodes with frequency scalable AMD-64 processors; energy can be saved by scaling down the CPU. Our cluster provides a different balance of power and performance than low-power machines such as Green Destiny. In particular, its performance is on par with a Pentium 4-equipped cluster. This thesis investigates the energy consumption and execution time of a wide range of applications, both serial and parallel, on a power-scalable cluster. We study via direct measurement both intra-node and inter-node effects of memory and communication bottlenecks, respectively. Additionally , we present a framework for executing a single application in several frequency-voltage settings. The basic idea is to first divide programs in to phases and then execute a series of experiments , with each phase assigned a prescribed frequency. Our results show that a power-scalable cluster has the potential to save energy by scaling the processor down to lower energy levels. Furthermore, we found that for some programs, it is possible to both consume less energy and execute in less time by increasing number of nodes and reducing frequency-voltage setting of the nodes. Additionally, we found that our phase detecting heuristic can find assignments of frequency to phase that is superior to any fixed-frequency solution.

[1]  Mary Baker,et al.  Non-volatile memory for fast, reliable file systems , 1992, ASPLOS V.

[2]  Paul Horton,et al.  A Quantitative Analysis of Disk Drive Power Management in Portable Computers , 1994, USENIX Winter.

[3]  Fred Douglis,et al.  Adaptive Disk Spin-Down Policies for Mobile Computers , 1995, Comput. Syst..

[4]  Darrell D. E. Long,et al.  A dynamic disk spin-down technique for mobile computing , 1996, MobiCom '96.

[5]  Mark Horowitz,et al.  Energy dissipation in general purpose microprocessors , 1996, IEEE J. Solid State Circuits.

[6]  A. M. Abdullah,et al.  Wireless lan medium access control (mac) and physical layer (phy) specifications , 1997 .

[7]  Ken Kennedy,et al.  Automatic data layout for distributed-memory machines , 1998, TOPL.

[8]  Thomas D. Burd,et al.  The simulation and evaluation of dynamic voltage scaling algorithms , 1998, Proceedings. 1998 International Symposium on Low Power Electronics and Design (IEEE Cat. No.98TH8379).

[9]  Carla Schlatter Ellis,et al.  The case for higher-level power management , 1999, Proceedings of the Seventh Workshop on Hot Topics in Operating Systems.

[10]  Rolf Rabenseifner,et al.  Automatic Profiling of MPI Applications with Hardware Performance Counters , 1999, PVM/MPI.

[11]  Karsten Schwan,et al.  Power-aware communication for mobile computers , 1999, 1999 IEEE International Workshop on Mobile Multimedia Communications (MoMuC'99) (Cat. No.99EX384).

[12]  Remzi H. Arpaci-Dusseau,et al.  Architectural Requirements and Scalability of the NAS Parallel Benchmarks , 1999, ACM/IEEE SC 1999 Conference (SC'99).

[13]  Amin Vahdat,et al.  Every joule is precious: the case for revisiting operating system design for energy efficiency , 2000, ACM SIGOPS European Workshop.

[14]  Alvin R. Lebeck,et al.  Power aware page allocation , 2000, SIGP.

[15]  Soonhoi Ha,et al.  Dynamic voltage scheduling technique for low-power multimedia applications using buffers , 2001, ISLPED '01.

[16]  Flavius Gruian Hard real-time scheduling for low-energy using stochastic data and DVS processors , 2001, ISLPED'01: Proceedings of the 2001 International Symposium on Low Power Electronics and Design (IEEE Cat. No.01TH8581).

[17]  Enrique V. Carrera,et al.  Load balancing and unbalancing for power and performance in cluster-based systems , 2001 .

[18]  David K. Lowenthal,et al.  Accurate data redistribution cost estimation in software distributed shared memory systems , 2001, PPoPP '01.

[19]  K. Langendoen,et al.  Energy priority scheduling for variable voltage processors , 2001, ISLPED'01: Proceedings of the 2001 International Symposium on Low Power Electronics and Design (IEEE Cat. No.01TH8581).

[20]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[21]  Sandhya Dwarkadas,et al.  Dynamic adaptation to available resources for parallel computing in an autonomous network of workstations , 2001, PPoPP '01.

[22]  David F. Heidel,et al.  An Overview of the BlueGene/L Supercomputer , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[23]  Mahmut T. Kandemir,et al.  Scheduler-based DRAM energy management , 2002, DAC '02.

[24]  Michael Kistler,et al.  The case for power management in web servers , 2002 .

[25]  Vincent W. Freeh,et al.  Dynamic Power Management using Feedback , 2002 .

[26]  Amin Vahdat,et al.  Currentcy: Unifying Policies for Resource Management , 2002 .

[27]  Vincent K. N. Lau,et al.  Automatic Performance Setting for Dynamic Voltage Scaling , 2002, Wirel. Networks.

[28]  Ricardo Bianchini,et al.  Application transformations for energy and performance-aware device management , 2002, Proceedings.International Conference on Parallel Architectures and Compilation Techniques.

[29]  Ricardo Bianchini,et al.  Dynamic cluster reconfiguration for power and performance , 2003 .

[30]  Mahmut T. Kandemir,et al.  Reducing Disk Power Consumption in Servers with DRPM , 2003, Computer.

[31]  Karthick Rajamani,et al.  Energy Management for Commercial Servers , 2003, Computer.

[32]  Ulrich Kremer,et al.  The design, implementation, and evaluation of a compiler algorithm for CPU energy reduction , 2003, PLDI '03.

[33]  E. N. Elnozahy,et al.  Energy Conservation Policies for Web Servers , 2003, USENIX Symposium on Internet Technologies and Systems.

[34]  DRPM: dynamic speed control for power management in server class disks , 2003, 30th Annual International Symposium on Computer Architecture, 2003. Proceedings..

[35]  James E. Smith,et al.  Comparing program phase detection techniques , 2003, Proceedings. 36th Annual IEEE/ACM International Symposium on Microarchitecture, 2003. MICRO-36..

[36]  Michael L. Scott,et al.  Energy efficiency through burstiness , 2003, 2003 Proceedings Fifth IEEE Workshop on Mobile Computing Systems and Applications.

[37]  Michael C. Huang,et al.  Positional adaptation of processors: application to energy reduction , 2003, ISCA '03.

[38]  Ricardo Bianchini,et al.  Conserving disk energy in network servers , 2003, ICS '03.

[39]  Kevin Skadron,et al.  Power-aware QoS management in Web servers , 2003, RTSS 2003. 24th IEEE Real-Time Systems Symposium, 2003.

[40]  Masanori Kameyama,et al.  A 15.2 TFlops Simulation of Geodynamo on the Earth Simulator , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[41]  Y. Charlie Hu,et al.  Program counter based techniques for dynamic power management , 2004, 10th International Symposium on High Performance Computer Architecture (HPCA'04).

[42]  Vincent W. Freeh,et al.  Safe Overprovisioning: Using Power Limits to Increase Aggregate Throughput , 2004, PACS.

[43]  Yuanyuan Zhou,et al.  Reducing Energy Consumption of Disk Storage Using Power-Aware Cache Management , 2004, 10th International Symposium on High Performance Computer Architecture (HPCA'04).

[44]  David K. Lowenthal,et al.  Client-centered energy savings for concurrent HTTP connections , 2004, NOSSDAV '04.

[45]  Kang Li,et al.  Client-centered energy and delay analysis for TCP downloads , 2004, Twelfth IEEE International Workshop on Quality of Service, 2004. IWQOS 2004..

[46]  Vincent W. Freeh,et al.  Boosting Data Center Performance Through Non-Uniform Power Allocation , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[47]  Hari Balakrishnan,et al.  Minimizing Energy for Wireless Web Access with Bounded Slowdown , 2005, Wirel. Networks.

[48]  Feng Pan,et al.  Exploring the energy-time tradeoff in MPI programs on a power-scalable cluster , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[49]  David K. Lowenthal,et al.  Using multiple energy gears in MPI programs on a power-scalable cluster , 2005, PPoPP.

[50]  Feng Pan,et al.  Exploring the energy-time tradeoff in high-performance computing , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.