Cost-Effective HPC: The Community or the Cloud?

The increasing availability of commercial cloud computing resources in recent years has caught the attention of the high-performance computing (HPC) and scientific computing community. Many researchers have subsequently examined the relative computational performance of commercially available cloud computing offerings across a number of HPC application bench-marks and scientific workflows, but the analogous cost comparisons—i.e., comparisons between the cost of doing scientific computation in traditional HPC environments vs. cloud computing environments—are less frequently discussed and are difficult to make in meaning-ful ways. Such comparisons are of interest to traditional HPC resource providers as well as to members of the scientific research community who need access to HPC resources on a routine basis. This paper is a case study of costs incurred by faculty end-users of Purdue University’s HPC “community cluster” program. We develop and present a per node-hour cloud computing equivalent cost that is based upon actual usage patterns of the community cluster participants and is suitable for direct comparison to hourly costs charged by one commercial cloud computing provider. We find that the majority of community cluster participants incur substantially lower out-of-pocket costs in this community cluster program than in purchasing cloud computing HPC products.

[1]  Edward Walker,et al.  The Real Cost of a CPU Hour , 2009, Computer.

[2]  Geoffrey C. Fox,et al.  High Performance Parallel Computing with Clouds and Cloud Technologies , 2009, CloudComp.

[3]  Paolo Bientinesi,et al.  Can cloud computing reach the top500? , 2009, UCHPC-MAW '09.

[4]  Sebastien Goasguen,et al.  A study of a KVM-based cluster for grid computing , 2009, ACM-SE 47.

[5]  David H. Bailey,et al.  The Nas Parallel Benchmarks , 1991, Int. J. High Perform. Comput. Appl..

[6]  David H. Bailey,et al.  The Nas Parallel Benchmarks , 1991, Int. J. High Perform. Comput. Appl..

[7]  Yoichi Muraoka,et al.  HPC Benchmarks on Amazon EC2 , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[8]  Anders Hast,et al.  Proceedings of the combined workshops on UnConventional high performance computing workshop plus memory access workshop , 2009 .

[9]  Marty Humphrey,et al.  A quantitative analysis of high performance computing with Amazon's EC2 infrastructure: The death of the local cluster? , 2009, 2009 10th IEEE/ACM International Conference on Grid Computing.

[10]  Edward Walker,et al.  Benchmarking Amazon EC2 for High-Performance Scientific Computing , 2008, login Usenix Mag..

[11]  G. Bruce Berriman,et al.  Scientific workflow applications on Amazon EC2 , 2010, 2009 5th IEEE International Conference on E-Science Workshops.