International Conference on Future Information Engineering Improving HPC Application Performance in Public Cloud

Improving as well as evaluating the performance of High Performance Computing (HPC) applications by migrating them to Cloud environments are widely considered as critical issues in the field of high performance and Cloud computing. However, poor network performance, heterogeneous and dynamic environments are some series of pitfalls for execution of HPC applications in Cloud. This paper proposes a new approach to improve the performance and scalability of HPC applications on Amazon’s HPC Cloud. The evidence from our approach points a significant improvement in speed up and scale up with the response rate of more than 20 percent parallel efficiency on the Cloud in comparison to dedicated HPC cluster. We state that the EC2 Cloud system is a feasible platform for deploying on-demand, small sized HPC

[1]  Kun Zhou,et al.  Data-Parallel Octrees for Surface Reconstruction. , 2011, IEEE transactions on visualization and computer graphics.

[2]  Alexandru Iosup,et al.  Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing , 2011, IEEE Transactions on Parallel and Distributed Systems.

[3]  Wenguang Chen,et al.  Cloud versus in-house cluster: Evaluating Amazon cluster compute instances for running MPI applications , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[4]  Peter Luksch,et al.  Analysis of Sparse Matrix-Vector Multiplication Using Iterative Method in CUDA , 2013, 2013 IEEE Eighth International Conference on Networking, Architecture and Storage.

[5]  Wessam Hassanein,et al.  Analyzing and enhancing the parallel sort operation on multithreaded architectures , 2010, The Journal of Supercomputing.

[6]  Peter Luksch,et al.  Scalable high performance computing in wide area network , 2012, 2012 International Conference on High Performance Computing & Simulation (HPCS).

[7]  Peter Luksch,et al.  Optimization of Communication in MPI-Based Clusters , 2014, 2014 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[8]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[9]  Peter Luksch,et al.  DMT: A new Approach of DiffServ QoS Methodology , 2012, ICT 2012.

[10]  Geoffrey C. Fox,et al.  High Performance Parallel Computing with Clouds and Cloud Technologies , 2009, CloudComp.

[11]  John Shalf,et al.  Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[12]  Pradeep Dubey,et al.  Fast sort on CPUs and GPUs: a case for bandwidth oblivious SIMD sort , 2010, SIGMOD Conference.

[13]  Guojing Cong,et al.  Fast PGAS Implementation of Distributed Graph Algorithms , 2010, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis.

[14]  Shujia Zhou,et al.  Case study for running HPC applications in public clouds , 2010, HPDC '10.

[15]  A. Grimshaw,et al.  High Performance and Scalable Radix Sorting: a Case Study of Implementing Dynamic Parallelism for GPU Computing , 2011, Parallel Process. Lett..

[16]  Peter Luksch,et al.  Optimizing Bandwidth by Employing MPLS AToM with QoS Support , 2012, 2012 IEEE Seventh International Conference on Networking, Architecture, and Storage.

[17]  Peter Luksch,et al.  High Performance Concurrent Multi-Path Communication for MPI , 2012, EuroMPI.