Cluster Computing with OpenHPC

OpenHPC is a newly formed, community-based project that is providing an integrated collection of HPC-centric software components that can be used to implement a full-featured reference HPC compute resource. Components span the entire HPC software ecosystem including provisioning and system administration tools, resource management, I/O services, development tools, numerical libraries, and performance analysis tools. Common clustering tools and scientific libraries are distributed as pre-built and validated binaries and are meant to seamlessly layer on top of existing Linux distributions. The architecture of OpenHPC is intentionally modular to allow end users to pick and choose from the provided components, as well as to foster a community of open contribution. This paper presents an overview of the underlying community vision, governance structure, packaging conventions, build and release infrastructure and validation methodologies.

[1]  Wei Huang,et al.  Design of High Performance MVAPICH2: MPI2 over InfiniBand , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[2]  Steven G. Johnson,et al.  The Design and Implementation of FFTW3 , 2005, Proceedings of the IEEE.

[3]  Andy B. Yoo,et al.  Approved for Public Release; Further Dissemination Unlimited X-ray Pulse Compression Using Strained Crystals X-ray Pulse Compression Using Strained Crystals , 2002 .

[4]  Peter W. Osel,et al.  Abstract Yourself With Modules , 1996, LISA.

[5]  Philip M. Papadopoulos,et al.  NPACI: rocks: tools and techniques for easily deploying manageable Linux clusters , 2001, Proceedings 42nd IEEE Symposium on Foundations of Computer Science.

[6]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[7]  Andy Georges,et al.  EasyBuild: Building Software with Ease , 2012, 2012 SC Companion: High Performance Computing, Networking Storage and Analysis.

[8]  Kohei Ichikawa,et al.  Building Secure and Transparent Inter-Cloud Infrastructure for Scientific Applications , 2012, High Performance Computing Workshop.

[9]  Stephen L. Scott.  OSCAR and the Beowulf arms race for the "cluster standard" , 2001, Proceedings 42nd IEEE Symposium on Foundations of Computer Science.

[10]  Philip M. Papadopoulos.  Extending clusters to Amazon EC2 using the Rocks toolkit , 2011, Int. J. High Perform. Comput. Appl..

[11]  Federico D. Sacerdoti,et al.  Rolls: modifying a standard system installer to support user-customizable cluster frontend appliances , 2004, 2004 IEEE International Conference on Cluster Computing (IEEE Cat. No.04EX935).

[12]  Tommy Minyard,et al.  Best practices for the deployment and management of production HPC clusters , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[13]  George Bosilca,et al.  Open MPI: Goals, Concept, and Design of a Next Generation MPI Implementation , 2004, PVM/MPI.

[14]  Bronis R. de Supinski,et al.  The Spack package manager: bringing order to HPC software chaos , 2015, SC15: International Conference for High Performance Computing, Networking, Storage and Analysis.