A Platform of Scientific Workflows for Orchestration of Parallel Components in a Cloud of High Performance Computing Applications

HPC Shelf is a proposal of a cloud computing platform for development, deployment and execution of component-based HPC applications with large-scale parallel processing requirements. Through components, it addresses the challenge of dealing with heterogeneous resources in high-end parallel computing systems, including both software and hardware. This paper introduces SAFe, a framework for deriving HPC Shelf applications, and SAFeSWL, a scientific workflow language for describing the architectural and orchestration parts of parallel computing systems deployed by HPC Shelf applications through SAFe.

[1]  Robert G. Dimond,et al.  Accelerating Large-Scale HPC Applications Using FPGAs , 2011, 2011 IEEE 20th Symposium on Computer Arithmetic.

[2]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[3]  Francisco Heron de Carvalho Junior,et al.  Contextual Abstraction in a Type System for Component-Based High Performance Computing Platforms , 2013, SBLP.

[4]  Daniel S. Katz,et al.  Pegasus: A framework for mapping complex scientific workflows onto distributed systems , 2005, Sci. Program..

[5]  D. Post,et al.  Computational Science Demands a New Paradigm , 2005 .

[6]  Michael Griebel,et al.  Massively Parallel Fluid Simulations on Amazon's HPC Cloud , 2011, 2011 First International Symposium on Network Cloud Computing and Applications.

[7]  Sparsh Mittal,et al.  A Survey of Techniques for Architecting and Managing Asymmetric Multicore Processors , 2016, ACM Comput. Surv..

[8]  Edward A. Lee,et al.  Scientific workflow management and the Kepler system , 2006, Concurr. Comput. Pract. Exp..

[9]  Francisco Heron de Carvalho Junior,et al.  A case study on expressiveness and performance of component-oriented parallel programming , 2013, J. Parallel Distributed Comput..

[10]  Andrzej M. Goscinski,et al.  Toward Exposing and Accessing HPC Applications in a SaaS Cloud , 2012, 2012 IEEE 19th International Conference on Web Services.

[11]  Dennis Gannon,et al.  Workflows for e-Science, Scientific Workflows for Grids , 2014 .

[12]  Gordon S. Blair,et al.  Component-based architecture: the Fractal initiative , 2009, Ann. des Télécommunications.

[13]  Alexander S. Szalay,et al.  Petascale computational systems , 2007, Computer.

[14]  M. Prange,et al.  Scientific Computing in the Cloud , 2008, Computing in Science & Engineering.

[15]  Steven G. Parker,et al.  The CCA component model for high-performance scientific computing , 2006 .

[16]  Denis Caromel,et al.  GCM: a grid extension to Fractal for autonomous distributed components , 2009, Ann. des Télécommunications.

[17]  Francisco Heron de Carvalho Junior,et al.  Contextual abstraction in a type system for component-based high performance computing platforms , 2013, Sci. Comput. Program..

[18]  Haibo Hu,et al.  MapReduce Parallel Programming Model: A State-of-the-Art Survey , 2015, International Journal of Parallel Programming.

[19]  James Laudon,et al.  The Coming Wave of Multithreaded Chip Multiprocessors , 2007, International Journal of Parallel Programming.

[20]  Daniel S. Katz,et al.  Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking , 2009, Int. J. Comput. Sci. Eng..

[21]  Alejandro Duran,et al.  The Intel® Many Integrated Core Architecture , 2012, 2012 International Conference on High Performance Computing & Simulation (HPCS).

[22]  Thomas Fahringer,et al.  UML based Grid Workflow Modeling under ASKALON , 2007 .

[23]  Arie E. Kaufman,et al.  GPU Cluster for High Performance Computing , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[24]  Rajkumar Buyya,et al.  High-Performance Cloud Computing: A View of Scientific Applications , 2009, 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks.

[25]  Carole A. Goble,et al.  The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud , 2013, Nucleic Acids Res..