Jetstream2: Accelerating cloud computing via Jetstream

Jetstream2 will be a category I production cloud resource that is part of the National Science Foundation’s Innovative HPC Program. The project’s aim is to accelerate science and engineering by providing “on-demand” programmable infrastructure built around a core system at Indiana University and four regional sites. Jetstream2 is an evolution of the Jetstream platform, which functions primarily as an Infrastructure-as-a-Service cloud. The lessons learned in cloud architecture, distributed storage, and container orchestration have inspired changes in both hardware and software for Jetstream2. These lessons have wide implications as institutions converge HPC and cloud technology while building on prior work when deploying their own cloud environments. Jetstream2’s next-generation hardware, robust open-source software, and enhanced virtualization will provide a significant platform to further cloud adoption within the US research and education communities.

[1]  Richard Knepper,et al.  Beyond Campus Bridging: A retrospective of Cyberinfrastructure Integration Efforts , 2019, PEARC.

[2]  Nancy Wilkins-Diehr,et al.  The Science Gateways Community Institute at Two Years , 2018, PEARC.

[3]  Brett K. Beaulieu-Jones,et al.  Reproducibility of computational workflows is automated using continuous analysis , 2017, Nature Biotechnology.

[4]  Andrea Zonca,et al.  Deploying Jupyter Notebooks at scale on XSEDE resources for Science Gateways and workshops , 2018, PEARC.

[5]  Jim Basney,et al.  CILogon: A federated X.509 certification authority for cyberinfrastructure logon , 2014, Concurr. Comput. Pract. Exp..

[6]  Nancy Wilkins-Diehr,et al.  XSEDE: Accelerating Scientific Discovery , 2014, Computing in Science & Engineering.

[7]  M Ramamurthy Unidata Science Gateway for Enabling Science as a Service to Facilitate Open Science and Reproducible Research , 2020 .

[8]  Jim Basney,et al.  CILogon: A federated X.509 certification authority for cyberinfrastructure logon , 2013, Concurr. Comput. Pract. Exp..

[9]  Marlon Pierce,et al.  Virtual Clusters in the Jetstream Cloud: A story of elasticized HPC , 2019, Proceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing.

[10]  Sanjana Sudarshan,et al.  Exosphere - Bringing The Cloud Closer , 2020, 2020 IEEE/ACM International Workshop on Interoperability of Supercomputing and Cloud Technologies (SuperCompCloud).

[11]  John Michael Lowe,et al.  Performance Characteristics of Virtualized GPUs for Deep Learning , 2020, 2020 IEEE/ACM International Workshop on Interoperability of Supercomputing and Cloud Technologies (SuperCompCloud).

[12]  Custos: Security Middleware for Science Gateways , 2020, PEARC.

[13]  Steven M. Gallo,et al.  A Workload Analysis of NSF's Innovative HPC Resources Using XDMoD , 2018, ArXiv.

[14]  Doreen Ware,et al.  The iPlant Collaborative: Cyberinfrastructure for Enabling Data to Discovery for the Life Sciences , 2016, PLoS biology.

[15]  Ian T. Foster,et al.  Jetstream: a self-provisioned, scalable science and engineering cloud environment , 2015, XSEDE.