Jetstream—Early operations performance, adoption, and impacts

Jetstream is a first of its kind system for the NSF — a distributed production cloud resource. We review the purpose for creating Jetstream, discuss Jetstream's key characteristics, describe our experiences from the first year of maintaining an OpenStack‐based cloud environment, and share some of the early scientific impacts achieved by Jetstream users. Jetstream offers a unique capability within the XSEDE‐supported US national cyberinfrastructure, delivering interactive virtual machines (VMs) via the Atmosphere interface. As a multi‐region deployment that operates as an integrated system, Jetstream is proving effective in supporting modes and disciplines of research traditionally underrepresented on larger XSEDE‐supported clusters and supercomputers. Already, Jetstream has been used to perform research and education in biology, biochemistry, atmospheric science, earth science, and computer science.

[1]  Marlon E. Pierce,et al.  Using the Jetstream Research Cloud to Provide Science Gateway Resources , 2017, 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID).

[2]  Richard J. Anderson.  At the University of Arkansas , 1980 .

[3]  M. Maslin,et al.  Defining the Anthropocene , 2015, Nature.

[4]  Douglas Thain,et al.  Work Queue + Python: A Framework For Scalable Scientific Ensemble Applications , 2011 .

[5]  Jim Basney,et al.  CILogon: A federated X.509 certification authority for cyberinfrastructure logon , 2013, Concurr. Comput. Pract. Exp..

[6]  Craig A. Stewart,et al.  Updated Acceptance Test Results for the Jetstream Production Environment , 2016 .

[7]  Daniel C. Stanzione,et al.  Jetstream: performance, early experiences, and early results , 2016, XSEDE.

[8]  Mark A. Davis,et al.  Anthropogenic impacts drive niche and conservation metrics of a cryptic rattlesnake on the Colorado Plateau of western North America , 2016, Royal Society Open Science.

[9]  G. Luikart,et al.  Genomics and the future of conservation genetics , 2010, Nature Reviews Genetics.

[10]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[11]  Craig A. Stewart,et al.  Jetstream: A Cloud System Enabling Learning in Higher Education Communities , 2017, SIGUCCS.

[12]  Ian T. Foster,et al.  Jetstream: a self-provisioned, scalable science and engineering cloud environment , 2015, XSEDE.

[13]  Douglas Thain,et al.  Scaling up genome annotation using MAKER and work queue , 2014, Int. J. Bioinform. Res. Appl..

[14]  Doreen Ware,et al.  The iPlant Collaborative: Cyberinfrastructure for Enabling Data to Discovery for the Life Sciences , 2016, PLoS biology.

[15]  F. Allendorf,et al.  Harnessing genomics for delineating conservation units. , 2012, Trends in ecology & evolution.

[16]  Adrian A. Harpold,et al.  Topographically driven differences in energy and water constrain climatic control on forest carbon sequestration , 2017 .

[17]  A. Nekrutenko,et al.  Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences , 2010, Genome Biology.

[18]  T. Sankey,et al.  UAV hyperspectral and lidar data and their fusion for arid and semi‐arid land vegetation monitoring , 2018 .

[19]  M. E. Douglas,et al.  Stream hierarchy defines riverscape genetics of a North American desert fish , 2013, Molecular ecology.

[20]  Nancy Wilkins-Diehr,et al.  A AAAA model to support science gateways with community accounts , 2007, Concurr. Comput. Pract. Exp..

[21]  Nancy Wilkins-Diehr,et al.  Science gateways today and tomorrow: positive perspectives of nearly 5000 members of the research community , 2015, Concurr. Comput. Pract. Exp..

[22]  Michael E. Douglas,et al.  DISCRIMINATING GILA ROBUSTA AND GILA CYPHA: RISK ASSESSMENT AND THE ENDANGERED SPECIES ACT , 1997 .

[23]  Craig A. Stewart,et al.  Jetstream overview -- what it is, how to apply for use , 2017 .

[24]  Marlis R. Douglas,et al.  Conservation and Management of Polytypic Species: The Little Striped Whiptail Complex (Aspidoscelis inornata) as a Case Study , 2014, Copeia.

[25]  P. Bryan Heidorn,et al.  Shedding Light on the Dark Data in the Long Tail of Science , 2008, Libr. Trends.

[26]  Mark A. Davis,et al.  Genetic rescue, the greater prairie chicken and the problem of conservation reliance in the Anthropocene , 2017, Royal Society Open Science.

[27]  Max R. Bangs,et al.  Fishes as a Template for Reticulate Evolution: A Case Study Involving Catostomus in the Colorado River Basin of Western North America , 2016 .