Adapting LIGO workflows to run in the Open Science Grid

During the first observation run the LIGO collaboration needed to offload some of its most, intense CPU workflows from its dedicated computing sites to opportunistic resources. Open Science Grid enabled LIGO to run PyCbC, RIFT and Bayeswave workflows to seamlessly run in a combination of owned and opportunistic resources. One of the challenges is enabling the workflows to use several heterogeneous resources in a coordinated and effective way.

[1]  Daniel S. Katz,et al.  BOSS-LDG: A Novel Computational Framework That Brings Together Blue Waters, Open Science Grid, Shifter and the LIGO Data Grid to Accelerate Gravitational Wave Discovery , 2017, 2017 IEEE 13th International Conference on e-Science (e-Science).

[2]  Frank Wuerthwein,et al.  The benefits and challenges of sharing glidein factory operations across nine time zones between OSG and CMS , 2012 .

[3]  I. Bird.  Computing for the Large Hadron Collider , 2011 .

[4]  E M Fajardo,et al.  Limits of the HTCondor Transfer System , 2019 .

[5]  Mats Rynge,et al.  OSG and GPUs: A tale of two use cases , 2019, EPJ Web of Conferences.

[6]  Brian Bockelman,et al.  Commissioning the HTCondor-CE for the Open Science Grid , 2015 .

[7]  Massimo Sgaravatto,et al.  The CREAM-CE: First experiences, results and requirements of the four LHC experiments , 2010 .

[8]  Gregory M. Kurtzer,et al.  Singularity 2.1.2 - Linux application and environment containers for science , 2016 .

[9]  Neil J. Cornish,et al.  Bayeswave: Bayesian inference for gravitational wave bursts and instrument glitches , 2014, 1410.3835.

[10]  Jorge Luis Rodriguez,et al.  The Open Science Grid , 2005 .

[11]  P. Elmer,et al.  XROOTD-A highly scalable architecture for data access , 2005 .

[12]  Brian Bockelman,et al.  StashCache: A Distributed Caching Federation for the Open Science Grid , 2019, PEARC.

[13]  Igor Sfiligoi,et al.  The Pilot Way to Grid Resources Using glideinWMS , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[14]  J. Letts,et al.  How much higher can HTCondor fly? , 2015 .

[15]  Richard O'Shaughnessy,et al.  Rapid and accurate parameter inference for coalescing, precessing compact binaries , 2018, 1805.10457.

[16]  M. Ellert,et al.  The NorduGrid project: using Globus toolkit for building GRID infrastructure , 2003 .

[17]  Nancy Wilkins-Diehr,et al.  Comet: Tales from the Long Tail: Two Years In and 10,000 Users Later , 2017, PEARC.

[18]  Neil J. Cornish,et al.  Bayesian inference for spectral estimation of gravitational wave detector noise , 2014, 1410.3852.