VIALACTEA science gateway for Milky Way analysis

Abstract This paper presents the latest developments on the VIALACTEA Science Gateway in the context of the FP7 VIALACTEA project. The science gateway operates as a central workbench for the VIALACTEA community in order to allow astronomers to process the new-generation surveys (from Infrared to Radio) of the Galactic Plane to build and deliver a quantitative 3D model of our Milky Way Galaxy. The final model will be used as a template for external galaxies to study star formation across the cosmic time. The adopted agile software development process allowed to fulfill the community needs in terms of required workflows and underlying resource monitoring. Scientific requirements arose during the process highlighted the needs for easy parameter setting, fully embarrassingly parallel computations and large-scale input dataset processing. Therefore the science gateway based on the WS-PGRADE/gUSE framework has been able to fulfill the requirements mainly exploiting the parameter sweep paradigm and parallel job execution of the workflow management system. Moving from development to production environment an efficient resource monitoring system has been implemented to easily analyze and debug sources of potential failures occurred during workflow computations. The results of the resource monitoring system are exploitable not only for IT experts, administrators and workflow developers but also for the end-users of the gateway. The affiliation to the STARnet Gateway Federation ensures the sustainability of the presented products after the end of the project, allowing the usage of the VIALACTEA Science Gateway to all the stakeholders, not only to the community members.

[1]  Julián Garrido,et al.  Web Services as Building Blocks for Science Gateways in Astrophysics , 2015, 2015 7th International Workshop on Science Gateways.

[2]  Ugo Becciani,et al.  An Innovative Science Gateway for the Cherenkov Telescope Array , 2015, Journal of Grid Computing.

[3]  L. Calzoletti,et al.  unimap: a generalized least-squares map maker for Herschel data , 2015 .

[4]  Ugo Becciani,et al.  VisIVO Science Gateway: a Collaborative Environment for the Astrophysics Community , 2013, IWSG.

[5]  Ugo Becciani,et al.  Integrated data access, visualization and analysis for Galactic Plane surveys: the VIALACTEA case , 2016, Proceedings of the International Astronomical Union.

[6]  Sergio Molinari,et al.  The Herschel InfraRed Galactic Plane Survey: A Panoramic View of Star Formation in the Milky Way , 2018, Proceedings of Frontier Research in Astrophysics – III — PoS(FRAPWS2018).

[7]  K. A. Marsh,et al.  Temperature as a third dimension in column-density mapping of dusty astrophysical structures associated with star formation , 2015, 1509.08699.

[8]  Péter Kacsuk,et al.  A Meta-Brokering Framework for Science Gateways , 2016, Journal of Grid Computing.

[9]  E. Schisano,et al.  THE IDENTIFICATION OF FILAMENTS ON FAR-INFRARED AND SUBMILLIMITER IMAGES: MORPHOLOGY, PHYSICAL CONDITIONS AND RELATION WITH STAR FORMATION OF FILAMENTARY STRUCTURE , 2014, 1406.4443.

[10]  Richard Grunzke,et al.  Enhanced Usability of Managing Workflows in an Industrial Data Gateway , 2015, 2015 IEEE 11th International Conference on e-Science.

[11]  Massimo Brescia,et al.  Machine learning based data mining for Milky Way filamentary structures reconstruction , 2016, Advances in Neural Networks.

[12]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[13]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[14]  Marlon E. Pierce,et al.  Apache Airavata: Design and Directions of a Science Gateway Framework , 2014, 2014 6th International Workshop on Science Gateways.

[15]  Miklós Kozlovszky,et al.  WS-PGRADE/gUSE Generic DCI Gateway Framework for a Large Variety of User Communities , 2012, Journal of Grid Computing.

[16]  Ugo Becciani,et al.  Milky Way Analysis through a Science Gateway: Workflows and Resource Monitoring , 2016, IWSG.

[17]  Ugo Becciani,et al.  Creating Gateway Alliances Using WS-PGRADE/gUSE , 2014, Science Gateways for Distributed Computing Infrastructures.

[18]  Péter Kacsuk,et al.  Building Science Gateways by Utilizing the Generic WS-Pgrade/gUSE Workflow System , 2013, Comput. Sci..

[19]  Mauricio Solar,et al.  Astronomical data analysis software and systems , 2018, Astron. Comput..

[20]  Ugo Becciani,et al.  Advanced Environment for Knowledge Discovery in the VIALACTEA Project , 2015 .

[21]  Ákos Balaskó.  Workflow Concept of WS-PGRADE/gUSE , 2014, Science Gateways for Distributed Computing Infrastructures.

[22]  Ugo Becciani,et al.  Science gateway technologies for the astrophysics community , 2015, Concurr. Comput. Pract. Exp..

[23]  Ugo Becciani,et al.  Mobile application development exploiting science gateway technologies , 2015, Concurr. Comput. Pract. Exp..

[24]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[25]  Miklós Kozlovszky,et al.  DCI Bridge: Executing WS-PGRADE Workflows in Distributed Computing Infrastructures , 2014, Science Gateways for Distributed Computing Infrastructures.

[26]  Raminderjeet Singh,et al.  Enabling dark energy survey science analysis with simulations on XSEDE resources , 2013, XSEDE.

[27]  Marco Molinaro,et al.  VIALACTEA knowledge base homogenizing access to Milky Way data , 2016, Astronomical Telescopes + Instrumentation.

[28]  Carole A. Goble,et al.  The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud , 2013, Nucleic Acids Res..

[29]  M. Sauvage,et al.  Hi-GAL: The Herschel Infrared Galactic Plane Survey , 2010, 1001.2106.

[30]  Mark Taylor,et al.  STILTS - A Package for Command-Line Processing of Tabular Data , 2006 .

[31]  Péter Kacsuk,et al.  Remote Storage Resource Management in WS-PGRADE/gUSE , 2014, Science Gateways for Distributed Computing Infrastructures.

[32]  P. Kacsuk,et al.  WS-PGRADE: Supporting parameter sweep applications in workflows , 2008, 2008 Third Workshop on Workflows in Support of Large-Scale Science.

[33]  W. Freudling,et al.  Automated data reduction workflows for astronomy , 2013, 1311.5411.

[34]  S. Sánchez-Expósito,et al.  AstroTaverna - Building workflows with Virtual Observatory services , 2014, Astron. Comput..

[35]  K. L. J. Rygl,et al.  THE FIRST Hi-GAL OBSERVATIONS OF THE OUTER GALAXY: A LOOK AT STAR FORMATION IN THE THIRD GALACTIC QUADRANT IN THE LONGITUDE RANGE 216.°5 ≲ ℓ ≲ 225.°5 , 2013, 1304.7358.

[36]  Massimo Brescia,et al.  C 3 , A Command-line Catalog Cross-match Tool for Large Astrophysical Catalogs , 2017 .

[37]  Edward A. Lee,et al.  Scientific workflow management and the Kepler system , 2006, Concurr. Comput. Pract. Exp..