ODI - Portal, Pipeline, and Archive (ODI-PPA): a web-based astronomical compute archive, visualization, and analysis service

The One Degree Imager-Portal, Pipeline, and Archive (ODI-PPA) is a web science gateway that provides astronomers a modern web interface that acts as a single point of access to their data, and rich computational and visualization capabilities. Its goal is to support scientists in handling complex data sets, and to enhance WIYN Observatory's scientific productivity beyond data acquisition on its 3.5m telescope. ODI-PPA is designed, with periodic user feedback, to be a compute archive that has built-in frameworks including: (1) Collections that allow an astronomer to create logical collations of data products intended for publication, further research, instructional purposes, or to execute data processing tasks (2) Image Explorer and Source Explorer, which together enable real-time interactive visual analysis of massive astronomical data products within an HTML5 capable web browser, and overlaid standard catalog and Source Extractor-generated source markers (3) Workflow framework which enables rapid integration of data processing pipelines on an associated compute cluster and users to request such pipelines to be executed on their data via custom user interfaces. ODI-PPA is made up of several light-weight services connected by a message bus; the web portal built using Twitter/Bootstrap, AngularJS and jQuery JavaScript libraries, and backend services written in PHP (using the Zend framework) and Python; it leverages supercomputing and storage resources at Indiana University. ODI-PPA is designed to be reconfigurable for use in other science domains with large and complex datasets, including an ongoing offshoot project for electron microscopy data.

[1]  Michael D. Young,et al.  Integrating the ODI-PPA scientific gateway with the QuickReduce pipeline for on-demand processing , 2014, Astronomical Telescopes and Instrumentation.

[2]  David A. Bohlender,et al.  Overview of the Gemini Science Archive , 2006 .

[3]  Craig A. Stewart,et al.  Publications, presentations, and news pertaining to National Science Foundation grant number 0521433 – MRI: Acquisition of a High-Speed, High Capacity Storage System to Support Scientific Computing: The Data Capacitor , 2011 .

[4]  Drummond Reed,et al.  OpenID 2.0: a platform for user-centric identity management , 2006, DIM '06.

[5]  Ralf Kotulla The QuickReduce data reduction pipeline for the WIYN One Degree Imager , 2013 .

[6]  W. A. Joye,et al.  New Features of SAOImage DS9 , 2003 .

[7]  Mark Taylor,et al.  TOPCAT & STIL: Starlink Table/VOTable Processing Software , 2005 .

[8]  F. Ochsenbein,et al.  The VizieR database of astronomical catalogues , 2000, astro-ph/0002122.

[9]  Emmanuel Bertin,et al.  The TERAPIX Pipeline , 2002 .

[10]  Michael D. Young,et al.  FRIAA: A FRamework for Web-based Interactive Astronomy Analysis using AMQP Messaging , 2013 .

[11]  Nancy Wilkins-Diehr,et al.  TeraGrid Science Gateways and Their Impact on Science , 2008, Computer.

[12]  Michael D. Young,et al.  IMAGE EXPLORER: Astronomical Image Analysis on an HTML5-based Web Application , 2014 .

[13]  Daniel R. Harbeck,et al.  The WIYN one degree imager 2014: performance of the partially populated focal plane and instrument upgrade path , 2014, Astronomical Telescopes and Instrumentation.

[14]  Steve Vinoski,et al.  Advanced Message Queuing Protocol , 2006, IEEE Internet Computing.

[15]  E. Bertin,et al.  SExtractor: Software for source extraction , 1996 .

[16]  Michael D. Young,et al.  SOURCE EXPLORER: Towards Web Browser Based Tools for Astronomical Source Visualization and Analysis , 2014 .