The Dark Energy Survey Image Processing Pipeline

The Dark Energy Survey (DES) is a five-year optical imaging campaign with the goal of understanding the origin of cosmic acceleration. DES performs a similar to 5000 deg(2) survey of the southern sky in five optical bands (g, r, i, z, Y) to a depth of similar to 24th magnitude. Contemporaneously, DES performs a deep, time-domain survey in four optical bands (g, r, i, z) over similar to 27 deg(2). DES exposures are processed nightly with an evolving data reduction pipeline and evaluated for image quality to determine if they need to be retaken. Difference imaging and transient source detection are also performed in the time domain component nightly. On a bi-annual basis, DES exposures are reprocessed with a refined pipeline and coadded to maximize imaging depth. Here we describe the DES image processing pipeline in support of DES science, as a reference for users of archival DES data, and as a guide for future astronomical surveys.

[1]  J. Munn,et al.  The USNO-B Catalog , 2002, astro-ph/0210694.

[2]  D. Schlegel,et al.  Maps of Dust IR Emission for Use in Estimation of Reddening and CMBR Foregrounds , 1997, astro-ph/9710327.

[3]  N. E. Sommer,et al.  Dark Energy Survey Year 1 Results: redshift distributions of the weak-lensing source galaxies , 2017, Monthly Notices of the Royal Astronomical Society.

[4]  Erin S. Sheldon,et al.  Practical Weak-lensing Shear Measurement with Metacalibration , 2017, 1702.02601.

[5]  P. Astier,et al.  The brighter-fatter effect and pixel correlations in CCD sensors , 2014, 1402.0725.

[6]  A scheme to deal accurately and efficiently with complex angular masks in galaxy surveys , 2003, astro-ph/0306324.

[7]  Y. Mellier,et al.  The XMM-LSS survey. Survey design and first results , 2003, astro-ph/0305191.

[8]  M. Skrutskie,et al.  The Two Micron All Sky Survey (2MASS) , 2006 .

[9]  James Annis,et al.  ObsTac: automated execution of Dark Energy Survey observing tactics. , 2013 .

[10]  C. B. D'Andrea,et al.  The DES Science Verification weak lensing shear catalogues , 2015, Monthly Notices of the Royal Astronomical Society.

[11]  Adrian T. Lee,et al.  The 10 Meter South Pole Telescope , 2009, 0907.4445.

[12]  R. C. Smith,et al.  Cyber-infrastructure to support science and data management for the Dark Energy Survey , 2006, SPIE Astronomical Telescopes + Instrumentation.

[13]  A. K. Inoue,et al.  The Hyper Suprime-Cam SSP Survey: Overview and Survey Design , 2017, 1704.05858.

[14]  E. al.,et al.  The Sloan Digital Sky Survey: Technical summary , 2000, astro-ph/0006396.

[15]  F. Roddier V The Effects of Atmospheric Turbulence in Optical Astronomy , 1981 .

[16]  Eric Neilsen,et al.  The Dark Energy Survey data management system , 2008, Astronomical Telescopes + Instrumentation.

[17]  B. Yanny,et al.  Dark Energy Survey year 1 results: Cosmological constraints from galaxy clustering and weak lensing , 2017, Physical Review D.

[18]  Rachel Mandelbaum,et al.  Metacalibration: Direct Self-Calibration of Biases in Shear Measurement , 2017, 1702.02600.

[19]  A. Hopkins,et al.  A 1.4-GHz survey of the southern European Large-Area ISO Survey region , 1999 .

[20]  E. Bertin,et al.  SExtractor: Software for source extraction , 1996 .

[21]  D. DePoy,et al.  Focal plane detectors for Dark Energy Camera (DECam) , 2010, Astronomical Telescopes + Instrumentation.

[22]  E. Greisen,et al.  Representations of celestial coordinates in FITS , 2002, astro-ph/0207413.

[23]  B. Yanny,et al.  Instrumental Response Model and Detrending for the Dark Energy Camera , 2017, 1706.09928.

[24]  K. Gorski,et al.  HEALPix: A Framework for High-Resolution Discretization and Fast Analysis of Data Distributed on the Sphere , 2004, astro-ph/0409513.

[25]  J. Mohr,et al.  THE BLANCO COSMOLOGY SURVEY: DATA ACQUISITION, PROCESSING, CALIBRATION, QUALITY DIAGNOSTICS, AND DATA RELEASE , 2012, 1204.1210.

[26]  Observatoire de la Côte d'Azur,et al.  Gaia Data Release 1. Summary of the astrometric, photometric, and survey properties , 2016, 1609.04172.

[27]  M. Sullivan,et al.  THE DIFFERENCE IMAGING PIPELINE FOR THE TRANSIENT SEARCH IN THE DARK ENERGY SURVEY , 2015, 1507.05137.

[28]  M. Swanson,et al.  Methods for rapidly processing angular masks of next-generation galaxy surveys , 2007, 0711.4352.

[29]  Igor Sfiligoi,et al.  FermiGrid—experience and future plans , 2008 .

[30]  R. Nichol,et al.  The Dark Energy Survey: more than dark energy - an overview , 2016, 1601.00329.

[31]  Jeffrey M. Kubo,et al.  THE SLOAN DIGITAL SKY SURVEY COADD: 275 deg2 OF DEEP SLOAN DIGITAL SKY SURVEY IMAGING ON STRIPE 82 , 2011, The Astrophysical Journal.

[32]  Gary M. Bernstein,et al.  Characterization and correction of charge-induced pixel shifts in DECam , 2015, 1501.02802.

[33]  P. S. Bunclark,et al.  Astronomical Data Analysis Software and Systems , 2008 .

[34]  Juan Estrada,et al.  0.250mm-thick CCD packaging for the Dark Energy Survey Camera array , 2006, SPIE Astronomical Telescopes + Instrumentation.

[35]  M. Raddick,et al.  The Fifth Data Release of the Sloan Digital Sky Survey , 2007, 0707.3380.

[36]  T. Arentoft,et al.  On Cross-talk Correction of Images from Multiple-port CCDs , 2014 .

[37]  Jake Vanderplas,et al.  SNANA: A Public Software Package for Supernova Analysis , 2009, 0908.4280.

[38]  Larry Denneau,et al.  The Pan-STARRS wide-field optical/NIR imaging survey , 2010, Astronomical Telescopes + Instrumentation.

[39]  Eduardo Serrano,et al.  LSST: From Science Drivers to Reference Design and Anticipated Data Products , 2008, The Astrophysical Journal.

[40]  D. Schneider,et al.  THE CHANDRA DEEP FIELD-SOUTH SURVEY: 4 Ms SOURCE CATALOGS , 2011, 1105.5643.

[41]  R. C. Wolf,et al.  AUTOMATED TRANSIENT IDENTIFICATION IN THE DARK ENERGY SURVEY , 2015, 1504.02936.

[42]  B. Yanny,et al.  Forward Global Photometric Calibration of the Dark Energy Survey , 2017, 1706.01542.

[43]  K. Abazajian,et al.  THE SEVENTH DATA RELEASE OF THE SLOAN DIGITAL SKY SURVEY , 2008, 0812.0649.

[44]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[45]  D. Schlegel,et al.  Maps of Dust Infrared Emission for Use in Estimation of Reddening and Cosmic Microwave Background Radiation Foregrounds , 1998 .

[46]  J.Lee,et al.  THE DARK ENERGY CAMERA , 2004, The Dark Energy Survey.

[47]  Kenneth Patton,et al.  The readout and control system of the Dark Energy Camera , 2012, Other Conferences.

[48]  Andrew J. Connolly,et al.  The LSST Data Management System , 2015, 1512.07914.

[49]  Emmanuel Bertin,et al.  Detection and removal of artifacts in astronomical images , 2016, Astron. Comput..

[50]  Jeffrey S. Vetter Contemporary High Performance Computing: From Petascale toward Exascale , 2013 .

[51]  B. Yanny,et al.  Dark Energy Survey Year 1 Results: The Photometric Data Set for Cosmology , 2017, 1708.01531.

[52]  A. J. Connolly,et al.  Simultaneous Multicolor Detection of Faint Galaxies in the Hubble Deep Field , 1998, astro-ph/9811086.

[53]  Edwin A. Valentijn,et al.  The Kilo-Degree Survey , 2012, Experimental Astronomy.