PROPER IMAGE SUBTRACTION—OPTIMAL TRANSIENT DETECTION, PHOTOMETRY, AND HYPOTHESIS TESTING

Transient detection and flux measurement via image subtraction stand at the base of time domain astronomy. Due to the varying seeing conditions, the image subtraction process is non-trivial, and existing solutions suffer from a variety of problems. Starting from basic statistical principles, we develop the optimal statistic for transient detection, flux measurement, and any image-difference hypothesis testing. We derive a closed-form statistic that: (1) is mathematically proven to be the optimal transient detection statistic in the limit of background-dominated noise, (2) is numerically stable, (3) for accurately registered, adequately sampled images, does not leave subtraction or deconvolution artifacts, (4) allows automatic transient detection to the theoretical sensitivity limit by providing credible detection significance, (5) has uncorrelated white noise, (6) is a sufficient statistic for any further statistical test on the difference image, and, in particular, allows us to distinguish particle hits and other image artifacts from real transients, (7) is symmetric to the exchange of the new and reference images, (8) is at least an order of magnitude faster to compute than some popular methods, and (9) is straightforward to implement. Furthermore, we present extensions of this method that make it resilient to registration errors, color-refraction errors, and any noise source that can be modeled. In addition, we show that the optimal way to prepare a reference image is the proper image coaddition presented in Zackay & Ofek. We demonstrate this method on simulated data and real observations from the PTF data release 2. We provide an implementation of this algorithm in MATLAB and Python.

[1]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[2]  E. S. Pearson,et al.  On the Problem of the Most Efficient Tests of Statistical Hypotheses , 1933 .

[3]  S. Karlin,et al.  The Theory of Decision Procedures for Distributions with Monotone Likelihood Ratio , 1956 .

[4]  A. V. Filippenko,et al.  THE IMPORTANCE OF ATMOSPHERIC DIFFERENTIAL REFRACTION IN SPECTROPHOTOMETRY. , 1982 .

[5]  P. Stetson.  DAOPHOT: A COMPUTER PROGRAM FOR CROWDED-FIELD STELLAR PHOTOMETRY , 1987 .

[6]  Supriya Chakrabarti,et al.  Astronomical data analysis from remote sites , 1988 .

[7]  R. Lupton,et al.  A Method for Optimal Image Subtraction , 1997, astro-ph/9712287.

[8]  C. Alard.  Image subtraction using a space-varying kernel , 2000 .

[9]  P. Dokkum.  Cosmic-Ray Rejection by Laplacian Edge Detection , 2001, astro-ph/0108003.

[10]  F. Yuan,et al.  Astronomical Image Subtraction by Cross-Convolution , 2008, 0801.0336.

[11]  D. M. Bramich,et al.  A new algorithm for difference image analysis , 2008, 0802.1273.

[12]  Puragra Guhathakurta,et al.  Supernovae in Low-Redshift Galaxy Clusters: Observations by the Wise Observatory Optical Transient Search (WOOTS) , 2007, 0711.0808.

[13]  Ernest E. Croner,et al.  The Palomar Transient Factory: System Overview, Performance, and First Results , 2009, 0906.5350.

[14]  Oxford,et al.  Exploring the Optical Transient Sky with the Palomar Transient Factory , 2009, 0906.5355.

[15]  M. Sullivan,et al.  The Palomar Transient Factory Photometric Calibration , 2011, 1112.4851.

[16]  E. O. Ofek,et al.  A VERY LARGE ARRAY SEARCH FOR 5 GHz RADIO TRANSIENTS AND VARIABLES AT LOW GALACTIC LATITUDES , 2011, 1103.3010.

[17]  John McKean,et al.  American Astronomical Society Meeting Abstracts , 2011 .

[18]  Ryan Chornock,et al.  Observed Fractions of Core-Collapse Supernova Types and Initial Masses of their Single and Binary Progenitor Stars , 2010, 1006.3899.

[19]  Richard Walters,et al.  REAL-TIME DETECTION AND RAPID MULTIWAVELENGTH FOLLOW-UP OBSERVATIONS OF A HIGHLY SUBLUMINOUS TYPE II-P SUPERNOVA FROM THE PALOMAR TRANSIENT FACTORY SURVEY , 2011, 1106.0400.

[20]  David Polishook,et al.  SN 2011dh: DISCOVERY OF A TYPE IIb SUPERNOVA FROM A COMPACT PROGENITOR IN THE NEARBY GALAXY M51 , 2011, 1106.3551.

[21]  A. J. Connolly,et al.  Regularization techniques for PSF-matching kernels - I. Choice of kernel basis , 2012, 1202.2902.

[22]  E. O. Ofek,et al.  Automating Discovery and Classification of Transients and Variable Stars in the Synoptic Survey Era , 2011, 1106.5491.

[23]  Charles Baltay,et al.  The La Silla-QUEST Low Redshift Supernova Survey , 2013 .

[24]  David Polishook,et al.  DISCOVERY OF A COSMOLOGICAL, RELATIVISTIC OUTBURST VIA ITS RAPIDLY FADING OPTICAL EMISSION , 2013, 1304.4236.

[25]  Eran O. Ofek,et al.  MAAT: MATLAB Astronomy and Astrophysics Toolbox , 2014 .

[26]  E. Ofek,et al.  PRECURSORS PRIOR TO TYPE IIn SUPERNOVA EXPLOSIONS ARE COMMON: PRECURSOR RATES, PROPERTIES, AND CORRELATIONS , 2014, 1401.5468.

[27]  Carnegie,et al.  A Wolf–Rayet-like progenitor of SN 2013cu from spectral observations of a stellar wind , 2014, Nature.

[28]  R. Kotak,et al.  Machine learning for transient discovery in Pan-STARRS1 difference imaging , 2015, 1501.05470.

[29]  D. A. Kann,et al.  iPTF14yb: THE FIRST DISCOVERY OF A GAMMA-RAY BURST AFTERGLOW INDEPENDENT OF A HIGH-ENERGY TRIGGER , 2015, 1504.00673.

[30]  C. W. Walter.  The Brighter-Fatter and other sensor effects in CCD simulations for precision astronomy , 2015 .

[31]  R. C. Wolf,et al.  AUTOMATED TRANSIENT IDENTIFICATION IN THE DARK ENERGY SURVEY , 2015, 1504.02936.

[32]  E. Bachelet,et al.  Difference image analysis: automatic kernel design using information criteria , 2015, 1512.04655.

[33]  Eduardo Serrano,et al.  LSST: From Science Drivers to Reference Design and Anticipated Data Products , 2008, The Astrophysical Journal.