From Laplace to Supernova SN 1987A: Bayesian Inference in Astrophysics

The Bayesian approach to probability theory is presented as an alternative to the currently used long-run relative frequency approach, which does not offer clear, compelling criteria for the design of statistical methods. Bayesian probability theory offers unique and demonstrably optimal solutions to well-posed statistical problems, and is historically the original approach to statistics. The reasons for earlier rejection of Bayesian methods are discussed, and it is noted that the work of Cox, Jaynes, and others answers earlier objections, giving Bayesian inference a firm logical and mathematical foundation as the correct mathematical language for quantifying uncertainty. The Bayesian approaches to parameter estimation and model comparison are outlined and illustrated by application to a simple problem based on the gaussian distribution. As further illustrations of the Bayesian paradigm, Bayesian solutions to two interesting astrophysical problems are outlined: the measurement of weak signals in a strong background, and the analysis of the neutrinos detected from supernova SN 1987A. A brief bibliography of astrophysically interesting applications of Bayesian inference is provided.

[1]  H. Jeffreys,et al.  Theory of probability , 1896 .

[2]  L. M. M.-T..  Theory of Probability , 1929, Nature.

[3]  H. Jeffreys.  On the relation between direct and inverse methods in statistics , 1937 .

[4]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[5]  David Lindley,et al.  Fiducial Distributions and Bayes' Theorem , 1958 .

[6]  R. T. Cox.  The Algebra of Probable Inference , 1962 .

[7]  A. Birnbaum.  On the Foundations of Statistical Inference , 1962 .

[8]  R. T. Cox,et al.  The Algebra of Probable Inference , 1962 .

[9]  Ward Edwards,et al.  Bayesian statistical inference for psychological research. , 1963 .

[10]  Ward Edwards,et al.  Bayesian Statistical Inference for Psychological Research , 1963 .

[11]  Melvin R. Novick,et al.  A Bayesian Indifference Procedure , 1965 .

[12]  A. P. Bowran.  A Boolean Algebra , 1965 .

[13]  David Lindley,et al.  Introduction to Probability and Statistics from a Bayesian Viewpoint , 1966 .

[14]  William Mendenhall,et al.  Introduction to Probability and Statistics , 1961, The Mathematical Gazette.

[15]  O. Penrose.  Foundations of statistical mechanics , 1969 .

[16]  D. Hearn.  Consistent analysis of gamma-ray astronomy experiments , 1969 .

[17]  Random observations. , 1971, Indian pediatrics.

[18]  F. James.  Statistical Methods in Experimental Physics , 1973 .

[19]  C. Chatfield,et al.  Statistics for physicists , 1971 .

[20]  A. Zellner.  An Introduction to Bayesian Inference in Econometrics , 1971 .

[21]  D. Hudson.,et al.  Statistics for Physicists , 1972 .

[22]  B. Frieden.  Restoring with maximum likelihood and maximum entropy. , 1972, Journal of the Optical Society of America.

[23]  K. Mardia.  Statistics of Directional Data , 1972 .

[24]  Alfréd Rényi,et al.  Letters on probability , 1973 .

[25]  G. Meek.  Mathematical statistics with applications , 1973 .

[26]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[27]  E. Jaynes.  The well-posed problem , 1973 .

[28]  E. O'mongain.  Application of Statistics to Results in Gamma Ray Astronomy , 1973, Nature.

[29]  A. Rényi,et al.  Letters on probability , 1975 .

[30]  B. Efron.  Biased Versus Unbiased Estimation , 1975 .

[31]  S. Bowyer,et al.  Parameter estimation in X-ray astronomy , 1976 .

[32]  C. Hooker,et al.  Foundations of Probability Theory, Statistical Inference, and Statistical Theories of Science , 1976 .

[33]  E. Jaynes,et al.  Confidence Intervals vs Bayesian Intervals , 1976 .

[34]  B. Dahn.  Foundations of Probability theory, statistical inference, and statistical theories of science , 1978 .

[35]  B. Roy Frieden,et al.  Restoring with maximum entropy. III. Poisson sources and backgrounds , 1978 .

[36]  S. Gull,et al.  Image reconstruction from incomplete and noisy data , 1978, Nature.

[37]  J. Bernardo.  Reference Posterior Distributions for Bayesian Inference , 1979 .

[38]  I. Good,et al.  The Maximum Entropy Formalism. , 1979 .

[39]  D. V. Lindley.  New developments in the application of Bayesian methods: Ahmet AYKAÇ and Carlo BRUMAT (editors) North-Holland, Amsterdam, 1977. xxiv + 385 pages, US $ 44.50, Dfl. 100.00 , 1979 .

[40]  I. Good,et al.  The Maximum Entropy Formalism. , 1979 .

[41]  E. T. Jaynes,et al.  Where do we Stand on Maximum Entropy , 1979 .

[42]  Edwin T. Jaynes,et al.  Inference, Method, and Decision: Towards a Bayesian Philosophy of Science. , 1979 .

[43]  Statistical evaluation of gamma-ray line observations , 1980 .

[44]  A. Zellner,et al.  Posterior odds ratios for selected regression hypotheses , 1980 .

[45]  Rodney W. Johnson,et al.  Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy , 1980, IEEE Trans. Inf. Theory.

[46]  A. Dawid.  A Bayesian look at nuisance parameters , 1980 .

[47]  Thomas S. Huang,et al.  Picture Processing and Digital Filtering , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Jan M. Van Campenhout,et al.  Maximum entropy and conditional probability , 1981, IEEE Trans. Inf. Theory.

[49]  E. Jaynes.  On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[50]  E. T. Jaynes,et al.  Papers on probability, statistics and statistical physics , 1983 .

[51]  Rodney W. Johnson,et al.  Comments on and correction to 'Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy' (Jan 80 26-37) , 1983, IEEE Trans. Inf. Theory.

[52]  Joseph B. Kadane,et al.  Robustness of Bayesian analyses , 1984 .

[53]  A. Zellner,et al.  Basic Issues in Econometrics. , 1986 .

[54]  Gudmund R. Iversen,et al.  Bayesian statistical inference , 1984 .

[55]  M. Degroot,et al.  Highly Informative Priors , 1985 .

[56]  C. R. Smith,et al.  Maximum-Entropy and Bayesian Methods in Inverse Problems , 1985 .

[57]  Arnold Zellner,et al.  Biased predictors, rationality and the evaluation of forecasts , 1986 .

[58]  R. Narayan,et al.  Maximum Entropy Image Restoration in Astronomy , 1986 .

[59]  J. Justice.  Maximum entropy and bayesian methods in applied statistics , 1986 .

[60]  E. T. Jaynes,et al.  Maximum Entropy and Bayesian Methods in Applied Statistics: Monkeys, Kangaroos, and N , 1986 .

[61]  E. T. Jaynes,et al.  BAYESIAN METHODS: GENERAL BACKGROUND ? An Introductory Tutorial , 1986 .

[62]  John Skilling,et al.  Theory of Maximum Entropy Image Reconstruction , 1986 .

[63]  R. G. Lacsamana,et al.  Where do we go from here? , 1986, The Journal of the Florida Medical Association.

[64]  David Lindley,et al.  Bayesian Statistics, a Review , 1987 .

[65]  G. J. Janacek,et al.  Maximum Entropy and Bayesian Spectral Analysis and Estimation Problems , 1987 .

[66]  M. Degroot,et al.  Bayesian Statistics 2. , 1987 .

[67]  E. T. Jaynes,et al.  Bayesian Spectrum and Chirp Analysis , 1987 .

[68]  P. Fougere.  Maximum Entropy Calculations on a Discrete Probability Space , 1988 .

[69]  C. Ray Smith,et al.  Maximum-entropy and Bayesian methods in science and engineering , 1988 .

[70]  E. Fenimore,et al.  X-ray observations of the galactic center by SPARTAN 1 , 1988 .

[71]  M. van der Klis,et al.  Fourier Techniques in X-Ray Timing , 1988 .

[72]  Marvin H. J. Guber.  Bayesian Spectrum Analysis and Parameter Estimation , 1988 .

[73]  David H. Bailey,et al.  Algorithms and applications , 1988 .

[74]  S. Gull.  Bayesian Inductive Inference and Maximum Entropy , 1988 .

[75]  James O. Berger,et al.  Statistical Analysis and the Illusion of Objectivity , 1988 .

[76]  E. T. Jaynes,et al.  How Does the Brain Do Plausible Reasoning , 1988 .

[77]  J. Berger.  Statistical Decision Theory and Bayesian Analysis , 1988 .

[78]  E. T. Jaynes,et al.  The Relation of Bayesian and Maximum Entropy Methods , 1988 .

[79]  E. Jaynes.  Detection of Extra-Solar System Planets , 1988 .

[80]  G. Larry Bretthorst,et al.  Excerpts from Bayesian Spectrum Analysis and Parameter Estimation , 1988 .

[81]  C. Ray Smith,et al.  From Rationality and Consistency to Bayesian Probability , 1989 .

[82]  E. T. Jaynes,et al.  Clearing up Mysteries — The Original Goal , 1989 .

[83]  E. T. Jaynesz,et al.  Clearing up Mysteries { the Original Goal , 1989 .

[84]  J. Skilling.  Classic Maximum Entropy , 1989 .

[85]  G. Barton.  Foundations of statistical mechanics , 1989 .

[86]  G. Larry Bretthorst,et al.  Bayesian Model Selection: Examples Relevant to NMR , 1989 .

[87]  H. Ögelman,et al.  Timing neutron stars , 1989 .

[88]  C. R. Smith,et al.  From Chirp to Chip, a Beginning , 1989 .

[89]  K. Horne,et al.  Maximum Entropy Tomography of Accretion Discs from Their Emission Lines , 1989 .

[90]  Stephen F. Gull,et al.  Developments in Maximum Entropy Data Analysis , 1989 .

[91]  Sir Harold Jeffreys (1891–1989) , 1989, Nature.

[92]  John Skilling,et al.  Maximum Entropy and Bayesian Methods , 1989 .

[93]  S. F. Gull,et al.  DISTANCES TO CLUSTERS OF GALAXIES BY MAXIMUM-ENTROPY METHOD , 1989 .

[94]  C. Burrows,et al.  The Application of Maximum Entropy Techniques to Chopped Astronomical Infrared Data , 1989 .

[95]  C. Ray Smith,et al.  Bayesian Analysis Of Signals From Closely-Spaced Objects , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[96]  Maximum Entropy Calculations on a Discrete Probability Space: Predictions Confirmed , 1989 .

[97]  G. L. Bretthorst,et al.  AN INTRODUCTION TO PARAMETER ESTIMATION USING BAYESIAN PROBABILITY THEORY , 1990 .

[98]  G. Larry Bretthorst,et al.  Bayesian analysis. II. Signal detection and model selection , 1990 .

[99]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[100]  T. Fearn,et al.  Bayesian statistics : principles, models, and applications , 1990 .

[101]  J. Skilling.  Quantified Maximum Entropy , 1990 .

[102]  William H. Press,et al.  Numerical recipes , 1990 .

[103]  Sibusiso Sibisi,et al.  Quantified Maxent: An NMR Application , 1990 .

[104]  R. T. Cox.  Probability, frequency and reasonable expectation , 1990 .

[105]  E. T. Jaynes,et al.  Probability Theory as Logic , 1990 .

[106]  G. Larry Bretthorst,et al.  Bayesian analysis. III. Applications to NMR signal detection, model selection, and parameter estimation , 1990 .

[107]  G. L. Bretthorst.  Bayesian analysis. I. Parameter estimation using quadrature NMR models , 1990 .

[108]  F. Guess.  Bayesian Statistics: Principles, Models, and Applications , 1990 .

[109]  T. Bayes.  An essay towards solving a problem in the doctrine of chances , 2003 .

[110]  Eric P. Fox.  Bayesian Statistics 3 , 1991 .