Strong matching of frequentist and Bayesian parametric inference

We define a notion of strong matching of frequentist and Bayesian inference for a scalar parameter, and show that for the special case of a location model strong matching is obtained for any interest parameter linear in the location parameters. Strong matching is defined using one-sided interval estimates constructed by inverting test quantities. A brief survey of methods for choosing a prior, of principles relating to the Bayesian paradigm, and of confidence and related procedures leads to the development of a general location reparameterization. This is followed by a brief survey of recent likelihood asymptotics which provides a basis for examining strong matching to third order in general continuous statistical methods. It is then shown that a flat prior with respect to the general location parameterization gives third-order strong matching for linear parameters; and for nonlinear parameters the strong matching requires an adjustment to the flat prior which is based on the observed Fisher information. A computationally more accessible approach then uses full dimensional pivotal quantities to generate default priors for linear parameters; this leads to second-order matching. A concluding section describes a confidence, fiducial, or default Bayesian inversion relative to the location parameterization. This provides a method to adjust interval estimates by means of a personal prior taken relative to the flat prior in the location parameterization.

[1]  R. Tibshirani Noninformative priors for one parameter of many , 1989 .

[2]  N. Reid,et al.  Ancillary Information for Statistical Inference , 2001 .

[3]  H. Jeffreys An invariant form for the prior probability in estimation problems , 1946, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[4]  D. Hinkley Likelihood as approximate pivotal distribution , 1980 .

[5]  T. Bayes An essay towards solving a problem in the doctrine of chances , 2003 .

[6]  D. Fraser Local Conditional Sufficiency , 1964 .

[7]  S. Rice,et al.  Saddle point approximation for the distribution of the sum of independent random variables , 1980, Advances in Applied Probability.

[8]  O. Barndorff-Nielsen Modified signed log likelihood ratio , 1991 .

[9]  Nancy Reid,et al.  Ancillaries and Third Order Significance , 1995 .

[10]  E. J. Hannan,et al.  Regression for time series with errors of measurement , 1963 .

[11]  Geoffrey Gregory,et al.  Foundations of Statistical Inference , 1973 .

[12]  L. Wasserman,et al.  The Selection of Prior Distributions by Formal Rules , 1996 .

[13]  H. W. Peers On Confidence Points and Bayesian Probability Points in the Case of Several Parameters , 1965 .

[14]  D. Fraser Tail probabilities from observed likelihoods , 1990 .

[15]  Donald Fraser BAYES, LIKELIHOOD, OR STRUCTURAL' , 1972 .

[16]  H. Daniels Saddlepoint Approximations in Statistics , 1954 .

[17]  Likelihood centered asymptotic model exponential and location model versions , 1998 .

[18]  Donald Fraser,et al.  Regression analysis, nonlinear or nonnormal simple and accurate p values from likelihood analysis , 1999 .

[19]  Bayes Posteriors for Scalar Interest Parameters , 1996 .

[20]  J. Bernardo Reference Posterior Distributions for Bayesian Inference , 1979 .

[21]  Nancy Reid,et al.  A simple general formula for tail probabilities for frequentist and Bayesian inference , 1999 .

[22]  O. E. Barndorff-Nielsen,et al.  Infereni on full or partial parameters based on the standardized signed log likelihood ratio , 1986 .