Integrated likelihood functions for non-Bayesian inference

Consider a model with parameter θ = (ψ, λ), where ψ is the parameter of interest, and let L(ψ, λ) denote the likelihood function. One approach to likelihood inference for ψ is to use an integrated likelihood function, in which λ is eliminated from L(ψ, λ) by integrating with respect to a density function π(λ|ψ). The goal of this paper is to consider the problem of selecting π(λ|ψ) so that the resulting integrated likelihood function is useful for non-Bayesian likelihood inference. The desirable properties of an integrated likelihood function are analyzed and these suggest that π(λ|ψ) should be chosen by finding a nuisance parameter ϕ that is unrelated to ψ and then taking the prior density for ϕ to be independent of ψ. Such an unrelated parameter is constructed and the resulting integrated likelihood is shown to be closely related to the modified profile likelihood. Copyright 2007, Oxford University Press.

[1]  H. Jeffreys,et al.  Theory of probability , 1896 .

[2]  G. Barnard,et al.  Likelihood Inference and Time Series , 1962 .

[3]  Irene A. Stegun,et al.  Handbook of Mathematical Functions. , 1966 .

[4]  John D. Kalbfleisch,et al.  Application of Likelihood Methods to Models Involving Large Numbers of Parameters , 1970 .

[5]  H. Martz Bayesian reliability analysis , 1982 .

[6]  O. Barndorff-Nielsen On a formula for the distribution of the maximum likelihood estimator , 1983 .

[7]  D. Cox,et al.  Parameter Orthogonality and Approximate Conditional Inference , 1987 .

[8]  James O. Berger,et al.  Estimating a Product of Means: Bayesian Analysis with Reference Priors , 1989 .

[9]  Nancy Reid,et al.  Adjustments to profile likelihood , 1989 .

[10]  Robert Tibshirani,et al.  A Simple Method for the Adjustment of Profile Likelihoods , 1990 .

[11]  J. Q. Smith,et al.  1. Bayesian Statistics 4 , 1993 .

[12]  Brunero Liseo,et al.  Elimination of nuisance parameters with reference priors , 1993 .

[13]  O. Barndorff-Nielsen,et al.  Adjusted Versions of Profile Likelihood and Directed Likelihood, and Extended Likelihood , 1994 .

[14]  D. Cox,et al.  Inference and Asymptotics , 1994 .

[15]  O. Barndorff-Nielsen Stable and invariant adjusted profile likelihood and directed likelihood for curved exponential models , 1995 .

[16]  I. Skovgaard,et al.  An explicit large-deviation approximation to one-parameter tests , 1996 .

[17]  Thomas J. DiCiccio,et al.  Information Bias and Adjusted Profile Likelihoods , 1996 .

[18]  L. Wasserman,et al.  The Selection of Prior Distributions by Formal Rules , 1996 .

[19]  Luigi Pace,et al.  Principles of Statistical Inference , 1997 .

[20]  Thomas A. Severini,et al.  An approximation to the modified profile likelihood function , 1998 .

[21]  Thomas A. Severini,et al.  Likelihood functions for inference in the presence of a nuisance parameter , 1998 .

[22]  R. Wolpert,et al.  Integrated likelihood methods for eliminating nuisance parameters , 1999 .

[23]  Tim B. Swartz,et al.  Approximating Integrals Via Monte Carlo and Deterministic Methods , 2000 .

[24]  T. Severini Likelihood Methods in Statistics , 2001 .

[25]  Donald Fraser,et al.  Likelihood for component parameters , 2003 .