A Decomposition for the Likelihood Ratio Statistic and the Bartlett Correction--A Bayesian Argument

Let l(θ) = n -1 log p(x, θ) be the log likelihood of an n-dimensional X under a p-dimensional θ. Let θˆ j be the mle under H j : θ 1 = θ 1 0 , ..., θ j = θ j 0 and θˆ 0 be the unrestricted mle. Define T j as [2n{l(θˆ j-1 )}] 1/2 sgn(θˆj j-1 -θ j 0 ). Let T = (T 1 , ..., T p ). Then under regularity conditions, the following theorem is proved: Under θ = θ 0 , T is asymptotically N(n -1/2 a 0 + n -1 a, J + n -1 ∑) + O(n -3/2 ) where J is the identity matrix. The result is proved by first establishing an analogous result when θ is random and then making the prior converge to a degenerate distribution. The existence of the Bartlett correction to order n -3/2 follows from the theorem. We show that an Edgeworth expansion with error O(n -2 ) for T involves only polynomials of degree less than or equal to 3 and hence verify rigorously Lawley's (1956) result giving the order of the error in the Bartlett correction as O(n -2 ).

[1]  B. L. Welch,et al.  On Formulae for Confidence Points Based on Integrals of Weighted Likelihoods , 1963 .

[2]  S. S. Wilks The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses , 1938 .

[3]  J. Ghosh,et al.  ON THE VALIDITY OF THE FORMAL EDGEWORTH EXPANSION , 1978 .

[4]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[5]  Patrick Billingsley,et al.  Statistical inference for Markov processes , 1961 .

[6]  G. Box,et al.  A general distribution theory for a class of likelihood criteria. , 1949, Biometrika.

[7]  Ole E. Barndorff-Nielsen,et al.  On the level-error after Bartlett adjustment of the likelihood ratio statistic , 1988 .

[8]  D. Cox,et al.  Bartlett Adjustments to the Likelihood Ratio Statistic and the Distribution of the Maximum Likelihood Estimator , 1984 .

[9]  P. Bickel,et al.  Edgeworth Expansions in Nonparametric Statistics , 1974 .

[10]  B. Efron Bootstrap confidence intervals for a class of parametric problems , 1985 .

[11]  A. Wald Tests of statistical hypotheses concerning several parameters when the number of observations is large , 1943 .

[12]  O. E. Barndorff-Nielsen,et al.  Infereni on full or partial parameters based on the standardized signed log likelihood ratio , 1986 .

[13]  B. Efron The jackknife, the bootstrap, and other resampling plans , 1987 .

[14]  M. Bartlett Properties of Sufficiency and Statistical Tests , 1992 .

[15]  Charles Stein,et al.  On the coverage probability of confidence sets based on a prior distribution , 1985 .

[16]  D. Lawley A GENERAL METHOD FOR APPROXIMATING TO THE DISTRIBUTION OF LIKELIHOOD RATIO CRITERIA , 1956 .