ON BAHADUR EFFICIENCY AND MAXIMUM LIKELIHOOD ESTIMATION IN GENERAL PARAMETER SPACES

The paper studies large deviations of maximum likelihood and related estimates in the case of i.i.d. observations with distribution determined by a param- eter θ taking values in a general metric space. The main theorems provide sufficient conditions under which an approximate sieve maximum likelihood estimate is an asymptotically locally optimal estimate of g(θ) in the sense of Bahadur, for virtu- ally all functions g of interest. These conditions are illustrated by application to several parametric, nonparametric, and semiparametric examples.

[1]  H. Cramér.  Mathematical Methods of Statistics (PMS-9), Volume 9 , 1946 .

[2]  A. Wald.  Note on the Consistency of the Maximum Likelihood Estimate , 1949 .

[3]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[4]  J. Kiefer,et al.  CONSISTENCY OF THE MAXIMUM LIKELIHOOD ESTIMATOR IN THE PRESENCE OF INFINITELY MANY INCIDENTAL PARAMETERS , 1956 .

[5]  R. R. Bahadur.  Examples of inconsistency of maximum likelihood estimates , 1958 .

[6]  S. Kullback,et al.  A lower bound for discrimination information in terms of variation (Corresp.) , 1967, IEEE Trans. Inf. Theory.

[7]  R. R. Bahadur.  Rates of Convergence of Estimates and Test Statistics , 1967 .

[8]  J. Fu,et al.  On a Theorem of Bahadur on the Rate of Convergence of Point Estimators , 1973 .

[9]  I. Csiszár.  $I$-Divergence Geometry of Probability Distributions and Minimization Problems , 1975 .

[10]  G. Sievers.  Estimates of Location: A Large Deviation Comparison , 1978 .

[11]  S.-S. Perng,et al.  Rate of Convergence of Estimators Based on Sample Mean , 1978 .

[12]  J. Fu.  Large Sample Point Estimation: A Large Deviation Theory Approach , 1982 .

[13]  Convergence Rates of Estimators of a Finite Parameter: How Small can Error Probabilities Be? , 1983 .

[14]  R. R. Bahadur.  LARGE DEVIATIONS OF THE MAXIMUM LIKELIHOOD ESTIMATE IN THE MARKOV CHAIN CASE , 1983 .

[15]  A. Rukhin,et al.  Convergence rates of large deviations probabilities for point estimators , 1983 .

[16]  A. Kester.  Some large deviation results in statistics , 1987 .

[17]  Jane-Ling Wang,et al.  Strong Consistency of Approximate Maximum Likelihood Estimators with Applications in Nonparametrics , 1985 .

[18]  On exponential rates of likelihood ratio estimators for location parameters , 1985 .

[19]  A. Kester,et al.  Large Deviations of Estimators , 1986 .

[20]  R. R. Bahadur.  Some Limit Theorems in Statistics , 1987 .

[21]  The Concept of Asymptotic Efficiency , 1988 .

[22]  W. Wong,et al.  Profile Likelihood and Conditionally Parametric Models , 1992 .

[23]  W. Wong,et al.  Convergence Rate of Sieve Estimates , 1994 .