Nonexistence of Informative Unbiased Estimators in Singular Problems

In many nonparametric problems, such as density estimation, nonparametric regression and so on, all the existing informative estimators are biased (asymptotic or finite sample). There has long been a suspicion that either informative unbiased estimators do not exist for such problems or they must be quite complicated. In this paper, we clarify the nonexistence of informative unbiased estimators in all singular problems both for fixed sample size and asymptotically (this includes most problems with optimal rate of convergence slower than n1/2). We also discuss situations in regular problems where such nonexistences can occur.

[1]  D. Blackwell.  Conditional Expectation and Unbiased Sequential Estimation , 1947 .

[2]  C. Radhakrishna Rao,et al.  Sufficient statistics and minimum variance estimates , 1949, Mathematical Proceedings of the Cambridge Philosophical Society.

[3]  Charles Stein,et al.  Unbiased Estimates with Minimum Variance , 1950 .

[4]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[5]  Le Cam,et al.  On some asymptotic properties of maximum likelihood estimates and related Bayes' estimates , 1953 .

[6]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[7]  E. L. Lehmann,et al.  Unbiased Estimation in Convex Families , 1969 .

[8]  R. H. Farrell.  On the Best Obtainable Asymptotic Rates of Convergence in Estimation of a Density Function at a Point , 1972 .

[9]  W. Y. Tan,et al.  Some Comparisons of the Method of Moments and the Method of Maximum Likelihood in Estimating Parameters of a Mixture of Two Normal Densities , 1972 .

[10]  R. Hasminskii.  Lower Bound for the Risks of Nonparametric Estimates of the Mode , 1979 .

[11]  C. J. Stone,et al.  Optimal Rates of Convergence for Nonparametric Estimators , 1980 .

[12]  Jerome Sacks,et al.  ASYMPTOTICALLY OPTIMUM KERNELS FOR DENSITY ESTIMATION AT A POINT , 1981 .

[13]  B. Silverman.  Density estimation for statistics and data analysis , 1986 .

[14]  L. L. Cam,et al.  Asymptotic Methods In Statistical Decision Theory , 1986 .

[15]  Hani Doss,et al.  Bias Reduction When There Is No Unbiased Estimate. , 1989 .

[16]  D. Donoho,et al.  Geometrizing Rates of Convergence, III , 1991 .