Intrinsic Estimation

In this paper the problem of parametric point estimation is addressed from an objective Bayesian viewpoint. Arguing that pure statistical estimation may be appropriately described as a precise decision problem where the loss function is a measure of the divergence between the assumed model and the estimated model, the information-based intrinsic discrepancy is proposed as an appropriate loss function. The intrinsic estimator is then defined as that minimizing the expected loss with respect to the reference posterior distribution. The resulting estimators are shown have attractive invariance properties. As demonstrated with illustrative examples, the proposed theory either leads to new, arguably better estimators, or provides a new perspective on well-established solutions.

[1]  J. Bernardo,et al.  Bayesian Hypothesis Testing: a Reference Approach , 2002 .

[2]  José M Bernardo and Adrian F M Smith,et al.  BAYESIAN THEORY , 2008 .

[3]  J. Bernardo Nested Hypothesis Testing: The Bayesian Reference Criterion , 2001 .

[4]  J. Bernardo,et al.  An introduction to Bayesian reference analysis: inference on the ratio of multinomial parameters , 1998 .

[5]  James O. Berger,et al.  ESTIMATION OF QUADRATIC FUNCTIONS: NONINFORMATIVE PRIORS FOR NON-CENTRALITY PARAMETERS , 1998 .

[6]  Nozer D. Singpurwalla,et al.  Non-informative priors do not exist A dialogue with José M. Bernardo , 1997 .

[7]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[8]  C. Robert Intrinsic losses , 1996 .

[9]  F. Y. Edgeworth,et al.  The theory of statistics , 1996 .

[10]  C. Stein,et al.  Estimation with Quadratic Loss , 1992 .

[11]  James O. Berger,et al.  Estimating a Product of Means: Bayesian Analysis with Reference Priors , 1989 .

[12]  E. T. Jaynes,et al.  Papers on probability, statistics and statistical physics , 1983 .

[13]  J. Bernardo Expected Information as Expected Utility , 1979 .

[14]  J. Bernardo Reference Posterior Distributions for Bayesian Inference , 1979 .

[15]  B. Efron,et al.  Combining Possibly Related Estimation Problems , 1973 .

[16]  Charles Stein,et al.  An Example of Wide Discrepancy Between Fiducial and Confidence Intervals , 1959 .

[17]  Vasant Shankar Huzurbazar,et al.  Exact forms of some invariants for distributions admitting sufficient statistics , 1955 .

[18]  H. Chernoff A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations , 1952 .

[19]  L. Stein,et al.  Probability and the Weighing of Evidence , 1950 .

[20]  L. M. M.-T. Theory of Probability , 1929, Nature.