论文信息 - Update of Prior Probabilities by Minimal Divergence

Update of Prior Probabilities by Minimal Divergence

The present paper investigates the update of an empirical probability distribution with the results of a new set of observations. The update reproduces the new observations and interpolates using prior information. The optimal update is obtained by minimizing either the Hellinger distance or the quadratic Bregman divergence. The results obtained by the two methods differ. Updates with information about conditional probabilities are considered as well.

Jan Naudts

[1] Maya R. Gupta,et al. Functional Bregman Divergence and Bayesian Estimation of Distributions , 2006, IEEE Transactions on Information Theory.

[2] P. Alam. ‘L’ , 2021, Composites Engineering: An A–Z Guide.

[3] Xin Guo,et al. On the optimality of conditional expectation as a Bregman predictor , 2005, IEEE Trans. Inf. Theory.

[4] A. Dawid,et al. Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory , 2004, math/0410076.

[5] H. White. Maximum Likelihood Estimation of Misspecified Models , 1982 .

[6] S. Amari. Information geometry , 2021, Japanese Journal of Mathematics.

[7] Richard C. Jeffrey,et al. Alias Smith and Jones: The testimony of the senses , 1987 .

[8] Brian Skyrms,et al. The structure of Radical Probabilism , 1996, Erkenntnis.

[9] F. Opitz. Information geometry and its applications , 2012, 2012 9th European Radar Conference.

[10] Shun-ichi Amari,et al. Methods of information geometry , 2000 .

[11] E. Jaynes. Information Theory and Statistical Mechanics , 1957 .

[12] I. Csiszár. Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems , 1991 .

[13] I. Csiszár. $I$-Divergence Geometry of Probability Distributions and Minimization Problems , 1975 .