论文信息 - Estimating Functions of Distributions from A Finite Set of Samples, Part 2: Bayes Estimators for Mutual Information, Chi-Squared, Covariance and other Statistics

Estimating Functions of Distributions from A Finite Set of Samples, Part 2: Bayes Estimators for Mutual Information, Chi-Squared, Covariance and other Statistics

We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint distribution, we present finite sample estimators for the mutual information, covariance, and chi-squared functions of that probability distribution.

David H. Wolpert | David R. Wolf | D. R. Wolf | D. Wolpert | D. Wolf

[1] Richard Wesley Hamming,et al. Coding and information theory (2. ed.) , 1986 .

[2] Irene A. Stegun,et al. Handbook of Mathematical Functions. , 1966 .

[3] E. T. Jaynes,et al. Papers on probability, statistics and statistical physics , 1983 .

[4] Wentian Li. Mutual information functions versus correlation functions , 1990 .

[5] D. R. Wolf,et al. Alpha, Evidence, and the Entropic Prior , 1993 .

[6] M. Degroot,et al. Probability and Statistics , 2021, Examining an Operational Approach to Teaching Probability.

[7] R. A. Silverman,et al. Special functions and their applications , 1966 .

[8] W. Rudin. Principles of mathematical analysis , 1964 .

[9] Wentian Li,et al. Mutual Information Functions of Natural Language Texts , 1989 .

[10] John Skilling,et al. Maximum entropy method in image processing , 1984 .

[11] Satosi Watanabe,et al. Pattern Recognition: Human and Mechanical , 1985 .

[12] David R. Wolf,et al. Estimating functions of probability distributions from a finite set of samples. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.