Generalized information criteria for optimal Bayes decisions 1 Research Report No . 2239 December 2008 Generalized information criteria for optimal Bayes decisions

This report constitutes an unrefereed manuscript which is intended to be submitted for publication. Any opinions and conclusions expressed in this report are those of the author(s) and do not necessarily represent the views of the Institute. This paper deals with Bayesian models given by statistical experiments and common types of loss functions. Probability of error of the Bayes identificator of state, and of more general types of Bayes risk are characterized by means of classical and generalized information criteria applicable to the experiment. In particular, the accuracy of the approximation is studied. A number of concrete numerical results and figures illustrate the obtained theoretical results.

[1]  Moshe Ben-Bassat,et al.  f-Entropies, probability of Error, and Feature Selection , 1978, Inf. Control..

[2]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[3]  Neri Merhav,et al.  Relations between entropy and error probability , 1994, IEEE Trans. Inf. Theory.

[4]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[5]  M. Ben-Bassat,et al.  Renyi's entropy and the probability of error , 1978, IEEE Trans. Inf. Theory.

[6]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[7]  Leandro Pardo,et al.  Uncertainty of discrete stochastic systems: general theory and statistical inference , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[8]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[9]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.