论文信息 - Information criteria for the predictive evaluation of bayesian models

Information criteria for the predictive evaluation of bayesian models

As a natural successor of the information criteria AIC and ABIC, information criteria for the Bayes models were developed by evaluating the bias of the log likelihood of the predictive distribution as an estimate of its expected log-likelihood. Considering two specific situations for the true distribution, two information criteria, PIC1 and PIC2 are derived. Linear Gaussian cases are considered in details and the evaluation of the maximum a posteriori estimator is also considered. By a simple example of estimating the signal to noise ratio, it was shown that the PIC2 is a good approximation to the expected log-likelihood in the entire region of the signal to noise ratio. On the other hand, PIC1 performs good only for the smaller values of the variance ratio. For illustration, the problems of trend estimation and seasonal adjustment are considered. Examples show that the hyper-parameters estimated by the new criteria are usually closer to the best ones than those by the ABIC.

Kitagawa Genshiro | Kitagawa Genshiro

[1] G. Schwarz. Estimating the Dimension of a Model , 1978 .

[2] G. Kitagawa. Bayesian analysis of outliers via akaike's predictive likelihood of a model , 1984 .

[3] N. Sugiura. Further analysts of the data by akaike' s information criterion and the finite corrections , 1978 .

[4] G. Kitagawa,et al. A Smoothness Priors–State Space Modeling of Time Series with Trend and Seasonality , 1984 .

[5] Hirotugu Akaike,et al. Likelihood and the Bayes procedure , 1980 .

[6] J. F. Bjørnstad. Predictive Likelihood: A Review , 1990 .

[7] H. Akaike,et al. Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[8] Hirotugu Akaike,et al. On entropy maximization principle , 1977 .

[9] G. Kitagawa,et al. Akaike Information Criterion Statistics , 1988 .

[10] R. Butler. Predictive Likelihood Inference with Applications , 1986 .

[11] G. Kitagawa,et al. Generalised information criteria in model selection , 1996 .

[12] D. Lindley,et al. Bayes Estimates for the Linear Model , 1972 .

[13] G. Kitagawa,et al. Akaike Information Criterion Statistics , 1988 .

[14] Hirotugu Akaike,et al. On the use of the predictive likelihood of a Gaussian model , 1980 .

[15] I. Good,et al. Density Estimation and Bump-Hunting by the Penalized Likelihood Method Exemplified by Scattering and Meteorite Data , 1980 .