Kolmogorov's structure function for probability models
暂无分享,去创建一个
This work was inspired by the paper of Vereshchagin and Vitanyi, where Kolmogorov's unpublished work on his structure function and the associated minimal sufficient statistics decomposition in the algorithmic theory of information is studied. The extension of Kolmogorov's great ideas to probability model classes turns out to add a new chapter to the MDL theory, which also provides an alternative approach to Shannon's rate-distortion theory.
[1] Nikolai K. Vereshchagin,et al. Kolmogorov's structure functions with an application to the foundations of model selection , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..
[2] Jorma Rissanen,et al. Fisher information and stochastic complexity , 1996, IEEE Trans. Inf. Theory.