Reducing the space complexity of a Bayes coding algorithm using an expanded context tree

The context tree models are widely used in a lot of research fields. Patricia[7] like trees are applied to the context trees that are expanded according to the increase of the length of a source sequence in the previous researches of non-predictive source coding and model selection. The space complexity of the Patricia like context trees are O(t) where t is the length of a source sequence. On the other hand, the predictive Bayes source coding algorithm cannot use a Patricia like context tree, because it is difficult to hold and update the posterior probability parameters on a Patricia like tree. So the space complexity of the expanded trees in the predictive Bayes coding algorithm is O(t2). In this paper, we propose an efficient predictive Bayes coding algorithm using a new representation of the posterior probability parameters and the compact context tree holding the parameters whose space complexity is O(t).

[1]  Toshiyasu Matsushima,et al.  A Bayes coding algorithm for FSM sources , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.

[2]  Gadiel Seroussi,et al.  Linear time universal coding and time reversal of tree sources via FSM closure , 2004, IEEE Transactions on Information Theory.

[3]  Andrew R. Barron,et al.  Information-theoretic asymptotics of Bayes methods , 1990, IEEE Trans. Inf. Theory.

[4]  Shigeichi Hirasawa,et al.  A Generalization of B. S. Clarke and A. R. Barron's Asymptotics of Bayes Codes for FSMX Sources , 1998 .

[5]  Edward R. Fiala,et al.  Data compression with finite windows , 1989, CACM.

[6]  Yoram Bresler,et al.  An O(N) semipredictive universal encoder via the BWT , 2004, IEEE Transactions on Information Theory.

[7]  Aurélien Garivier Consistency of the Unlimited BIC Context Tree Estimator , 2006, IEEE Transactions on Information Theory.

[8]  Y. Shtarkov,et al.  The context-tree weighting method: basic properties , 1995, IEEE Trans. Inf. Theory.

[9]  Shigeichi Hirasawa,et al.  A class of distortionless codes designed by Bayes decision theory , 1991, IEEE Trans. Inf. Theory.

[10]  Frans M. J. Willems,et al.  The Context-Tree Weighting Method : Extensions , 1998, IEEE Trans. Inf. Theory.