A "follow the perturbed leader"-type algorithm for zero-delay quantization of individual sequences

Zero-delay lossy source coding schemes are considered for individual sequences. Performance is measured by the distortion redundancy, defined as the difference between the normalized cumulative mean squared distortion of the scheme and the normalized cumulative distortion of the best scalar quantizer of the same rate which is matched to the entire sequence to be encoded. Recently, Weissman and Merhav constructed a randomized scheme which, for any bounded individual sequence of length n, achieves a distortion redundancy O(n/sup -1/3/logn). However, this scheme has prohibitive complexity (both space and time) which makes practical implementation infeasible. In this paper, we present an efficiently computable algorithm based on a "follow the perturbed leader"-type prediction method by Kalai and Vempala. Our algorithm achieves distortion redundancy O(n/sup -1/4/ logn), which is somewhat worse than that of the scheme by Merhav and Weissman, but it has computational complexity that is linear in the sequence length n, and requires O(n/sup 1/4/) storage capacity.

[1]  Tamás Linder,et al.  Efficient adaptive algorithms and minimax bounds for zero-delay lossy source coding , 2004, IEEE Transactions on Signal Processing.

[2]  S. Vempala,et al.  Eecient Algorithms for Online Decision Problems , 2003 .

[3]  N. Merhav,et al.  On limited-delay lossy coding and filtering of individual sequences , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[4]  Tamás Linder,et al.  Efficient algorithms and minimax bounds for zero-delay lossy source coding , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[5]  Vladimir Vovk,et al.  Aggregating strategies , 1990, COLT '90.

[6]  Manfred K. Warmuth,et al.  The weighted majority algorithm , 1989, 30th Annual Symposium on Foundations of Computer Science.

[7]  Vladimir Vovk,et al.  A game of prediction with expert advice , 1995, COLT '95.

[8]  Kaizhong Zhang,et al.  Quantizer monotonicities and globally optimal scalar quantizer design , 1993, IEEE Trans. Inf. Theory.

[9]  Tamás Linder,et al.  A zero-delay sequential scheme for lossy coding of individual sequences , 2001, IEEE Trans. Inf. Theory.