Sequential Coding of Markov Sources over Burst Erasure Channels

We study sequential coding of Markov sources under an error propagation constraint. An encoder sequentially compresses a sequence of vector-sources that are spatially i.i.d. but temporally correlated according to a first-order Markov process. The channel erases up to B packets in a single burst, but reveals all other packets to the destination. The destination is required to reproduce all the source-vectors instantaneously and in a lossless manner, except those sequences that occur in an error propagation window of length B + W following the start of the erasure burst. We define the rate-recovery function R(B, W) - the minimum achievable compression rate per source sample in this framework - and develop upper and lower bounds on this function. Our upper bound is obtained using a random binning technique, whereas our lower bound is obtained by drawing connections to multi-terminal source coding. Our upper and lower bounds coincide, yielding R(B, W), in some special cases. More generally, both the upper and lower bounds equal the rate for predictive coding plus a term that decreases as 1/(W+1), thus establishing a scaling behaviour of the rate-recovery function. For a special class of semi-deterministic Markov sources we propose a new optimal coding scheme: prospicient coding. An extension of this coding technique to Gaussian sources is also developed. For the class of symmetric Markov sources and memoryless encoders, we establish the optimality of random binning. When the destination is required to reproduce each source sequence with a fixed delay and when W = 0 we also establish the optimality of binning.

[1]  Zhen Zhang,et al.  Rate Distortion Theory for Causal Video Coding: Characterization, Computation Algorithm, and Comparison , 2011, IEEE Transactions on Information Theory.

[2]  Imre Csiszár,et al.  Towards a general theory of source networks , 1980, IEEE Trans. Inf. Theory.

[3]  Prakash Ishwar,et al.  On Delayed Sequential Coding of Correlated Sources , 2011, IEEE Transactions on Information Theory.

[4]  Narendra Ahuja,et al.  Wyner-Ziv coding of video: an error-resilient compression framework , 2004, IEEE Transactions on Multimedia.

[5]  Vinod M. Prabhakaran,et al.  Syndrome-Based Robust Video Transmission Over Networks with Bursty Losses , 2006, 2006 International Conference on Image Processing.

[6]  Yasutada Oohama Gaussian Zig-Zag Source Coding Problem , 2010, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[7]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .

[8]  Bernd Girod,et al.  Forward Error Protection for low-delay packet video , 2010, 2010 18th International Packet Video Workshop.

[9]  Ieee On Techniques-for Reducing the Visibility of Transmission Errors in Digitally Encoded Video Signals , 1973 .

[10]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[11]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[12]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  Bixio Rimoldi,et al.  Successive refinement of information: characterization of the achievable rates , 1994, IEEE Trans. Inf. Theory.

[15]  Giuseppe Longo,et al.  The information theory approach to communications , 1977 .

[16]  William Equitz,et al.  Successive refinement of information , 1991, IEEE Trans. Inf. Theory.

[17]  Avideh Zakhor,et al.  Video multicast using layered FEC and scalable compression , 2001, IEEE Trans. Circuits Syst. Video Technol..

[18]  Gregory W. Wornell,et al.  Causal Transmission of Colored Source Frames over a Packet Erasure Channel , 2010, 2010 Data Compression Conference.

[19]  Toby Berger,et al.  Sequential coding of correlated sources , 2000, IEEE Trans. Inf. Theory.