Sequential coding of Gauss-Markov sources with packet erasures and feedback

We consider the problem of sequential transmission of Gauss-Markov sources. We show that in the limit of large spatial block lengths, greedy compression with respect to the squared error distortion is optimal; that is, there is no tension between optimizing the distortion of the source in the current time instant and that of future times. We then extend this result to the case where at time t a random compression rate rt is allocated independently of the rate at other time instants. This, in turn, allows us to derive the optimal performance of sequential coding over packet-erasure channels with instantaneous feedback. For the case of packet erasures with delayed feedback, we connect the problem to that of compression with side information that is known at the encoder and may be known at the decoder — where the most recent packets serve as side information that may have been erased, and demonstrate that the loss due to a delay by one time unit is rather small.

[1]  Toby Berger,et al.  Sequential coding of correlated sources , 2000, IEEE Trans. Inf. Theory.

[2]  Babak Hassibi,et al.  Sequential Coding of Gauss-Markov Sources , 2017 .

[3]  Babak Hassibi,et al.  Algorithms for optimal control with fixed-rate feedback , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[4]  Suhas N. Diggavi,et al.  On the Role of Encoder Side-Information in Source Coding for Multiple Decoders , 2006, 2006 IEEE International Symposium on Information Theory.

[5]  U. Erez,et al.  Source coding with composite side information at the decoder , 2012, 2012 IEEE 27th Convention of Electrical and Electronics Engineers in Israel.

[6]  Zhen Zhang,et al.  Rate Distortion Theory for Causal Video Coding: Characterization, Computation Algorithm, and Comparison , 2011, IEEE Transactions on Information Theory.

[7]  Takashi Tanaka,et al.  Semidefinite representation of sequential rate-distortion function for stationary Gauss-Markov processes , 2015, 2015 IEEE Conference on Control Applications (CCA).

[8]  Gregory W. Wornell,et al.  Causal Transmission of Colored Source Frames over a Packet Erasure Channel , 2010, 2010 Data Compression Conference.

[9]  Massimo Franceschetti,et al.  Data Rate Theorem for Stabilization Over Time-Varying Feedback Channels , 2009, IEEE Transactions on Automatic Control.

[10]  Uri Erez,et al.  A Gaussian input is not too bad , 2004, IEEE Transactions on Information Theory.

[11]  Tie Liu,et al.  Gaussian Robust Sequential and Predictive Coding , 2013, IEEE Trans. Inf. Theory.

[12]  Amiram H. Kaspi,et al.  Rate-distortion function when side-information may be present at the decoder , 1994, IEEE Trans. Inf. Theory.

[13]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[14]  Prakash Ishwar,et al.  On Delayed Sequential Coding of Correlated Sources , 2011, IEEE Transactions on Information Theory.

[15]  Toby Berger,et al.  Rate distortion when side information may be absent , 1985, IEEE Trans. Inf. Theory.

[16]  Tihao Chiang,et al.  Advances in the scalable amendment of H.264/AVC , 2007, IEEE Communications Magazine.

[17]  En-Hui Yang,et al.  Causal coding of multiple jointly Gaussian sources , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[18]  Thomas M. Cover,et al.  Elements of Information Theory: Cover/Elements of Information Theory, Second Edition , 2005 .

[19]  Babak Hassibi,et al.  Rate-cost tradeoffs in control , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[20]  Farrokh Etezadi,et al.  Zero-Delay Sequential Transmission of Markov Sources Over Burst Erasure Channels , 2014, IEEE Transactions on Information Theory.

[21]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[22]  Yuval Kochman,et al.  Lattice Coding for Signals and Networks: Lattice shaping , 2014 .

[23]  Sekhar Tatikonda,et al.  Control under communication constraints , 2004, IEEE Transactions on Automatic Control.