Semidefinite representation of sequential rate-distortion function for stationary Gauss-Markov processes

We consider an information-theoretic performance limitation of zero-delay source coding schemes for multidimensional stationary Gauss-Markov sources. In particular, the sequential rate-distortion (SRD) problem is formulated in which the average rate per stage is minimized subject to a constraint on the average mean-square distortion per stage. We prove that there exists an optimal test channel that is linear and time invariant, which can be efficiently constructed by semidefinite programming (SDP). This result indicates that the exponentiated sequential rate-distortion function admits a semidefinite representation.

[1]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[2]  Stephen P. Boyd,et al.  Determinant Maximization with Linear Matrix Inequality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[3]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[4]  Takashi Tanaka.  Zero-delay rate-distortion optimization for partially observable Gauss-Markov processes , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[5]  J. Massey.  CAUSALITY, FEEDBACK AND DIRECTED INFORMATION , 1990 .

[6]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[7]  David L. Neuhoff,et al.  Causal source codes , 1982, IEEE Trans. Inf. Theory.

[8]  Panos J. Antsaklis,et al.  Control and Communication Challenges in Networked Real-Time Systems , 2007, Proceedings of the IEEE.

[9]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[10]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[11]  D. Harville.  Matrix Algebra From a Statistician's Perspective , 1998 .

[12]  E. Yaz.  Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  Pablo A. Parrilo,et al.  Semidefinite Programming Approach to Gaussian Sequential Rate-Distortion Trade-Offs , 2014, IEEE Transactions on Automatic Control.

[15]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[16]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[17]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .