Feedback Capacity of Parallel ACGN Channels and Kalman Filter: Power Allocation with Feedback

In this paper, we relate the feedback capacity of parallel additive colored Gaussian noise (ACGN) channels to a variant of the Kalman filter. By doing so, we obtain lower bounds on the feedback capacity of such channels, as well as the corresponding feedback (recursive) coding schemes, which are essentially power allocation policies with feedback, to achieve the bounds. The results are seen to reduce to existing lower bounds in the case of a single ACGN feedback channel, whereas when it comes to parallel additive white Gaussian noise (AWGN) channels with feedback, the recursive coding scheme reduces to a “feedback water-filling” power allocation policy.

[1]  Young Han Kim,et al.  Feedback capacity of the first-order moving average Gaussian channel , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[2]  Vincent Y. F. Tan,et al.  A Tight Upper Bound on the Second-Order Coding Rate of the Parallel Gaussian Channel With Feedback , 2017, IEEE Transactions on Information Theory.

[3]  Takashi Tanaka,et al.  Some Results on the Computation of Feedback Capacity of Gaussian Channels with Memory , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  Chong Li,et al.  Computation of Feedback Capacity of Single User Multi-Antenna Stationary Gaussian Channel , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[5]  Quanyan Zhu,et al.  A Connection between Feedback Capacity and Kalman Filter for Colored Gaussian Noises , 2020, 2020 IEEE International Symposium on Information Theory (ISIT).

[6]  Nicola Elia,et al.  Convergence of Fundamental Limitations in Feedback Communication, Estimation, and Feedback Control over Gaussian Channels , 2009, Commun. Inf. Syst..

[7]  Jie Chen,et al.  An Integral Characterization of Optimal Error Covariance by Kalman Filtering , 2018, 2018 Annual American Control Conference (ACC).

[8]  Sekhar Tatikonda,et al.  On the Feedback Capacity of Power-Constrained Gaussian Noise Channels With Memory , 2007, IEEE Transactions on Information Theory.

[9]  Richard M. Murray,et al.  Feedback Systems: An Introduction for Scientists and Engineers , 2008 .

[10]  Christos K. Kourtellaris,et al.  Sequential Necessary and Sufficient Conditions for Capacity Achieving Distributions of Channels With Memory and Feedback , 2016, IEEE Transactions on Information Theory.

[11]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[12]  N. I. Miridakis,et al.  Linear Estimation , 2018, Digital and Statistical Signal Processing.

[13]  P. P. Vaidyanathan,et al.  The Theory of Linear Prediction , 2008, Synthesis Lectures on Signal Processing.

[14]  Massimo Franceschetti,et al.  Control-Theoretic Approach to Communication With Feedback , 2012, IEEE Transactions on Automatic Control.

[15]  Tao Liu,et al.  Feedback Capacity of Stationary Gaussian Channels Further Examined , 2019, IEEE Transactions on Information Theory.

[16]  Ziv Goldfeld,et al.  Capacity of Continuous Channels with Memory via Directed Information Neural Estimator , 2020, 2020 IEEE International Symposium on Information Theory (ISIT).

[17]  Nicola Elia,et al.  Youla Coding and Computation of Gaussian Feedback Capacity , 2018, IEEE Transactions on Information Theory.

[18]  Sekhar Tatikonda,et al.  The Capacity of Channels With Feedback , 2006, IEEE Transactions on Information Theory.

[19]  Ather Gattami.  Feedback Capacity of Gaussian Channels Revisited , 2019, IEEE Transactions on Information Theory.

[20]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[21]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[22]  Young-Han Kim,et al.  Feedback Capacity of Stationary Gaussian Channels , 2006, 2006 IEEE International Symposium on Information Theory.

[23]  Christos K. Kourtellaris,et al.  Information Structures of Capacity Achieving Distributions for Feedback Channels with Memory and Transmission Cost: Stochastic Optimal Control & Variational Equalities-Part I , 2015, ArXiv.

[24]  Sekhar Tatikonda,et al.  Capacity-Achieving Feedback Schemes for Gaussian Finite-State Markov Channels With Channel State Information , 2008, IEEE Transactions on Information Theory.

[25]  Thomas M. Cover,et al.  Gaussian feedback capacity , 1989, IEEE Trans. Inf. Theory.

[26]  Jie Chen,et al.  Towards Integrating Control and Information Theories , 2017 .

[27]  Nicola Elia,et al.  When bode meets shannon: control-oriented feedback communication schemes , 2004, IEEE Transactions on Automatic Control.