Achieving the Stationary Feedback Capacity for Gaussian Channels

AbstractIn this paper, we study a Gaussian channel with memory and wit h noiseless feedback, for which we present a coding scheme to achieve the stationary feedback capacity (the maximum information rate over all stationaryinput distributions, conjectured to be the asymptotic feed back capacity). The coding scheme essentially implements the celebrated Kalman filter algorithm; is equiv alent to an estimation system over the same channel without feedback; and reveals that the achievable informat ion rate of the feedback communication system can be alternatively given by the decay rate of the Cramer-Rao boun d of the associated estimation system. Thus, combined with the control theoretic characterizations of feedback c ommunication (proposed by Elia), this implies that the fundamental limitations in feedback communication, estim a on, and control coincide. In addition, the proposed coding scheme simplifies the coding complexity and shortens he coding delay, and its construction amounts to solving a finite-dimensional optimization problem. We also pr vide a further simplification to the optimal input distribution developed by Yang, Kavcic, and Tatikonda.

[1]  Meir Feder,et al.  On a capacity achieving scheme for the colored Gaussian channel with feedback , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[2]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[3]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[4]  Huibert Kwakernaak,et al.  Linear Optimal Control Systems , 1972 .

[5]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[6]  T. Kailath,et al.  A coding scheme for additive noise channels with feedback, Part I: No bandwith constraint , 1998 .

[7]  Nigel J. Newton,et al.  Information and Entropy Flow in the Kalman–Bucy Filter , 2005 .

[8]  S. Butman Linear feedback rate bounds for regressive channels , 1976 .

[9]  Sekhar Tatikonda,et al.  Control over noisy channels , 2004, IEEE Transactions on Automatic Control.

[10]  L. Goddard Information Theory , 1962, Nature.

[11]  Jim K. Omura,et al.  Optimum linear transmission of analog data for channels with feedback , 1968, IEEE Trans. Inf. Theory.

[12]  Sekhar Tatikonda,et al.  On the Feedback Capacity of Power-Constrained Gaussian Noise Channels With Memory , 2007, IEEE Transactions on Information Theory.

[13]  Thomas M. Cover,et al.  Gaussian feedback capacity , 1989, IEEE Trans. Inf. Theory.

[14]  J. Pieter M. Schalkwijk,et al.  A coding scheme for additive noise channels with feedback-II: Band-limited signals , 1966, IEEE Trans. Inf. Theory.

[15]  Nicola Elia,et al.  When bode meets shannon: control-oriented feedback communication schemes , 2004, IEEE Transactions on Automatic Control.

[16]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .

[17]  Kyle A. Gallivan,et al.  Singular Riccati equations stabilizing large-scale systems , 2006 .

[18]  Gerhard Kramer,et al.  Feedback strategies for white Gaussian interference networks , 2002, IEEE Trans. Inf. Theory.