Upper and Lower Bounds to the Information Rate Transferred Through First-Order Markov Channels With Free-Running Continuous State

Starting from the definition of mutual information, one promptly realizes that the probabilities inferred by Bayesian tracking can be used to compute the Shannon information between the state and the measurement of a dynamic system. In the Gaussian and linear case, the information rate can be evaluated from the probabilities computed by the Kalman filter. When the probability distributions inferred by Bayesian tracking are nontractable, one is forced to resort to approximated inference, which gives only an approximation to the wanted probabilities. We propose upper and lower bounds to the information rate between the hidden state and the measurement based on approximated inference. Application of these bounds to multiplicative communication channels is discussed, and experimental results for the discrete-time phase noise channel and for the Gauss-Markov fading channel are presented.

[1]  J.V. Candy,et al.  Bootstrap Particle Filtering , 2007, IEEE Signal Processing Magazine.

[2]  S. Venkatraman,et al.  The Constrained Capacity of Single and Multiuser Channels with Unknown Fading , 2007, 2007 IEEE Information Theory Workshop.

[3]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[4]  Amos Lapidoth.  On phase noise channels at high SNR , 2002, Proceedings of the IEEE Information Theory Workshop.

[5]  Luca Barletta,et al.  Tight upper and lower bounds to the information rate of the phase noise channel , 2013, 2013 IEEE International Symposium on Information Theory.

[6]  Helmut Bölcskei,et al.  On the Sensitivity of Continuous-Time Noncoherent Fading Channel Capacity , 2012, IEEE Transactions on Information Theory.

[7]  Maurizio Magarini,et al.  Empirical modeling and simulation of phase noise in long-haul coherent optical transmission systems. , 2011, Optics express.

[8]  G. Colavolpe,et al.  Impact of Phase Noise and Compensation Techniques in Coherent Optical Systems , 2011, Journal of Lightwave Technology.

[9]  Gerhard Kramer,et al.  On Noncoherent Fading Relay Channels at High Signal-to-Noise Ratio , 2011, IEEE Transactions on Information Theory.

[10]  M. Magarini,et al.  Bridging the Gap Between Kalman Filter and Wiener Filter in Carrier Phase Tracking , 2013, IEEE Photonics Technology Letters.

[11]  L. Barletta,et al.  Estimate of Information Rates of Discrete-Time First-Order Markov Phase Noise Channels , 2011, IEEE Photonics Technology Letters.

[12]  Luca Barletta,et al.  New Lower Bound below the Information Rate of Phase Noise Channel Based on Kalman Carrier Recovery , 2012 .

[13]  Petar M. Djuric,et al.  Distributed particle filtering in agent networks: A survey, classification, and comparison , 2013, IEEE Signal Processing Magazine.

[14]  Justin Dauwels,et al.  Computation of Information Rates by Particle Methods , 2004, IEEE Transactions on Information Theory.

[15]  Ping Hou,et al.  Shaping gain of the partially coherent additive white Gaussian noise channel , 2002, IEEE Communications Letters.

[16]  David Tse,et al.  Degrees of freedom in some underspread MIMO fading channels , 2006, IEEE Transactions on Information Theory.

[17]  Luca Barletta,et al.  On continuous-time white phase noise channels , 2014, 2014 IEEE International Symposium on Information Theory.

[18]  Giuseppe Durisi,et al.  On the capacity of MIMO Wiener phase-noise channels , 2013, 2013 Information Theory and Applications Workshop (ITA).

[19]  P. Winzer,et al.  Capacity Limits of Optical Fiber Networks , 2010, Journal of Lightwave Technology.

[20]  Maurizio Magarini,et al.  Wiener's Analysis of the Discrete-Time Phase-Locked Loop With Loop Delay , 2008, IEEE Transactions on Circuits and Systems II: Express Briefs.

[21]  Nicholas G. Polson,et al.  Particle Filtering , 2006 .

[22]  John B. Moore,et al.  Optimal State Estimation , 2006 .

[23]  M. Magarini,et al.  The Information Rate Transferred Through the Discrete-Time Wiener's Phase Noise Channel , 2012, Journal of Lightwave Technology.

[24]  Gerhard Kramer,et al.  Multi-sample receivers increase information rates for Wiener phase noise channels , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[25]  Peter J. Winzer,et al.  Calculation of Mutual Information for Partially Coherent Gaussian Channels With Applications to Fiber Optics , 2010, IEEE Transactions on Information Theory.

[26]  P. Djurić,et al.  Particle filtering , 2003, IEEE Signal Process. Mag..

[27]  Riccardo Raheli,et al.  On the information rate of phase noise-limited communications , 2013, 2013 Information Theory and Applications Workshop (ITA).

[28]  Luca Barletta,et al.  A new lower bound below the information rate of Wiener phase noise channel based on Kalman carrier recovery. , 2012, Optics express.

[29]  Drew D. Creal.  A Survey of Sequential Monte Carlo Methods for Economics and Finance , 2012 .

[30]  Giulio Colavolpe,et al.  On the Information Rate and Repeat-Accumulate Code Design for Phase Noise Channels , 2011, IEEE Transactions on Communications.

[31]  Gerhard Kramer,et al.  On Wiener phase noise channels at high Signal-to-Noise Ratio , 2013, 2013 IEEE International Symposium on Information Theory.