The Interplay Between Information and Estimation Measures

1. Introduction 2: Basic Information and Estimation Measures 3: Properties of the MMSE in Gaussian Noise 4: Mutual Information and MMSE: Basic Relationship 5: Mutual Information and MMSE in Discrete- and Continuous-time Gaussian Channels 6: Entropy, Relative Entropy, Fisher Information, and Mismatched Estimation 7: Applications of I-MMSE 8: Information and Estimation Measures in Poisson Models and Channels 9: Beyond Gaussian and Poisson Models 10: Outlook. Acknowledgements. Appendices. References.

[1]  A. D. Wyner,et al.  The wire-tap channel , 1975, The Bell System Technical Journal.

[2]  Rick S. Blum,et al.  MIMO radar waveform design based on mutual information and minimum mean-square error estimation , 2007, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Sergio Verdú,et al.  Functional Properties of Minimum Mean-Square Error and Mutual Information , 2012, IEEE Transactions on Information Theory.

[4]  Haim H. Permuter,et al.  Directed Information, Causal Estimation, and Communication in Continuous Time , 2013, IEEE Trans. Inf. Theory.

[5]  Sergio Verdú,et al.  Derivative of Mutual Information at Zero SNR: The Gaussian-Noise Case , 2011, IEEE Transactions on Information Theory.

[6]  Dongning Guo,et al.  The Degrees of Freedom of Isotropic MIMO Interference Channels Without State Information at the Transmitters , 2012, IEEE Transactions on Information Theory.

[7]  Shlomo Shamai,et al.  The Capacity Region of the Gaussian Multiple-Input Multiple-Output Broadcast Channel , 2006, IEEE Transactions on Information Theory.

[8]  Tsachy Weissman,et al.  The Relationship Between Causal and Noncausal Mismatched Estimation in Continuous-Time AWGN Channels , 2010, IEEE Transactions on Information Theory.

[9]  Moshe Zakai,et al.  On mutual information, likelihood ratios, and estimation error for the additive Gaussian channel , 2004, IEEE Transactions on Information Theory.

[10]  Shlomo Shamai,et al.  On the Capacity Region of the Multi-Antenna Broadcast Channel with Common Messages , 2006, 2006 IEEE International Symposium on Information Theory.

[11]  Sergio Verdu,et al.  MMSE Dimension , 2011, IEEE Trans. Inf. Theory.

[12]  Dongning Guo,et al.  Ergodic Fading Z-Interference Channels Without State Information at Transmitters , 2011, IEEE Transactions on Information Theory.

[13]  Miguel R. D. Rodrigues,et al.  Generalized Bregman divergence and gradient of mutual information for vector Poisson channels , 2013, 2013 IEEE International Symposium on Information Theory.