Joint coordination-channel coding for strong coordination over noisy channels based on polar codes

We construct a joint coordination-channel polar coding scheme for strong coordination of actions between two agents X and Y, which communicate over a discrete memoryless channel (DMC) such that the joint distribution of actions follows a prescribed probability distribution. We show that polar codes are able to achieve our previously established inner bound to the strong noisy coordination capacity region and thus provide a constructive alternative to a random coding proof. Our polar coding scheme also offers a constructive solution to a channel simulation problem where a DMC and shared randomness are together employed to simulate another DMC. In particular, our proposed solution is able to utilize the randomness of the DMC to reduce the amount of local randomness required to generate the sequence of actions at agent Y. By leveraging our earlier random coding results for this problem, we conclude that the proposed joint coordination-channel coding scheme strictly outperforms a separate scheme in terms of achievable communication rate for the same amount of injected randomness into both systems.

[1]  Jörg Kliewer,et al.  Strong coordination over noisy channels: Is separation sufficient? , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[2]  Amin Gohari,et al.  Channel Simulation via Interactive Communications , 2012, IEEE Transactions on Information Theory.

[3]  Ali Bereyhi,et al.  Empirical coordination in a triangular multiterminal network , 2013, 2013 IEEE International Symposium on Information Theory.

[4]  Jörg Kliewer,et al.  Strong coordination over a line network , 2013, 2013 IEEE International Symposium on Information Theory.

[5]  Amin Gohari,et al.  Coordination via a relay , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[6]  Jörg Kliewer,et al.  Strong coordination over multi-hop line networks , 2015, 2015 IEEE Information Theory Workshop - Fall (ITW).

[7]  Sergio Verdú,et al.  Approximation theory of output statistics , 1993, IEEE Trans. Inf. Theory.

[8]  Erdal Arikan,et al.  Source polarization , 2010, 2010 IEEE International Symposium on Information Theory.

[9]  Matthieu R. Bloch,et al.  Polar coding for empirical coordination of signals and actions over noisy channels , 2016, 2016 IEEE Information Theory Workshop (ITW).

[10]  Michael Langberg,et al.  Asymmetric Error Correction and Flash-Memory Rewriting Using Polar Codes , 2014, IEEE Transactions on Information Theory.

[11]  Jörg Kliewer,et al.  Strong coordination over a three-terminal relay network , 2014, 2014 IEEE Information Theory Workshop (ITW 2014).

[12]  Mikael Skoglund,et al.  Polar Codes for Coordination in Cascade Networks , 2012 .

[13]  Michael Gastpar,et al.  Polar Codes for Broadcast Channels , 2013, IEEE Transactions on Information Theory.

[14]  Remi A. Chou,et al.  Polar Coding for the Broadcast Channel With Confidential Messages: A Random Binning Analogy , 2016, IEEE Transactions on Information Theory.

[15]  Paul W. Cuff,et al.  Hybrid codes needed for coordination over the point-to-point channel , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[16]  Emina Soljanin,et al.  Compressing quantum mixed-state sources by sending classical information , 2002, IEEE Trans. Inf. Theory.

[17]  Mohammad Reza Aref,et al.  Simulation of a Channel With Another Channel , 2013, IEEE Transactions on Information Theory.

[18]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[19]  G. David Forney,et al.  On the role of MMSE estimation in approaching the information-theoretic limits of linear Gaussian channels: Shannon meets Wiener , 2004, ArXiv.

[20]  Paul W. Cuff,et al.  Distributed Channel Synthesis , 2012, IEEE Transactions on Information Theory.

[21]  Venkat Anantharam,et al.  Generating dependent random variables over networks , 2011, 2011 IEEE Information Theory Workshop.

[22]  Jörg Kliewer,et al.  Strong coordination with polar codes , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[23]  Emre Telatar,et al.  Polarization for arbitrary discrete memoryless channels , 2009, 2009 IEEE Information Theory Workshop.

[24]  Rüdiger L. Urbanke,et al.  Achieving Marton’s Region for Broadcast Channels Using Polar Codes , 2014, IEEE Transactions on Information Theory.

[25]  Jörg Kliewer,et al.  Empirical and Strong Coordination via Soft Covering With Polar Codes , 2016, IEEE Transactions on Information Theory.

[26]  Erdal Arikan,et al.  Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Binary-Input Memoryless Channels , 2008, IEEE Transactions on Information Theory.

[27]  Haim H. Permuter,et al.  Coordination Capacity , 2009, IEEE Transactions on Information Theory.

[28]  Matthieu R. Bloch,et al.  Strong Coordination of Signals and Actions Over Noisy Channels With Two-Sided State Information , 2018, IEEE Transactions on Information Theory.