Negligible Cooperation: Contrasting the Maximal- and Average-Error Cases

In communication networks, cooperative strategies are coding schemes where network nodes work together to improve network performance metrics such as the total rate delivered across the network. This work studies encoder cooperation in the setting of a discrete multiple access channel (MAC) with two encoders and a single decoder. A network node, here called the cooperation facilitator (CF), that is connected to both encoders via rate-limited links, enables the cooperation strategy. Previous work by the authors presents two classes of MACs: (i) one class where the average-error sum-capacity has an infinite derivative in the limit where CF output link capacities approach zero, and (ii) a second class of MACs where the maximal-error sum-capacity is not continuous at the point where the output link capacities of the CF equal zero. This work contrasts the power of the CF in the maximal- and average-error cases, showing that a constant number of bits communicated over the CF output link can yield a positive gain in the maximal-error sum-capacity, while a far greater number of bits, even numbers that grow sublinearly in the blocklength, can never yield a non-negligible gain in the average-error sum-capacity.

[1]  Tracey Ho,et al.  On equivalence between network topologies , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[2]  Masoud Salehi,et al.  Multiple access channels with arbitrarily correlated sources , 1980, IEEE Trans. Inf. Theory.

[3]  Gerhard Kramer,et al.  An application of a wringing lemma to the multiple access channel with cooperative encoders , 2014, 2014 Iran Workshop on Communication and Information Theory (IWCIT).

[4]  M. Effros,et al.  A continuity theory for lossless source coding over networks , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[5]  Alex J. Grant,et al.  On capacity regions of non-multicast networks , 2010, 2010 IEEE International Symposium on Information Theory.

[6]  Michael Langberg,et al.  Can Negligible Rate Increase Network Reliability? , 2018, IEEE Transactions on Information Theory.

[7]  Michael Langberg,et al.  Source coding for dependent sources , 2012, 2012 IEEE Information Theory Workshop.

[8]  Oliver Kosut,et al.  Strong Converses are Just Edge Removal Properties , 2017, IEEE Transactions on Information Theory.

[9]  Imre Csiszár,et al.  Information Theory and Statistics: A Tutorial , 2004, Found. Trends Commun. Inf. Theory.

[10]  Frans M. J. Willems,et al.  The discrete memoryless multiple access channel with partially cooperating encoders , 1983, IEEE Trans. Inf. Theory.

[11]  Parham Noorzad Network Effects in Small Networks: A Study of Cooperation , 2017 .

[12]  Michael Langberg,et al.  Network coding: Is zero error always possible? , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[13]  Lizhong Zheng,et al.  Fundamental Limits of Communication With Low Probability of Detection , 2015, IEEE Transactions on Information Theory.

[14]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[15]  Anand D. Sarwate,et al.  Some observations on limited feedback for multiaccess channels , 2009, 2009 IEEE International Symposium on Information Theory.

[16]  Michael Langberg,et al.  On the Capacity Advantage of a Single Bit , 2016, 2016 IEEE Globecom Workshops (GC Wkshps).

[17]  John N. Tsitsiklis,et al.  Introduction to linear optimization , 1997, Athena scientific optimization and computation series.

[18]  Michael Langberg,et al.  Can Negligible Cooperation Increase Network Capacity? The Average-Error Case , 2018, ArXiv.

[19]  Andries P. Hekstra,et al.  Dependence balance bounds for single-output two-way channels , 1989, IEEE Trans. Inf. Theory.

[20]  R. Gallager Information Theory and Reliable Communication , 1968 .

[21]  Tracey Ho,et al.  On the impact of a single edge on the network coding capacity , 2011, 2011 Information Theory and Applications Workshop.