On the capacity of cloud radio access networks with oblivious relaying

We study the transmission over a network in which users send information to a remote destination through relay nodes that are connected to the destination via finite-capacity error-free links, i.e., a cloud radio access network. The relays are constrained to operate without knowledge of the users' codebooks, i.e., they perform oblivious processing. The destination, or central processor, however, is informed about the users' codebooks. We establish a single-letter characterization of the capacity region of this model for a class of discrete memoryless channels in which the outputs at the relay nodes are independent given the users' inputs. We show that both relaying a-la Cover-El Gamal, i.e., compress-and-forward with joint decompression and decoding, and “noisy network coding”, are optimal. The proof of the converse part establishes, and utilizes, connections with the Chief Executive Officer (CEO) source coding problem under logarithmic loss distortion measure. Extensions to general discrete memoryless channels are also investigated. In this case, we establish inner and outer bounds on the capacity region. For memoryless Gaussian channels within the studied class of channels, we characterize the capacity under Gaussian channel inputs.

[1]  Shlomo Shamai,et al.  Robust Communication via Decentralized Processing With Unreliable Backhaul Links , 2011, IEEE Transactions on Information Theory.

[2]  Pramod Viswanath,et al.  Rate Region of the Quadratic Gaussian Two-Encoder Source-Coding Problem , 2005, IEEE Transactions on Information Theory.

[3]  Prakash Narayan,et al.  Reliable Communication Under Channel Uncertainty , 1998, IEEE Trans. Inf. Theory.

[4]  Rüdiger L. Urbanke,et al.  A rate-splitting approach to the Gaussian multiple-access channel , 1996, IEEE Trans. Inf. Theory.

[5]  Naftali Tishby,et al.  The information bottleneck method , 2000, ArXiv.

[6]  Naftali Tishby,et al.  Extraction of relevant speech features using the information bottleneck method , 2005, INTERSPEECH.

[7]  Hans S. Witsenhausen,et al.  A conditional entropy bound for a pair of discrete random variables , 1975, IEEE Trans. Inf. Theory.

[8]  Jing Liu,et al.  Community Detection in Networks Based on Information Bottleneck Clustering , 2015 .

[9]  Shlomo Shamai,et al.  Robust distributed compression for cloud radio access networks , 2012, 2012 IEEE Information Theory Workshop.

[10]  Gal Chechik,et al.  Information Bottleneck for Gaussian Variables , 2003, J. Mach. Learn. Res..

[11]  Sae-Young Chung,et al.  Noisy Network Coding , 2010, IEEE Transactions on Information Theory.

[12]  Shlomo Shamai,et al.  Structured superposition for backhaul constrained cellular uplink , 2009, 2009 IEEE International Symposium on Information Theory.

[13]  Shlomo Shamai,et al.  Robust and Efficient Distributed Compression for Cloud Radio Access Networks , 2012, IEEE Transactions on Vehicular Technology.

[14]  Suhas N. Diggavi,et al.  Wireless Network Information Flow: A Deterministic Approach , 2009, IEEE Transactions on Information Theory.

[15]  Giuseppe Caire,et al.  Compute-and-Forward Strategies for Cooperative Distributed Antenna Systems , 2012, IEEE Transactions on Information Theory.

[16]  Inaki Estella Aguerri,et al.  A generalization of blahut-arimoto algorithm to compute rate-distortion regions of multiterminal source coding under logarithmic loss , 2017, 2017 IEEE Information Theory Workshop (ITW).

[17]  Naftali Tishby,et al.  Deep learning and the information bottleneck principle , 2015, 2015 IEEE Information Theory Workshop (ITW).

[18]  Young-Han Kim,et al.  On the capacity of cloud radio access networks , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[19]  Shlomo Shamai,et al.  Communication Via Decentralized Processing , 2005, IEEE Transactions on Information Theory.

[20]  Shlomo Shamai,et al.  Joint Decompression and Decoding for Cloud Radio Access Networks , 2013, IEEE Signal Processing Letters.

[21]  Wei Yu,et al.  On the Optimal Fronthaul Compression and Decoding Strategies for Uplink Cloud Radio Access Networks , 2016, IEEE Transactions on Information Theory.

[22]  Gábor Lugosi,et al.  Prediction, learning, and games , 2006 .

[23]  Elza Erkip,et al.  The Efficiency of Investment Information , 1998, IEEE Trans. Inf. Theory.

[24]  H. Vincent Poor,et al.  Fronthaul-constrained cloud radio access networks: insights and challenges , 2015, IEEE Wireless Communications.

[25]  Tsachy Weissman,et al.  Multiterminal Source Coding Under Logarithmic Loss , 2011, IEEE Transactions on Information Theory.

[26]  Naftali Tishby,et al.  Opening the Black Box of Deep Neural Networks via Information , 2017, ArXiv.

[27]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[28]  Naftali Tishby,et al.  The Information Bottleneck Revisited or How to Choose a Good Distortion Measure , 2007, 2007 IEEE International Symposium on Information Theory.

[29]  Abbas El Gamal,et al.  Capacity theorems for the relay channel , 1979, IEEE Trans. Inf. Theory.

[30]  Venkat Anantharam,et al.  An improved outer bound for multiterminal source coding , 2008, IEEE Transactions on Information Theory.

[31]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[32]  Naftali Tishby,et al.  An Information Theoretic Tradeoff between Complexity and Accuracy , 2003, COLT.

[33]  Wei Yu,et al.  An uplink-downlink duality for cloud radio access network , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[34]  Wei Yu,et al.  Uplink Multicell Processing with Limited Backhaul via Per-Base-Station Successive Interference Cancellation , 2012, IEEE Journal on Selected Areas in Communications.

[35]  Shlomo Shamai,et al.  Uplink Macro Diversity of Limited Backhaul Cellular Network , 2008, IEEE Transactions on Information Theory.

[36]  Inaki Estella Aguerri,et al.  Distributed Information Bottleneck Method for Discrete and Gaussian Sources , 2017, ArXiv.

[37]  T. Cover,et al.  Rate Distortion Theory , 2001 .

[38]  Shlomo Shamai,et al.  On Codebook Information for Interference Relay Channels With Out-of-Band Relaying , 2011, IEEE Transactions on Information Theory.

[39]  Wolfgang Maass,et al.  A Spiking Neuron as Information Bottleneck , 2010, Neural Computation.

[40]  Michael Gastpar,et al.  Compute-and-Forward: Harnessing Interference Through Structured Codes , 2009, IEEE Transactions on Information Theory.

[41]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[42]  Giuseppe Caire,et al.  On the Capacity of Cloud Radio Access Networks With Oblivious Relaying , 2019, IEEE Transactions on Information Theory.

[43]  Sennur Ulukus,et al.  An Outer Bound for the Vector Gaussian CEO Problem , 2014, IEEE Transactions on Information Theory.

[44]  W. Bialek,et al.  Information-based clustering. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[45]  Inaki Estella Aguerri,et al.  Lossy Compression for Compute-and-Forward in Limited Backhaul Uplink Multicell Processing , 2016, IEEE Transactions on Communications.

[46]  Toby Berger,et al.  Successive Wyner–Ziv Coding Scheme and Its Application to the Quadratic Gaussian CEO Problem , 2006, IEEE Transactions on Information Theory.

[47]  Naftali Tishby,et al.  Document clustering using word clusters via the information bottleneck method , 2000, SIGIR '00.

[48]  Gerald Matz,et al.  Rate-information-optimal Gaussian channel output compression , 2014, 2014 48th Annual Conference on Information Sciences and Systems (CISS).

[49]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[50]  Naftali Tishby,et al.  The Power of Word Clusters for Text Classification , 2006 .

[51]  Abbas El Gamal,et al.  Bounds on capacity and minimum energy-per-bit for AWGN relay channels , 2006, IEEE Transactions on Information Theory.

[52]  János Körner,et al.  How to encode the modulo-two sum of binary sources (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[53]  Boris Tsybakov,et al.  Information transmission with additional noise , 1962, IRE Trans. Inf. Theory.

[54]  Young-Han Kim,et al.  Coding Techniques for Primitive Relay Channels , 2008 .

[55]  Aylin Yener,et al.  Relaying for multiple sources in the absence of codebook information , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[56]  Daniela Tuninetti,et al.  On discrete alphabets for the two-user Gaussian interference channel with one receiver lacking knowledge of the interfering codebook , 2014, 2014 Information Theory and Applications Workshop (ITA).

[57]  Amir Dembo,et al.  Information theoretic inequalities , 1991, IEEE Trans. Inf. Theory.