Exploiting Interference through Algebraic Structure

Author(s): Nazer, Bobak Anthony | Advisor(s): Gastpar, Michael C | Abstract: In a network, interference between transmitters is usually viewed as highly undesirable and clever algorithms and protocols have been devised to avoid it. Collectively, these strategies transform the physical layer into a set of reliable bit pipes which can then be used seamlessly by higher layers in the protocol stack. Unfortunately, interference avoidance results in sharply decreasing rates as the number of users increases. In this thesis, we develop a new tool, computation coding, that allows receivers to reliably decode equations of transmitted messages by harnessing the interference structure of the channel. Applied to a wireless network, this enables relays to decode linear functions of the transmitted messages with coefficients dictated by the fading realization. Relays can then forward these equations towards the destinations which simply collect enough equations to solve for their desired messages. Structured codes (such as lattices) ensure that these linear combinations can be decoded reliably at the relays, often at far higher rates than the messages individually. Through examples drawn from cooperative communication including cellular uplink, distributed MIMO and wireless network coding, we demonstrate that this compute-and-forward strategy can improve end-to-end throughput in a network. As a consequence, we will see that structured codes can play an important role in approaching the capacity of networks. We also show that our techniques can result in both energy and delay savings for distributed signal processing over a sensor network. Finally, by viewing interference as implicit computation, we provide a new perspective on the interference channel with time-varying fading. We describe a simple interference alignment scheme that enables each user to achieve at least half its interference-free capacity at any signal-to-noise ratio.

[1]  S. Shamai,et al.  Scaling Laws in Decentralized Processing of Interfered Gaussian Channels , 2008, 2008 IEEE International Zurich Seminar on Communications.

[2]  Sathya Narayanan,et al.  CoopMAC: A Cooperative MAC for Wireless LANs , 2007, IEEE Journal on Selected Areas in Communications.

[3]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[4]  Anna Scaglione,et al.  A scalable wireless communication architecture for average consensus , 2007, 2007 46th IEEE Conference on Decision and Control.

[5]  D. Tuninetti,et al.  Gaussian fading interference channels: Power control , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.

[6]  A. Sinclair Improved Bounds for Mixing Rates of Markov Chains and Multicommodity Flow , 1992, Combinatorics, Probability and Computing.

[7]  Imre Csiszár Linear codes for sources and source networks: Error exponents, universal coding , 1982, IEEE Trans. Inf. Theory.

[8]  Henry Herng-Jiunn Liao,et al.  Multiple access channels (Ph.D. Thesis abstr.) , 1973, IEEE Trans. Inf. Theory.

[9]  Shlomo Shamai,et al.  Sum Rate Characterization of Joint Multiple Cell-Site Processing , 2007, IEEE Transactions on Information Theory.

[10]  Alexandros G. Dimakis,et al.  Geographic Gossip: Efficient Averaging for Sensor Networks , 2007, IEEE Transactions on Signal Processing.

[11]  Yuval Kochman,et al.  Analog Matching of Colored Sources to Colored Channels , 2006, ISIT.

[12]  Richard M. Murray,et al.  Approximate distributed Kalman filtering in sensor networks with quantifiable performance , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[13]  Peter Sanders,et al.  Polynomial time algorithms for network information flow , 2003, SPAA '03.

[14]  Hans-Andrea Loeliger,et al.  Averaging bounds for lattices and linear codes , 1997, IEEE Trans. Inf. Theory.

[15]  Syed Ali Jafar,et al.  Interference Alignment and the Degrees of Freedom of Wireless $X$ Networks , 2009, IEEE Transactions on Information Theory.

[16]  Giuseppe Caire,et al.  Lattice coding and decoding achieve the optimal diversity-multiplexing tradeoff of MIMO channels , 2004, IEEE Transactions on Information Theory.

[17]  B. Nazer,et al.  Structured Random Codes and Sensor Network Coding Theorems , 2008, 2008 IEEE International Zurich Seminar on Communications.

[18]  Aaron B. Wagner On Distributed Compression of Linear Functions , 2011, IEEE Transactions on Information Theory.

[19]  Yuval Kochman,et al.  Joint Wyner-Ziv / Dirty-Paper Coding by Analog Modulo-Lattice Modulation † , 2009 .

[20]  C. A. Rogers Lattice coverings of space , 1959 .

[21]  Stephen P. Boyd,et al.  Analysis and optimization of randomized gossip algorithms , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[22]  Shlomo Shamai,et al.  Uplink Macro Diversity of Limited Backhaul Cellular Network , 2008, IEEE Transactions on Information Theory.

[23]  Syed Ali Jafar The Ergodic Capacity of Interference Networks , 2009, ArXiv.

[24]  Abbas El Gamal,et al.  Capacity theorems for the relay channel , 1979, IEEE Trans. Inf. Theory.

[25]  Rudolf Ahlswede,et al.  On source coding with side information via a multiple-access channel and related problems in multi-user information theory , 1983, IEEE Trans. Inf. Theory.

[26]  H.V. Poor,et al.  Ergodic two-user interference channels: Is separability optimal? , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[27]  Anand D. Sarwate,et al.  Broadcast Gossip Algorithms for Consensus , 2009, IEEE Transactions on Signal Processing.

[28]  Michael Gastpar,et al.  Compute-and-Forward: Harnessing Interference Through Structured Codes , 2009, IEEE Transactions on Information Theory.

[29]  Lizhong Zheng,et al.  Amplify-and-Forward in Wireless Relay Networks: Rate, Diversity, and Network Size , 2007, IEEE Transactions on Information Theory.

[30]  Toby Berger,et al.  An upper bound on the sum-rate distortion function and its corresponding rate allocation schemes for the CEO problem , 2004, IEEE Journal on Selected Areas in Communications.

[31]  N. Alon,et al.  The Probabilistic Method, Second Edition , 2000 .

[32]  Guy Bresler,et al.  3 User interference channel: Degrees of freedom as a function of channel diversity , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[33]  Shlomo Shamai,et al.  Information-theoretic implications of constrained cooperation in simple cellular models , 2008, 2008 IEEE 19th International Symposium on Personal, Indoor and Mobile Radio Communications.

[34]  Gerhard Kramer,et al.  A New Outer Bound and the Noisy-Interference Sum–Rate Capacity for Gaussian Interference Channels , 2007, IEEE Transactions on Information Theory.

[35]  Hirosuke Yamamoto,et al.  Wyner-Ziv theory for a general function of the correlated sources , 1982, IEEE Trans. Inf. Theory.

[36]  Rudolf Ahlswede,et al.  Multi-way communication channels , 1973 .

[37]  Shreyas Sundaram,et al.  Distributed consensus and linear functional calculation in networks: an observability perspective , 2007, IPSN.

[38]  H. Nyquist,et al.  Certain Topics in Telegraph Transmission Theory , 1928, Transactions of the American Institute of Electrical Engineers.

[39]  Yunnan Wu,et al.  Reducing repair traffic for erasure coding-based storage via interference alignment , 2009, 2009 IEEE International Symposium on Information Theory.

[40]  Elza Erkip,et al.  User cooperation diversity. Part I. System description , 2003, IEEE Trans. Commun..

[41]  Yasutada Oohama,et al.  The Rate-Distortion Function for the Quadratic Gaussian CEO Problem , 1998, IEEE Trans. Inf. Theory.

[42]  R. Zamir,et al.  On lattice quantization noise , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[43]  Gerhard Kramer,et al.  The multicast capacity of deterministic relay networks with no interference , 2006, IEEE Transactions on Information Theory.

[44]  Ron Dabora,et al.  On the Role of Estimate-and-Forward With Time Sharing in Cooperative Communication , 2006, IEEE Transactions on Information Theory.

[45]  Ruggero Carli,et al.  Average consensus on networks with quantized communication , 2009 .

[46]  Yuhong Yang Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[47]  Sriram Vishwanath,et al.  Communicating the Difference of Correlated Gaussian Sources over a MAC , 2009, 2009 Data Compression Conference.

[48]  Uri Erez,et al.  Achieving 1/2 log (1+SNR) on the AWGN channel with lattice encoding and decoding , 2004, IEEE Transactions on Information Theory.

[49]  Amir K. Khandani,et al.  Communication Over MIMO X Channels: Interference Alignment, Decomposition, and Performance Analysis , 2008, IEEE Transactions on Information Theory.

[50]  Masoud Salehi,et al.  Multiple access channels with arbitrarily correlated sources , 1980, IEEE Trans. Inf. Theory.

[51]  Uri Erez,et al.  Lattice Strategies for the Dirty Multiple Access Channel , 2007, IEEE Transactions on Information Theory.

[52]  K. Ramchandran,et al.  Distributed Beamforming using 1 Bit Feedback : from Concept to Realization , 2006 .

[53]  Sriram Vishwanath,et al.  On the secrecy rate of interference networks using structured codes , 2009, 2009 IEEE International Symposium on Information Theory.

[54]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .

[55]  Devavrat Shah,et al.  Information Dissemination via Gossip: Applications to Averaging and Coding , 2005 .

[56]  Michael Rabbat,et al.  Distributed Average Consensus using Probabilistic Quantization , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[57]  Tobias J. Oechtering,et al.  Broadcast Capacity Region of Two-Phase Bidirectional Relaying , 2007, IEEE Transactions on Information Theory.

[58]  Wei Kang,et al.  A Single-letter Upper Bound for the Sum Rate of Multiple Access Channels with Correlated Sources , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..

[59]  Michael Gastpar,et al.  The case for structured random codes in network capacity theorems , 2008, Eur. Trans. Telecommun..

[60]  Shlomo Shamai,et al.  Degrees of Freedom Region of the MIMO $X$ Channel , 2008, IEEE Transactions on Information Theory.

[61]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[62]  Panganamala Ramana Kumar,et al.  Computing and communicating functions over sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[63]  Shlomo Shamai,et al.  Systematic Lossy Source/Channel Coding , 1998, IEEE Trans. Inf. Theory.

[64]  Amir K. Khandani,et al.  Capacity bounds for the Gaussian Interference Channel , 2008, 2008 IEEE International Symposium on Information Theory.

[65]  M. Gastpar Uncoded transmission is exactly optimal for a simple Gaussian "sensor" network , 2007 .

[66]  R. Koetter,et al.  An algebraic approach to network coding , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[67]  D. R. Fulkerson,et al.  Maximal Flow Through a Network , 1956 .

[68]  Shlomo Shamai,et al.  Structured superposition for backhaul constrained cellular uplink , 2009, 2009 IEEE International Symposium on Information Theory.

[69]  Syed Ali Jafar,et al.  Interference Alignment and Spatial Degrees of Freedom for the K User Interference Channel , 2007, 2008 IEEE International Conference on Communications.

[70]  Tracey Ho,et al.  A Random Linear Network Coding Approach to Multicast , 2006, IEEE Transactions on Information Theory.

[71]  Sriram Vishwanath,et al.  Interference alignment at finite SNR: General message sets , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[72]  V. Cadambe,et al.  Interference alignment with asymmetric complex signaling , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[73]  R. Zamir Lattices are everywhere , 2009, 2009 Information Theory and Applications Workshop.

[74]  Alexandros G. Dimakis,et al.  Local interference can accelerate gossip algorithms , 2008, Allerton 2008.

[75]  Michael Gastpar,et al.  To code or not to code , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[76]  D. R. Fulkerson,et al.  Flows in Networks. , 1964 .

[77]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[78]  Syed Ali Jafar,et al.  Multiple Access Outerbounds and the Inseparability of Parallel Interference Channels , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[79]  Muriel Médard,et al.  XORs in the Air: Practical Wireless Network Coding , 2006, IEEE/ACM Transactions on Networking.

[80]  R. Zamir,et al.  A modulo-lattice transformation for multiple-access channels , 2008, 2008 IEEE 25th Convention of Electrical and Electronics Engineers in Israel.

[81]  Gerhard Fettweis,et al.  On backhaul-constrained multi-cell cooperative detection based on superposition coding , 2008, 2008 IEEE 19th International Symposium on Personal, Indoor and Mobile Radio Communications.

[82]  M. Alanyali,et al.  Distributed Detection in Sensor Networks With Packet Losses and Finite Capacity Links , 2006, IEEE Transactions on Signal Processing.

[83]  Shuo-Yen Robert Li,et al.  Linear network coding , 2003, IEEE Trans. Inf. Theory.

[84]  Thomas M. Cover,et al.  Comments on Broadcast Channels , 1998, IEEE Trans. Inf. Theory.

[85]  Zhen Zhang,et al.  On the CEO problem , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[86]  R. Ahlswede Group Codes do not Achieve Shannon's Channel Capacity for General Discrete Channels , 1971 .

[87]  Sanjay Shakkottai,et al.  On Network Coding for Interference Networks , 2006, 2006 IEEE International Symposium on Information Theory.

[88]  T. Berger,et al.  The quadratic Gaussian CEO problem , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.

[89]  Aylin Yener,et al.  Providing Secrecy With Structured Codes: Tools and Applications to Two-User Gaussian Channels , 2009, ArXiv.

[90]  Gregory W. Wornell,et al.  Cooperative diversity in wireless networks: Efficient protocols and outage behavior , 2004, IEEE Transactions on Information Theory.

[91]  Toby Berger,et al.  Coding for noisy channels with input-dependent insertions , 1977, IEEE Trans. Inf. Theory.

[92]  Michael Gastpar,et al.  On the capacity of wireless networks: the relay case , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[93]  Gregory Poltyrev,et al.  On coding without restrictions for the AWGN channel , 1993, IEEE Trans. Inf. Theory.

[94]  Michael Gastpar,et al.  Computation Over Multiple-Access Channels , 2007, IEEE Transactions on Information Theory.

[95]  Ayfer Özgür,et al.  Achieving linear scaling with interference alignment , 2009, 2009 IEEE International Symposium on Information Theory.

[96]  Shlomo Shamai,et al.  Capacity of channels with uncoded side information , 1995, Eur. Trans. Telecommun..

[97]  Wen J. Li,et al.  Location-Aided Fast Distributed Consensus , 2007, ArXiv.

[98]  Robert D. Nowak,et al.  Decentralized compression and predistribution via randomized gossiping , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[99]  Devavrat Shah,et al.  Distributed Functional Compression through Graph Coloring , 2007, 2007 Data Compression Conference (DCC'07).

[100]  Vinod M. Prabhakaran,et al.  Harnessing bursty interference , 2009, 2009 IEEE Information Theory Workshop on Networking and Information Theory.

[101]  Shlomo Shamai,et al.  A layered lattice coding scheme for a class of three user Gaussian interference channels , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[102]  Shlomo Shamai,et al.  On the capacity of some channels with channel state information , 1999, IEEE Trans. Inf. Theory.

[103]  Thomas M. Cover,et al.  A Proof of the Data Compression Theorem of Slepian and Wolf for Ergodic Sources , 1971 .

[104]  Peter Elias,et al.  A note on the maximum flow through a network , 1956, IRE Trans. Inf. Theory.

[105]  Sae-Young Chung,et al.  Capacity of a class of multi-source relay networks , 2009, 2009 Information Theory and Applications Workshop.

[106]  Wei Yu,et al.  Capacity of a Class of Modulo-Sum Relay Channels , 2007, IEEE Transactions on Information Theory.

[107]  Alexander Sprintson,et al.  Joint Physical Layer Coding and Network Coding for Bidirectional Relaying , 2008, IEEE Transactions on Information Theory.

[108]  Prakash Ishwar,et al.  Distributed Source Coding for Interactive Function Computation , 2008 .

[109]  Martin J. Wainwright,et al.  Network-Based Consensus Averaging With General Noisy Channels , 2008, IEEE Transactions on Signal Processing.

[110]  Alon Orlitsky,et al.  Coding for computing , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[111]  Sae-Young Chung,et al.  Nested Lattice Codes for Gaussian Relay Networks With Interference , 2011, IEEE Transactions on Information Theory.

[112]  S. Sandeep Pradhan,et al.  A proof of the existence of good nested lattices , 2007 .

[113]  Michael Gastpar,et al.  Source-Channel Communication in Sensor Networks , 2003, IPSN.

[114]  Michelle Effros,et al.  Functional Source Coding for Networks with Receiver Side Information ∗ , 2004 .

[115]  Simon Litsyn,et al.  Lattices which are good for (almost) everything , 2005, IEEE Transactions on Information Theory.

[116]  Emre Telatar,et al.  Capacity of Multi-antenna Gaussian Channels , 1999, Eur. Trans. Telecommun..

[117]  János Körner,et al.  How to encode the modulo-two sum of binary sources (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[118]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .

[119]  Te Sun Han,et al.  A new achievable rate region for the interference channel , 1981, IEEE Trans. Inf. Theory.

[120]  Panganamala Ramana Kumar,et al.  A cautionary perspective on cross-layer design , 2005, IEEE Wireless Communications.

[121]  Sachin Katti,et al.  Embracing wireless interference: analog network coding , 2007, SIGCOMM.

[122]  R. Dobrushin Asymptotic Optimality of Group and Systematic Codes for Some Channels , 1963 .

[123]  Ashutosh Sabharwal,et al.  Building a Cooperative Communications System , 2007, ArXiv.

[124]  Michael Gastpar,et al.  Cooperative strategies and capacity theorems for relay networks , 2005, IEEE Transactions on Information Theory.

[125]  Michael Gastpar,et al.  MIMO compute-and-forward , 2009, 2009 IEEE International Symposium on Information Theory.

[126]  Hua Wang,et al.  Gaussian Interference Channel Capacity to Within One Bit , 2007, IEEE Transactions on Information Theory.

[127]  H. Vincent Poor,et al.  Collaborative beamforming for distributed wireless ad hoc sensor networks , 2005, IEEE Transactions on Signal Processing.

[128]  Abbas El Gamal,et al.  Relay Networks With Delays , 2007, IEEE Transactions on Information Theory.

[129]  A. Dimakis,et al.  Geographic gossip: efficient aggregation for sensor networks , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[130]  R. Gallager Information Theory and Reliable Communication , 1968 .

[131]  Shlomo Shamai,et al.  Nested linear/Lattice codes for structured multiterminal binning , 2002, IEEE Trans. Inf. Theory.

[132]  R. Gallager,et al.  The Gaussian parallel relay network , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[133]  Aaron D. Wyner,et al.  Shannon-theoretic approach to a Gaussian cellular multiple-access channel , 1994, IEEE Trans. Inf. Theory.

[134]  Young-Han Kim,et al.  Capacity of a Class of Deterministic Relay Channels , 2006, 2007 IEEE International Symposium on Information Theory.

[135]  Mischa Dohler,et al.  2-hop distributed MIMO communication system , 2003 .

[136]  Soung Chang Liew,et al.  Hot topic: physical-layer network coding , 2006, MobiCom '06.

[137]  Robert D. Nowak,et al.  Matched source-channel communication for field estimation in wireless sensor network , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[138]  S.S. Pradhan,et al.  Distributed source coding using Abelian group codes: Extracting performance from structure , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[139]  Philippe Flajolet,et al.  Probabilistic Counting Algorithms for Data Base Applications , 1985, J. Comput. Syst. Sci..

[140]  M. Franceschetti,et al.  Network coding for computing , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[141]  Ayfer Özgür,et al.  Hierarchical Cooperation Achieves Optimal Capacity Scaling in Ad Hoc Networks , 2006, IEEE Transactions on Information Theory.

[142]  S. Sandeep Pradhan,et al.  Lattices for Distributed Source Coding: Jointly Gaussian Sources and Reconstruction of a Linear Function , 2007, AAECC.

[143]  Michael Gastpar,et al.  On the capacity of large Gaussian relay networks , 2005, IEEE Transactions on Information Theory.

[144]  Vinod M. Prabhakaran,et al.  Rate region of the quadratic Gaussian CEO problem , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[145]  Michael Gastpar,et al.  Lattice Coding Increases Multicast Rates for Gaussian Multiple-Access Networks , 2007 .

[146]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[147]  P. Chou,et al.  Low complexity algebraic multicast network codes , 2003, IEEE International Symposium on Information Theory, 2003. Proceedings..

[148]  Shlomo Shamai,et al.  Distributed MIMO Receiver—Achievable Rates and Upper Bounds , 2007, IEEE Transactions on Information Theory.

[149]  R. Koetter,et al.  Network coding from a network flow perspective , 2003, IEEE International Symposium on Information Theory, 2003. Proceedings..

[150]  John N. Tsitsiklis,et al.  On distributed averaging algorithms and quantization effects , 2007, 2008 47th IEEE Conference on Decision and Control.

[151]  Piyush Gupta,et al.  Information-theoretic bounds for multiround function computation in collocated networks , 2009, 2009 IEEE International Symposium on Information Theory.

[152]  Aydano B. Carleial,et al.  Interference channels , 1978, IEEE Trans. Inf. Theory.

[153]  Hiroshi Sato,et al.  The capacity of the Gaussian interference channel under strong interference , 1981, IEEE Trans. Inf. Theory.

[154]  Venugopal V. Veeravalli,et al.  Gaussian interference networks: sum capacity in the low-interference regime and new outer bounds on the capacity region , 2009, IEEE Trans. Inf. Theory.

[155]  Lang Tong,et al.  Type based estimation over multiaccess channels , 2006, IEEE Transactions on Signal Processing.

[156]  Alexandros G. Dimakis,et al.  Order-Optimal Consensus Through Randomized Path Averaging , 2010, IEEE Transactions on Information Theory.

[157]  Sae-Young Chung,et al.  Capacity Bounds for Two-Way Relay Channels , 2008, 2008 IEEE International Zurich Seminar on Communications.