Soft-Decoding-Based Strategies for Relay and Interference Channels: Analysis and Achievable Rates Using LDPC Codes

We provide a rigorous mathematical analysis of two communication strategies: soft decode-and-forward (soft-DF) for relay channels and soft partial interference-cancelation (soft-IC) for interference channels. Both strategies involve soft estimation, which assists the decoding process. We consider LDPC codes, not because of their practical benefits, but because of their analytic tractability, which enables an asymptotic analysis similar to random coding methods of information theory. Unlike some works on the closely-related demodulate-and-forward, we assume non-memoryless, code-structure-aware estimation. With soft-DF, we develop simultaneous density evolution to bound the decoding error probability at the destination. This result applies to erasure relay channels. In one variant of soft-DF, the relay applies Wyner-Ziv coding to enhance its communication with the destination, borrowing from compress-and-forward. To analyze soft-IC, we adapt existing techniques for iterative multiuser detection, and focus on binary-input additive white Gaussian noise interference channels. We prove that optimal point-to-point codes are unsuitable for soft-IC, as well as for all strategies that apply partial decoding to improve upon single-user detection and multiuser detection, including Han-Kobayashi.

[1]  Giuseppe Caire,et al.  Iterative multiuser joint decoding: Unified framework and asymptotic analysis , 2002, IEEE Trans. Inf. Theory.

[2]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[3]  Young-Han Kim,et al.  Coding Techniques for Primitive Relay Channels , 2008 .

[4]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[5]  Te Sun Han,et al.  A new achievable rate region for the interference channel , 1981, IEEE Trans. Inf. Theory.

[6]  Rüdiger L. Urbanke,et al.  Parity-check density versus performance of binary linear block codes over memoryless symmetric channels , 2003, IEEE Transactions on Information Theory.

[7]  Rüdiger L. Urbanke,et al.  A rate-splitting approach to the Gaussian multiple-access channel , 1996, IEEE Trans. Inf. Theory.

[8]  Emre Telatar,et al.  Finite-length analysis of low-density parity-check codes on the binary erasure channel , 2002, IEEE Trans. Inf. Theory.

[9]  Axthonv G. Oettinger,et al.  IEEE Transactions on Information Theory , 1998 .

[10]  Hua Wang,et al.  Gaussian Interference Channel Capacity to Within One Bit , 2007, IEEE Transactions on Information Theory.

[11]  Jae Hong Lee,et al.  Multi-Stage Partial Parallel Interference Cancellation Receivers for Multi-Rate DS-CDMA System , 2003 .

[12]  Daniel A. Spielman,et al.  Efficient erasure correcting codes , 2001, IEEE Trans. Inf. Theory.

[13]  Jacobus H. van Lint,et al.  Coding Theory , 1971 .

[14]  Michael Gastpar,et al.  Compute-and-Forward: Harnessing Interference Through Structured Codes , 2009, IEEE Transactions on Information Theory.

[15]  Daniel A. Spielman,et al.  Improved low-density parity-check codes using irregular graphs and belief propagation , 1998, Proceedings. 1998 IEEE International Symposium on Information Theory (Cat. No.98CH36252).

[16]  Max H. M. Costa,et al.  The capacity region of the discrete memoryless interference channel with strong interference , 1987, IEEE Trans. Inf. Theory.

[17]  Chin-Liang Wang,et al.  An iterative multiuser receiver using partial parallel interference cancellation for turbo-coded DS-CDMA systems , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[18]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[19]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[20]  Robert Michael Tanner,et al.  A recursive approach to low complexity codes , 1981, IEEE Trans. Inf. Theory.

[21]  Uri Erez,et al.  Bounds on rates of LDPC codes for BEC with varying erasure rate , 2010, 2008 IEEE International Symposium on Information Theory.

[22]  Shlomo Shamai,et al.  The empirical distribution of good codes , 1997, IEEE Trans. Inf. Theory.

[23]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[24]  Giuseppe Caire,et al.  Successive interference cancellation with SISO decoding and EM channel estimation , 2001, IEEE Journal on Selected Areas in Communications.

[25]  S. Shamai,et al.  Bounds on the MMSE of “bad” LDPC codes at rates above capacity , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[26]  Rüdiger L. Urbanke,et al.  The capacity of low-density parity-check codes under message-passing decoding , 2001, IEEE Trans. Inf. Theory.

[27]  Muriel Médard,et al.  A Theory of Network Equivalence – Part II: Multiterminal Channels , 2014, IEEE Transactions on Information Theory.

[28]  Daniel Pérez Palomar,et al.  Representation of Mutual Information Via Input Estimates , 2007, IEEE Transactions on Information Theory.

[29]  Dariush Divsalar,et al.  Improved parallel interference cancellation for CDMA , 1998, IEEE Trans. Commun..

[30]  Claude E. Shannon,et al.  Two-way Communication Channels , 1961 .

[31]  Gerhard Kramer,et al.  Cooperative Communications , 2007, Found. Trends Netw..

[32]  David Burshtein,et al.  Bounds on the maximum-likelihood decoding error probability of low-density parity-check codes , 2000, IEEE Trans. Inf. Theory.

[33]  Shlomo Shamai,et al.  MMSE of “Bad” Codes , 2013, IEEE Transactions on Information Theory.

[34]  John M. Shea,et al.  Collaborative decoding in bandwidth-constrained environments , 2007, IEEE Journal on Selected Areas in Communications.

[35]  H. Vincent Poor,et al.  Iterative (turbo) soft interference cancellation and decoding for coded CDMA , 1999, IEEE Trans. Commun..

[36]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[37]  Alexander Sprintson,et al.  Joint Physical Layer Coding and Network Coding for Bidirectional Relaying , 2008, IEEE Transactions on Information Theory.

[38]  J. Nicholas Laneman,et al.  Cooperative diversity in wireless networks: algorithms and architectures , 2002 .

[39]  Sichao Yang,et al.  Network Coding over a Noisy Relay : a Belief Propagation Approach , 2007, 2007 IEEE International Symposium on Information Theory.

[40]  Alon Orlitsky,et al.  Stopping set distribution of LDPC code ensembles , 2003, IEEE Transactions on Information Theory.

[41]  Anders Høst-Madsen,et al.  Capacity bounds and power allocation for wireless relay channels , 2005, IEEE Transactions on Information Theory.

[42]  Andrea Montanari,et al.  The Generalized Area Theorem and Some of its Consequences , 2005, IEEE Transactions on Information Theory.

[43]  Guosen Yue,et al.  LDPC-coded cooperative relay systems: performance analysis and code design , 2008, IEEE Transactions on Communications.

[44]  Muriel Médard,et al.  A Theory of Network Equivalence— Part I: Point-to-Point Channels , 2011, IEEE Transactions on Information Theory.

[45]  Michael Gastpar,et al.  Compute-and-forward: Harnessing interference with structured codes , 2008, 2008 IEEE International Symposium on Information Theory.

[46]  Robert M. Gray,et al.  Coding for noisy channels , 2011 .

[47]  Ralf R. Müller,et al.  Iterative multiuser joint decoding: optimal power allocation and low-complexity implementation , 2004, IEEE Transactions on Information Theory.

[48]  Michael Gastpar,et al.  Cooperative strategies and capacity theorems for relay networks , 2005, IEEE Transactions on Information Theory.

[49]  David Burshtein,et al.  Asymptotic enumeration methods for analyzing LDPC codes , 2004, IEEE Transactions on Information Theory.

[50]  Abbas El Gamal,et al.  Capacity theorems for the relay channel , 1979, IEEE Trans. Inf. Theory.

[51]  Stephan ten Brink,et al.  Extrinsic information transfer functions: model and erasure channel properties , 2004, IEEE Transactions on Information Theory.

[52]  Ron Dabora,et al.  On the Role of Estimate-and-Forward With Time Sharing in Cooperative Communication , 2006, IEEE Transactions on Information Theory.

[53]  Branka Vucetic,et al.  Distributed Turbo Coding With Soft Information Relaying in Multihop Relay Networks , 2006, IEEE Journal on Selected Areas in Communications.

[54]  François Baccelli,et al.  Interference Networks With Point-to-Point Codes , 2011, IEEE Transactions on Information Theory.

[55]  Shlomo Shamai,et al.  Statistical Physics of Signal Estimation in Gaussian Noise: Theory and Examples of Phase Transitions , 2008, IEEE Transactions on Information Theory.

[56]  Shlomo Shamai,et al.  LDPC coded MIMO multiple access with iterative joint decoding , 2005, IEEE Transactions on Information Theory.

[57]  V.W.S. Chan,et al.  Principles of Digital Communication and Coding , 1979 .

[58]  Xin Li,et al.  Reliability exchange schemes for iterative packet combining in distributed arrays , 2003, 2003 IEEE Wireless Communications and Networking, 2003. WCNC 2003..

[59]  Luc Vandendorpe,et al.  Soft decode and forward improves cooperative communications , 2007, 1st IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2005..

[60]  David Declercq,et al.  Characterization and Optimization of LDPC Codes for the 2-User Gaussian Multiple Access Channel , 2007, EURASIP J. Wirel. Commun. Netw..

[61]  D. Burshtein,et al.  Upper bounds on the rate of LDPC codes , 2002, Proceedings IEEE International Symposium on Information Theory,.

[62]  G. David Forney,et al.  Modulation and Coding for Linear Gaussian Channels , 1998, IEEE Trans. Inf. Theory.

[63]  Somchai Jitapunkul,et al.  Iterative partial soft interference cancellation with MMSE multiuser detection for uplink turbo-coded MC-CDMA system , 2005, 3rd Annual Communication Networks and Services Research Conference (CNSR'05).

[64]  Shlomo Shamai,et al.  Capacity and lattice strategies for canceling known interference , 2005, IEEE Transactions on Information Theory.

[65]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[66]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[67]  Rüdiger L. Urbanke,et al.  Modern Coding Theory , 2008 .

[68]  Abdelaziz Amraoui,et al.  Achieving general points in the 2-user Gaussian MAC without time-sharing or rate-splitting by means of iterative coding , 2002, Proceedings IEEE International Symposium on Information Theory,.

[69]  Ram Zamir,et al.  The rate loss of single letter characterization for the “dirty” multiple access channel , 2008, 2008 IEEE Information Theory Workshop.

[70]  J. Nicholas Laneman,et al.  Noncoherent demodulation for cooperative diversity in wireless systems , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[71]  Vinod M. Prabhakaran,et al.  The Two-User Compound Interference Channel , 2009, IEEE Transactions on Information Theory.

[72]  S.A. Jafar,et al.  Optimizing Soft Information in Relay Networks , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[73]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[74]  Ram Zamir,et al.  On the Loss of Single-Letter Characterization: The Dirty Multiple Access Channel , 2009, IEEE Transactions on Information Theory.

[75]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[76]  John M. Shea,et al.  Collaborative decoding of a broadcast message in bandwidth-constrained environments , 2006 .

[77]  Rüdiger L. Urbanke,et al.  Design of capacity-approaching irregular low-density parity-check codes , 2001, IEEE Trans. Inf. Theory.

[78]  Shlomo Shamai,et al.  Information Theory On extrinsic information of good binary codes operating over Gaussian channels , 2007, Eur. Trans. Telecommun..

[79]  Gerhard Kramer,et al.  Outer bounds on the capacity of Gaussian interference channels , 2004, IEEE Transactions on Information Theory.

[80]  Tolga M. Duman,et al.  On the Performance of Low Density Parity Check Codes for Gaussian Interference Channels , 2013, ArXiv.