Lossy Multicasting Over Binary Symmetric Broadcast Channels

Lossy multicasting of a set of independent, discrete-time, continuous-amplitude source components under the mean square error distortion measure over binary symmetric broadcast channels is investigated. The practically appealing concatenation of successive refinement source coding with broadcast coding and, specifically, time-sharing of linear binary codes, is considered. Three different system optimization criteria are formulated for the lossy multicasting problem. The resulting system optimization is fairly general and applies to a variety of combinations of successive refinement source codes and channel codes. The system optimization is investigated in depth for a class of channel optimized quantization with successive refinement, obtained by using standard embedded scalar quantizers and linear mapping of the (redundant) quantizer bitplanes onto channel codewords by using a systematic Raptor encoder. This scheme is referred to as quantization with linear index coding (QLIC). Unlike existing literature on progressive transmission with unequal error protection or channel optimized quantization, the focus here is on the regime of moderate-to-large code block length and the power of modern sparse-graph codes with iterative belief propagation decoding is leveraged. In this regime, the system optimization takes on the form of simple convex programming that reduces to linear programming for QLIC. The performance of QLIC compares favorably with respect to the state of the art channel optimized quantization in the conventional setting of a single Gaussian source over a binary symmetric channel. For the multicast scenario, the performance gap incurred by the practical QLIC design with respect to ideal source and channel codes is quantified.

[1]  Vladimir Cuperman,et al.  Joint source and channel coding using a non-linear receiver , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[2]  Nariman Farvardin,et al.  Optimal block cosine transform image coding for noisy channels , 1990, IEEE Trans. Commun..

[3]  Robert F. H. Fischer,et al.  Multilevel codes: Theoretical concepts and practical design rules , 1999, IEEE Trans. Inf. Theory.

[4]  Joachim Hagenauer Source-controlled channel decoding , 1995, IEEE Trans. Commun..

[5]  Patrick P. Bergmans,et al.  Random coding theorem for broadcast channels with degraded components , 1973, IEEE Trans. Inf. Theory.

[6]  Nariman Farvardin,et al.  On the performance and complexity of channel-optimized vector quantizers , 1991, IEEE Trans. Inf. Theory.

[7]  S. Verdú,et al.  Noiseless Data Compression with Low-Density Parity-Check Codes , 2003, Advances in Network Information Theory.

[8]  Rüdiger L. Urbanke,et al.  Modern Coding Theory , 2008 .

[9]  Giuseppe Caire,et al.  A Flexible Multiple Description Coding Scheme Based on Rateless Codes , 2010, 2010 Data Compression Conference.

[10]  Hamid Jafarkhani,et al.  Design of channel optimized vector quantizers in the presence of channel mismatch , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[11]  Shlomo Shamai,et al.  A broadcast strategy for the Gaussian slowly fading channel , 1997, Proceedings of IEEE International Symposium on Information Theory.

[12]  A. Alwan,et al.  A perceptually based embedded subband speech coder , 1997, IEEE Trans. Speech Audio Process..

[13]  H. Vincent Poor,et al.  Joint Source-Channel Coding at the Application Layer , 2009, 2009 Data Compression Conference.

[14]  Jacob Ziv,et al.  On universal quantization , 1985, IEEE Trans. Inf. Theory.

[15]  Michelle Effros,et al.  Multiresolution vector quantization , 2004, IEEE Transactions on Information Theory.

[16]  Dariush Divsalar,et al.  Joint source-channel coding for deep space image transmission using rateless codes , 2011, 2011 Information Theory and Applications Workshop.

[17]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[18]  Herbert Gish,et al.  Asymptotically efficient quantizing , 1968, IEEE Trans. Inf. Theory.

[19]  Nariman Farvardin,et al.  Progressive transmission of images over memoryless noisy channels , 2000, IEEE Journal on Selected Areas in Communications.

[20]  Maria Fresia,et al.  Determination of Optimal Distortion-Based Protection in Progressive Image Transmission: A Heuristic Approach , 2007, IEEE Transactions on Image Processing.

[21]  Maria Fresia,et al.  Joint source-channel coding at the application layer for parallel Gaussian sources , 2009, 2009 IEEE International Symposium on Information Theory.

[22]  Stephan ten Brink,et al.  Extrinsic information transfer functions: model and erasure channel properties , 2004, IEEE Transactions on Information Theory.

[23]  Thomas R. Fischer,et al.  Robust image transmission using JPEG2000 and turbo-codes , 2000, IEEE Signal Processing Letters.

[24]  NARIMAN FARVARDIN,et al.  Optimal quantizer design for noisy channels: An approach to combined source - channel coding , 1987, IEEE Trans. Inf. Theory.

[25]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[26]  Dariush Divsalar,et al.  Joint Source-Channel Coding for Deep-Space Image Transmission , 2011 .

[27]  Suhas N. Diggavi,et al.  Approximate Characterizations for the Gaussian Source Broadcast Distortion Region , 2011, IEEE Transactions on Information Theory.

[28]  H. Vincent Poor,et al.  Lossy Joint Source-Channel Coding Using Raptor Codes , 2008, Int. J. Digit. Multim. Broadcast..

[29]  Masoud Salehi,et al.  Optimal quantization for finite-state channels , 1997, IEEE Trans. Inf. Theory.

[30]  Shlomo Shamai,et al.  Fountain codes for lossless data compression , 2003, Algebraic Coding Theory and Information Theory.

[31]  Teresa H. Y. Meng,et al.  Adaptive channel optimization of vector quantized data , 1993, [Proceedings] DCC `93: Data Compression Conference.

[32]  Zixiang Xiong,et al.  Fast algorithm for distortion-based error protection of embedded image codes , 2005, IEEE Transactions on Image Processing.

[33]  Maria Fresia,et al.  A Linear Encoding Approach to Index Assignment in Lossy Source-Channel Coding , 2010, IEEE Transactions on Information Theory.

[34]  David L. Neuhoff,et al.  Optimal binary index assignments for a class of equiprobable scalar and vector quantizers , 1995, IEEE Trans. Inf. Theory.

[35]  Joachim Hagenauer,et al.  Iterative decoding of binary block and convolutional codes , 1996, IEEE Trans. Inf. Theory.

[36]  Hamid Jafarkhani,et al.  Entropy-constrained successively refinable scalar quantization , 1997, Proceedings DCC '97. Data Compression Conference.

[37]  Toby Berger,et al.  All sources are nearly successively refinable , 2001, IEEE Trans. Inf. Theory.

[38]  William Equitz,et al.  Successive refinement of information , 1991, IEEE Trans. Inf. Theory.

[39]  Michael Gastpar,et al.  To code, or not to code: lossy source-channel communication revisited , 2003, IEEE Trans. Inf. Theory.

[40]  Aria Nosratinia,et al.  Source-channel rate allocation for progressive transmission of images , 2003, IEEE Trans. Commun..

[41]  Joachim Hagenauer,et al.  LOSSLESS TURBO SOURCE CODING WITH DECREMENTAL REDUNDANCY , 2004 .