Zero-delay source-channel coding

In this thesis, we investigate the zero-delay transmission of source samples over three di↵erent types of communication channel models. First, we consider the zero-delay transmission of a Gaussian source sample over an additive white Gaussian noise (AWGN) channel in the presence of an additive white Gaussian (AWG) interference, which is fully known by the transmitter. We propose three parameterized linear and non-linear transmission schemes for this scenario, and compare the corresponding mean square error (MSE) performances with that of a numerically optimized encoder, obtained using the necessary optimality conditions. Next, we consider the zero-delay transmission of a Gaussian source sample over an AWGN channel with a one-bit analog-to-digital (ADC) front end. We study this problem under two di↵erent performance criteria, namely the MSE distortion and the distortion outage probability (DOP), and obtain the optimal encoder and the decoder for both criteria. As generalizations of this scenario, we consider the performance with a K-level ADC front end as well as with multiple one-bit ADC front ends. We derive necessary conditions for the optimal encoder and decoder, which are then used to obtain numerically optimized encoder and decoder mappings. Finally, we consider the transmission of a Gaussian source sample over an AWGN channel with a one-bit ADC front end in the presence of correlated side information at the receiver. Again, we derive the necessary optimality conditions, and using these conditions obtain numerically optimized encoder and decoder mappings. We also consider the scenario in which the side information is available also at the encoder, and obtain the optimal encoder and decoder mappings. The performance of the latter scenario serves as a lower bound on the performance of the case in which the side information is available only at the decoder.

[1]  Erik G. Larsson,et al.  Optimal Modulation for Known Interference , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[2]  Deniz Gündüz,et al.  Joint Source–Channel Codes for MIMO Block-Fading Channels , 2007, IEEE Transactions on Information Theory.

[3]  T.A. Ramstad,et al.  Quantizer optimization in hybrid digital-analog transmission of analog source signals , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[4]  H. Miyakawa,et al.  Matched-Transmission Technique for Channels With Intersymbol Interference , 1972, IEEE Trans. Commun..

[5]  Sergio Verdú,et al.  Spectral efficiency in the wideband regime , 2002, IEEE Trans. Inf. Theory.

[6]  Robert H. Walden,et al.  Analog-to-digital converter survey and analysis , 1999, IEEE J. Sel. Areas Commun..

[7]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[8]  Josef A. Nossek,et al.  Analysis of Rayleigh-fading channels with 1-bit quantized output , 2008, 2008 IEEE International Symposium on Information Theory.

[9]  T.A. Ramstad,et al.  Power Constrained Channel Optimized Vector Quantizers used for Bandwidth Expansion , 2007, 2007 4th International Symposium on Wireless Communication Systems.

[10]  Michael Gastpar,et al.  To code, or not to code: lossy source-channel communication revisited , 2003, IEEE Trans. Inf. Theory.

[11]  Deniz Gündüz,et al.  Zero-delay joint source-channel coding , 2014, 2014 Iran Workshop on Communication and Information Theory (IWCIT).

[12]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[13]  Thomas M. Cover,et al.  Broadcast channels , 1972, IEEE Trans. Inf. Theory.

[14]  Deniz Gündüz,et al.  Joint source-channel coding with one-bit ADC front end , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[15]  Deniz Gündüz,et al.  Wyner–Ziv Coding Over Broadcast Channels: Digital Schemes , 2009, IEEE Transactions on Information Theory.

[16]  M. Tomlinson New automatic equaliser employing modulo arithmetic , 1971 .

[17]  Deniz Gündüz,et al.  Joint Source-Channel Coding With Time-Varying Channel and Side-Information , 2013, IEEE Transactions on Information Theory.

[18]  Mikael Skoglund,et al.  Hybrid Digital–Analog Source–Channel Coding for Bandwidth Compression/Expansion , 2006, IEEE Transactions on Information Theory.

[19]  Kyong-Hwa Lee,et al.  Optimal Linear Coding for Vector Channels , 1976, IEEE Trans. Commun..

[20]  Deniz Gündüz,et al.  Zero-delay joint source-channel coding in the presence of interference known at the encoder , 2015, 2015 IEEE International Conference on Communications (ICC).

[21]  Gerhard Fettweis,et al.  5G: Personal mobile internet beyond what cellular did to telephony , 2014, IEEE Communications Magazine.

[22]  Kenneth Rose,et al.  On Zero-Delay Source-Channel Coding , 2014, IEEE Transactions on Information Theory.

[23]  Robert W. Brodersen,et al.  An ultra-wideband transceiver architecture for low power, low rate, wireless systems , 2005, IEEE Transactions on Vehicular Technology.

[24]  Sae-Young Chung,et al.  On the construction of some capacity-approaching coding schemes , 2000 .

[25]  Amos Lapidoth,et al.  At Low SNR, Asymmetric Quantizers are Better , 2012, IEEE Transactions on Information Theory.

[26]  Reza Khosravi-Farsani,et al.  Achievable rate regions for Dirty Tape Channels and “joint writing on Dirty paper and Dirty Tape” , 2010, 2010 IEEE Information Theory Workshop.

[27]  Kenneth Rose,et al.  On Conditions for Linearity of Optimal Estimation , 2010, IEEE Transactions on Information Theory.

[28]  Aaron D. Wyner,et al.  Channels with Side Information at the Transmitter , 1993 .

[29]  Morteza Varasteh,et al.  Layered hybrid digital-analog coding with correlated interference , 2012, 2012 IEEE International Conference on Communications (ICC).

[30]  George L. Turin,et al.  The theory of optimum noise immunity , 1959 .

[31]  Ram Zamir,et al.  The Ziv–Zakai–Rényi Bound for Joint Source-Channel Coding , 2015, IEEE Transactions on Information Theory.

[32]  M. Gastpar Uncoded transmission is exactly optimal for a simple Gaussian "sensor" network , 2007 .

[33]  Morteza Varasteh,et al.  Optimal HDA Schemes for Transmission of a Gaussian Source Over a Gaussian Channel With Bandwidth Compression in the Presence of an Interference , 2012, IEEE Transactions on Signal Processing.

[34]  Marco Chiani,et al.  New exponential bounds and approximations for the computation of error probability in fading channels , 2003, IEEE Trans. Wirel. Commun..

[35]  Kenneth Rose,et al.  Robust vector quantizer design by noisy channel relaxation , 1999, IEEE Trans. Commun..

[36]  Shlomo Shamai,et al.  Fronthaul Compression for Cloud Radio Access Networks: Signal processing advances inspired by network information theory , 2014, IEEE Signal Processing Magazine.

[37]  Robert W. Heath,et al.  Capacity Analysis of One-Bit Quantized MIMO Systems With Transmitter Channel State Information , 2014, IEEE Transactions on Signal Processing.

[38]  Fady Alajaji,et al.  Low-Latency Source-Channel Coding for Fading Channels with Correlated Interference , 2014, IEEE Wireless Communications Letters.

[39]  Upamanyu Madhow,et al.  On the limits of communication with low-precision analog-to-digital conversion at the receiver , 2009, IEEE Transactions on Communications.

[40]  Jacob Ziv,et al.  On functionals satisfying a data-processing theorem , 1973, IEEE Trans. Inf. Theory.

[41]  Max H. M. Costa,et al.  Writing on dirty paper , 1983, IEEE Trans. Inf. Theory.

[42]  Mikael Skoglund,et al.  Optimized low-delay source-channel-relay mappings , 2010, IEEE Transactions on Communications.

[43]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[44]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[45]  Ertem Tuncel,et al.  Zero-delay joint source-channel coding for the Gaussian Wyner-Ziv problem , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[46]  Pascal O. Vontobel,et al.  A generalized Blahut-Arimoto algorithm , 2003, IEEE International Symposium on Information Theory, 2003. Proceedings..

[47]  Mikael Skoglund,et al.  Zero-Delay Joint Source-Channel Coding for a Bivariate Gaussian on a Gaussian MAC , 2012, IEEE Transactions on Communications.

[48]  Gerhard Fettweis,et al.  Fading channels with 1-bit output quantization: Optimal modulation, ergodic capacity and outage probability , 2010, 2010 IEEE Information Theory Workshop.

[49]  Kenneth Rose,et al.  Optimization of zero-delay mappings for distributed coding by deterministic annealing , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[50]  Deniz Gündüz,et al.  Designing intelligent energy harvesting communication systems , 2014, IEEE Communications Magazine.

[51]  Sven Jacobsson,et al.  One-bit massive MIMO: Channel estimation and high-order modulations , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[52]  Sueli I. Rodrigues Costa,et al.  Curves on a sphere, shift-map dynamics, and error control for continuous alphabet sources , 2003, IEEE Transactions on Information Theory.

[53]  Erik G. Larsson,et al.  Massive MIMO with 1-bit ADC , 2014, ArXiv.

[54]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[55]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[56]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[57]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[58]  Tamer Basar,et al.  Variations on the theme of the Witsenhausen counterexample , 2008, 2008 47th IEEE Conference on Decision and Control.

[59]  Josef A. Nossek,et al.  On Ultra-Wideband MIMO Systems with 1-bit Quantized Outputs: Performance Analysis and Input Optimization , 2007, 2007 IEEE International Symposium on Information Theory.

[60]  Tor A. Ramstad,et al.  Bandwidth compression for continuous amplitude channels based on vector approximation to a continuous subset of the source signal space , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[61]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[62]  Tor A. Ramstad,et al.  Shannon-kotel-nikov mappings in joint source-channel coding , 2009, IEEE Transactions on Communications.

[63]  Nam C. Phamdo,et al.  Hybrid digital-analog (HDA) joint source-channel codes for broadcasting and robust communications , 2002, IEEE Trans. Inf. Theory.

[64]  Frans M. J. Willems Signaling for the Gaussian channel with side information at the transmitter , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[65]  Warren J. Gross,et al.  A Chernoff-type Lower Bound for the Gaussian Q-function , 2012 .

[66]  Ertem Tuncel,et al.  Zero-Delay Joint Source-Channel Coding Using Hybrid Digital-Analog Schemes in the Wyner-Ziv Setting , 2014, IEEE Transactions on Communications.

[67]  Thomas J. Goblick,et al.  Theoretical limitations on the transmission of data from analog sources , 1965, IEEE Trans. Inf. Theory.

[68]  Kenneth Rose,et al.  Corrections to "robust vector quantizer design by noisy channel relaxation" , 2000, IEEE Trans. Commun..

[69]  Amos Lapidoth,et al.  Sending a bivariate Gaussian over a Gaussian MAC , 2010, IEEE Trans. Inf. Theory.

[70]  Shlomo Shamai,et al.  Capacity and lattice strategies for canceling known interference , 2005, IEEE Transactions on Information Theory.