Deep Quantization for MIMO Channel Estimation

Quantizers play a critical role in digital signal processing systems. In practice, quantizers are typically implemented using scalar analog-to-digital converters (ADCs), commonly utilizing a fixed uniform quantization rule which is ignorant of the task of the system. Recent works have shown that the performance of quantization systems utilizing scalar ADCs can be significantly improved by properly processing the analog signal prior to quantization. However, the implementation of such systems requires complete knowledge of the underlying model, which may not be available in practice. In this work we design task-oriented quantization systems with scalar ADCs using deep learning, focusing on the task of multiple-input multiple-output (MIMO) channel estimation. By utilizing deep learning, we construct a task-based quantization system, overcoming the need to explicitly recover the system model and to find the proper quantization rule for it. Our results indicate that the proposed method results in practical MIMO systems with scalar ADCs which are capable of approaching the optimal performance limits dictated by indirect rate-distortion theory, achievable using vector quantizers and requiring complete knowledge of the underlying statistical model.

[1]  Ran El-Yaniv,et al.  Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations , 2016, J. Mach. Learn. Res..

[2]  Robert W. Heath,et al.  Near Maximum-Likelihood Detector and Channel Estimator for Uplink Multiuser Massive MIMO Systems With One-Bit ADCs , 2015, IEEE Transactions on Communications.

[3]  Cheng Tao,et al.  Channel Estimation and Performance Analysis of One-Bit Massive MIMO Systems , 2016, IEEE Transactions on Signal Processing.

[4]  Toby Berger,et al.  Lossy Source Coding , 1998, IEEE Trans. Inf. Theory.

[5]  Robert M. Gray,et al.  Asymptotic Performance of Vector Quantizers with a Perceptual Distortion Measure , 1997, IEEE Trans. Inf. Theory.

[6]  Valero Laparra,et al.  End-to-end Optimized Image Compression , 2016, ICLR.

[7]  Robert W. Heath,et al.  Hybrid Architectures With Few-Bit ADC Receivers: Achievable Rates and Energy-Rate Tradeoffs , 2016, IEEE Transactions on Wireless Communications.

[8]  Yonina C. Eldar,et al.  Hardware-Limited Task-Based Quantization , 2018, 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[9]  Max Welling,et al.  Soft Weight-Sharing for Neural Network Compression , 2017, ICLR.

[10]  David Minnen,et al.  Full Resolution Image Compression with Recurrent Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Geoffrey C. Fox,et al.  Vector quantization by deterministic annealing , 1992, IEEE Trans. Inf. Theory.

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  Jack K. Wolf,et al.  Transmission of noisy information to a noisy receiver with minimum distortion , 1970, IEEE Trans. Inf. Theory.

[14]  David Minnen,et al.  Improved Lossy Image Compression with Priming and Spatially Adaptive Bit Rates for Recurrent Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.