A New Fast Algorithm for Finding Capacity of Discrete Memoryless Thresholding Channels

This paper proposes an efficient algorithm for finding the channel capacity of discrete memoryless thresholding channels (DMTCs) that are typically used in Pulse Amplitude Modulation (PAM). While there are efficient algorithms for determining capacity of a discrete memoryless channel (DMC), it is difficult to obtain the capacity of a DMTC. Unlike a typical DMC channel whose the capacity is a convex function of the input distribution, the capacity of a DMTC is a non-convex function of both the input distribution and decision thresholds. To resolve this problem, we propose an efficient algorithm for approximating the channel capacity of a DMTC using a novel modified k-means algorithm whose computational complexity is reduced by a factor of $ \frac{M}{\log M}$ over the standard k-means algorithm, where M relates to the precision resolution of the solution. Both theoretical and numerical results are provided to verify the proposed algorithm.

[1]  Richard E. Blahut,et al.  Computation of channel capacity and rate-distortion functions , 1972, IEEE Trans. Inf. Theory.

[2]  Rudolf Mathar,et al.  Threshold optimization for capacity-achieving discrete input one-bit output quantization , 2013, 2013 IEEE International Symposium on Information Theory.

[3]  Thinh Nguyen,et al.  On Closed Form Capacities of Discrete Memoryless Channels , 2018, 2018 IEEE 87th Vehicular Technology Conference (VTC Spring).

[4]  Inderjit S. Dhillon,et al.  Clustering with Bregman Divergences , 2005, J. Mach. Learn. Res..

[5]  Thinh Nguyen,et al.  On the Capacities of Discrete Memoryless Thresholding Channels , 2018, 2018 IEEE 87th Vehicular Technology Conference (VTC Spring).

[6]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[7]  Brian M. Kurkoski,et al.  Decoding LDPC codes with mutual information-maximizing lookup tables , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[8]  Brian M. Kurkoski,et al.  Low-complexity quantization of discrete memoryless channels , 2016, 2016 International Symposium on Information Theory and Its Applications (ISITA).

[9]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[10]  Brian M. Kurkoski,et al.  Quantization of Binary-Input Discrete Memoryless Channels , 2011, IEEE Transactions on Information Theory.