Towards Massive, Ultra-Reliable, and Low-Latency Wireless Communication with Short Packets

Most of the recent advances in the design of high-speed wireless systems are based on information-theoretic principles that demonstrate how to efficiently transmit long data packets. However, the upcoming wireless systems, notably the fifth-generation (5G) system, will need to support novel traffic types that use short packets. For example, short packets represent the most common form of traffic generated by sensors and other devices involved in machine-to-machine (M2M) communications. Furthermore, there are emerging applications in which small packets are expected to carry critical information that should be received with low latency and ultrahigh reliability. Current wireless systems are not designed to support short-packet transmissions. For example, the design of current systems relies on the assumption that the metadata (control information) is of negligible size compared to the actual information payload. Hence, transmitting metadata using heuristic methods does not affect the overall system performance. However, when the packets are short, metadata may be of the same size as the payload, and the conventional methods to transmit it may be highly suboptimal. In this paper, we review recent advances in information theory, which provide the theoretical principles that govern the transmission of short packets. We then apply these principles to three exemplary scenarios (the two-way channel, the downlink broadcast channel, and the uplink random access channel), thereby illustrating how the transmission of control information can be optimized when the packets are short. The insights brought by these examples suggest that new principles are needed for the design of wireless protocols supporting short packets. These principles will have a direct impact on the system design.

[1]  J. Nicholas Laneman,et al.  On the second-order coding rate of non-ergodic fading channels , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[2]  Giuseppe Durisi,et al.  Short-Packet Communications Over Multiple-Antenna Rayleigh-Fading Channels , 2016, IEEE Transactions on Communications.

[3]  Alexander Vardy,et al.  Algebraic soft-decision decoding of Reed-Solomon codes , 2003, IEEE Trans. Inf. Theory.

[4]  Y.-P. Eric Wang,et al.  Radio access for ultra-reliable and low-latency 5G communications , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[5]  H. Vincent Poor,et al.  Channel coding: non-asymptotic fundamental limits , 2010 .

[6]  Rüdiger L. Urbanke,et al.  Finite-Length Scaling for Polar Codes , 2013, IEEE Transactions on Information Theory.

[7]  Giuseppe Caire,et al.  Optimum power control over fading channels , 1999, IEEE Trans. Inf. Theory.

[8]  Aggelos Bletsas,et al.  Noncoherent composite hypothesis testing receivers for extended range bistatic scatter radio WSNs , 2015, 2015 IEEE International Conference on Communications (ICC).

[9]  Giuseppe Durisi,et al.  Quasi-Static Multiple-Antenna Fading Channels at Finite Blocklength , 2013, IEEE Transactions on Information Theory.

[10]  Romain Couillet,et al.  The Second-Order Coding Rate of the MIMO Quasi-Static Rayleigh Fading Channel , 2015, IEEE Transactions on Information Theory.

[11]  Robert G. Gallager,et al.  Basic limits on protocol information in data communication networks , 1976, IEEE Trans. Inf. Theory.

[12]  Giuseppe Durisi,et al.  Diversity versus channel knowledge at finite block-length , 2012, 2012 IEEE Information Theory Workshop.

[13]  Shlomo Shamai,et al.  Fading Channels: Information-Theoretic and Communication Aspects , 1998, IEEE Trans. Inf. Theory.

[14]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[15]  Dimitri P. Bertsekas,et al.  Data networks (2nd ed.) , 1992 .

[16]  Zoran Utkovski,et al.  Finite-SNR Bounds on the Sum-Rate Capacity of Rayleigh Block-Fading Multiple-Access Channels With No A Priori CSI , 2015, IEEE Transactions on Communications.

[17]  Taoka Hidekazu,et al.  Scenarios for 5G mobile and wireless communications: the vision of the METIS project , 2014, IEEE Communications Magazine.

[18]  Behrooz Makki,et al.  Finite block-length analysis of spectrum sharing networks , 2015, 2015 IEEE International Conference on Communications (ICC).

[19]  Richard D. Wesel,et al.  Feedback Communication Systems with Limitations on Incremental Redundancy , 2013, ArXiv.

[20]  Alexander Vardy,et al.  List decoding of polar codes , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[21]  David Tse,et al.  Fundamentals of Wireless Communication , 2005 .

[22]  Lizhong Zheng,et al.  The Diversity-Multiplexing Tradeoff for Non-Coherent Multiple Antenna Channels∗ , 2002 .

[23]  Aggelos Bletsas,et al.  Coherent Detection and Channel Coding for Bistatic Scatter Radio Sensor Networking , 2015, IEEE Transactions on Communications.

[24]  P. Vijay Kumar,et al.  Explicit Space–Time Codes Achieving the Diversity–Multiplexing Gain Tradeoff , 2006, IEEE Transactions on Information Theory.

[25]  Petar Popovski,et al.  Ultra-reliable communication in 5G wireless systems , 2014, 1st International Conference on 5G for Ubiquitous Connectivity.

[26]  T. Richardson,et al.  Multi-Edge Type LDPC Codes , 2004 .

[27]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[28]  Shlomo Shamai,et al.  Information theoretic considerations for cellular mobile radio , 1994 .

[29]  Alhussein A. Abouzeid,et al.  On the Cost of Knowledge of Mobility in Dynamic Networks: An Information-Theoretic Approach , 2012, IEEE Transactions on Mobile Computing.

[30]  J. Nicholas Laneman,et al.  Basic limits on protocol information in slotted communication networks , 2008, 2008 IEEE International Symposium on Information Theory.

[31]  Rüdiger L. Urbanke,et al.  Unified scaling of polar codes: Error exponent, scaling exponent, moderate deviations, and error floors , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[32]  Amiel Feinstein,et al.  Error bounds in noisy channels without memory , 1955, IRE Trans. Inf. Theory.

[33]  Thomas L. Marzetta,et al.  Capacity of a Mobile Multiple-Antenna Communication Link in Rayleigh Flat Fading , 1999, IEEE Trans. Inf. Theory.

[34]  Erik G. Ström,et al.  Finite-blocklength analysis of the ARQ-protocol throughput over the Gaussian collision channel , 2014, 2014 6th International Symposium on Communications, Control and Signal Processing (ISCCSP).

[35]  Gerald Matz,et al.  Fundamentals of Time-Varying Communication Channels , 2011 .

[36]  Michael Langberg,et al.  One-shot capacity of discrete channels , 2010, 2010 IEEE International Symposium on Information Theory.

[37]  Y.-P. Eric Wang,et al.  Analysis of ultra-reliable and low-latency 5G communication for a factory automation use case , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[38]  Andrea J. Goldsmith,et al.  Generalizing Capacity: New Definitions and Capacity Theorems for Composite Channels , 2010, IEEE Transactions on Information Theory.

[39]  Richard D. Wesel,et al.  Variable-Length Convolutional Coding for Short Blocklengths With Decision Feedback , 2014, IEEE Transactions on Communications.

[40]  Hsuan-Yin Lin,et al.  Optimal Ultrasmall Block-Codes for Binary Discrete Memoryless Channels , 2013, IEEE Transactions on Information Theory.

[41]  Giuseppe Durisi,et al.  Diversity versus multiplexing at finite blocklength , 2014, 2014 11th International Symposium on Wireless Communications Systems (ISWCS).

[42]  Vincent Yan Fu Tan,et al.  The third-order term in the normal approximation for the AWGN channel , 2014, 2014 IEEE International Symposium on Information Theory.

[43]  David Burshtein,et al.  Improved Bounds on the Finite Length Scaling of Polar Codes , 2013, IEEE Transactions on Information Theory.

[44]  Romain Couillet,et al.  Bounds on the second-order coding rate of the MIMO Rayleigh block-fading channel , 2013, 2013 IEEE International Symposium on Information Theory.

[45]  Lizhong Zheng,et al.  Diversity and multiplexing: a fundamental tradeoff in multiple-antenna channels , 2003, IEEE Trans. Inf. Theory.

[46]  Dariush Divsalar,et al.  Code Performance as a Function of Block Size , 1998 .

[47]  Shu Lin,et al.  Soft-decision decoding of linear block codes based on ordered statistics , 1994, IEEE Trans. Inf. Theory.

[48]  Sergio Verdú,et al.  Scalar coherent fading channel: Dispersion analysis , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[49]  M. Feder,et al.  Dispersion of infinite constellations in MIMO fading channels , 2012, 2012 IEEE 27th Convention of Electrical and Electronics Engineers in Israel.

[50]  Nihar Jindal,et al.  Transmit diversity vs. spatial multiplexing in modern MIMO systems , 2008, IEEE Transactions on Wireless Communications.

[51]  Stefan Parkvall,et al.  5G radio access , 2014 .

[52]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[53]  Sergio VerdÂ,et al.  Fading Channels: InformationTheoretic and Communications Aspects , 2000 .

[54]  Emre Telatar,et al.  Capacity of Multi-antenna Gaussian Channels , 1999, Eur. Trans. Telecommun..

[55]  Lizhong Zheng,et al.  Communication on the Grassmann manifold: A geometric approach to the noncoherent multiple-antenna channel , 2002, IEEE Trans. Inf. Theory.

[56]  Anthony Ephremides,et al.  Information Theory and Communication Networks: An Unconsummated Union , 1998, IEEE Trans. Inf. Theory.

[57]  Daniel J. Costello,et al.  Low Latency Coding: Convolutional Codes vs. LDPC Codes , 2012, IEEE Transactions on Communications.

[58]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[59]  Hiroki Koga,et al.  Information-Spectrum Methods in Information Theory , 2002 .

[60]  Yury Polyanskiy,et al.  Orthogonal designs optimize achievable dispersion for coherent MISO channels , 2014, 2014 IEEE International Symposium on Information Theory.

[61]  Siavash M. Alamouti,et al.  A simple transmit diversity technique for wireless communications , 1998, IEEE J. Sel. Areas Commun..

[62]  C. Shannon Probability of error for optimal codes in a Gaussian channel , 1959 .

[63]  Lizhong Zheng Diversity-Multiplexing Tradeo: A Comprehensive View of Multiple Antenna Systems , 2002 .

[64]  Giuseppe Caire,et al.  Finite-blocklength channel coding rate under a long-term power constraint , 2014, 2014 IEEE International Symposium on Information Theory.

[65]  Vincent Yan Fu Tan,et al.  Asymptotic Estimates in Information Theory with Non-Vanishing Error Probabilities , 2014, Found. Trends Commun. Inf. Theory.

[66]  Giuseppe Caire,et al.  Optimum Power Control at Finite Blocklength , 2014, IEEE Transactions on Information Theory.

[67]  H. Vincent Poor,et al.  Feedback in the Non-Asymptotic Regime , 2011, IEEE Transactions on Information Theory.

[68]  Robert W. Heath,et al.  Five disruptive technology directions for 5G , 2013, IEEE Communications Magazine.

[69]  Behrooz Makki,et al.  Finite Block-Length Analysis of Spectrum Sharing Networks: Interference-Constrained Scenario , 2015, IEEE Wireless Communications Letters.