Towards Massive, Ultra-Reliable, and Low-Latency Wireless: The Art of Sending Short Packets

Most of the recent advances in the design of high-speed wireless systems are based on information-theoretic principles that demonstrate how to efficiently transmit long data packets. However, the upcoming 5G wireless systems will need to support novel traffic types that use short packets. For example, short packets represent the most common form of traffic generated by sensors and other devices involved in Machine-to-Machine (M2M) communications. Furthermore, there are emerging applications in which small packets are expected to carry critical information that should be received with low latency and ultra-high reliability. Current wireless systems are not designed to support short-packet transmissions. For example, the design of current systems rely on the assumption that the metadata (control information) is typically of negligible size compared to the actual information payload. Hence, although metadata is often transmitted using heuristic methods, this does not affect the overall system performance. When the packets are short, however, metadata may be of the same size as the payload, and the conventional methods to transmit it may be highly suboptimal. In this article, we review recent advances in information theory, which provide the theoretical principles that govern the transmission of short packets. We then apply these principles to three exemplary scenarios (the two-way channel, the downlink broadcast channel, and the uplink random access channel), thereby illustrating how the transmission of control information can be optimized when the packets are short. The insights brought by these examples suggest that new principles are needed for the design of wireless protocols supporting short packets. These principles will have a direct impact on the operations of the upcoming 5G systems.

[1]  Giuseppe Durisi,et al.  Diversity versus multiplexing at finite blocklength , 2014, 2014 11th International Symposium on Wireless Communications Systems (ISWCS).

[2]  David Tse,et al.  Fundamentals of Wireless Communication , 2005 .

[3]  Vincent Yan Fu Tan,et al.  The third-order term in the normal approximation for the AWGN channel , 2014, 2014 IEEE International Symposium on Information Theory.

[4]  Thomas L. Marzetta,et al.  Capacity of a Mobile Multiple-Antenna Communication Link in Rayleigh Flat Fading , 1999, IEEE Trans. Inf. Theory.

[5]  Hsuan-Yin Lin,et al.  Optimal Ultrasmall Block-Codes for Binary Discrete Memoryless Channels , 2013, IEEE Transactions on Information Theory.

[6]  M. Feder,et al.  Dispersion of infinite constellations in MIMO fading channels , 2012, 2012 IEEE 27th Convention of Electrical and Electronics Engineers in Israel.

[7]  Y F TanVincent Asymptotic Estimates in Information Theory with Non-Vanishing Error Probabilities , 2014 .

[8]  Romain Couillet,et al.  Bounds on the second-order coding rate of the MIMO Rayleigh block-fading channel , 2013, 2013 IEEE International Symposium on Information Theory.

[9]  Lizhong Zheng,et al.  Diversity and multiplexing: a fundamental tradeoff in multiple-antenna channels , 2003, IEEE Trans. Inf. Theory.

[10]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[11]  Giuseppe Caire,et al.  Finite-blocklength channel coding rate under a long-term power constraint , 2014, 2014 IEEE International Symposium on Information Theory.

[12]  Shlomo Shamai,et al.  Information theoretic considerations for cellular mobile radio , 1994 .

[13]  David Burshtein,et al.  Improved Bounds on the Finite Length Scaling of Polar Codes , 2013, IEEE Transactions on Information Theory.

[14]  Y.-P. Eric Wang,et al.  Radio access for ultra-reliable and low-latency 5G communications , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[15]  Sergio Verdú,et al.  Scalar coherent fading channel: Dispersion analysis , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[16]  Aggelos Bletsas,et al.  Noncoherent composite hypothesis testing receivers for extended range bistatic scatter radio WSNs , 2015, 2015 IEEE International Conference on Communications (ICC).

[17]  Giuseppe Durisi,et al.  Quasi-Static Multiple-Antenna Fading Channels at Finite Blocklength , 2013, IEEE Transactions on Information Theory.

[18]  Robert G. Gallager,et al.  Basic limits on protocol information in data communication networks , 1976, IEEE Trans. Inf. Theory.

[19]  Giuseppe Durisi,et al.  Diversity versus channel knowledge at finite block-length , 2012, 2012 IEEE Information Theory Workshop.

[20]  Shlomo Shamai,et al.  Fading Channels: Information-Theoretic and Communication Aspects , 1998, IEEE Trans. Inf. Theory.

[21]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[22]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[23]  J. Nicholas Laneman,et al.  Basic limits on protocol information in slotted communication networks , 2008, 2008 IEEE International Symposium on Information Theory.

[24]  Amiel Feinstein,et al.  Error bounds in noisy channels without memory , 1955, IRE Trans. Inf. Theory.

[25]  Emre Telatar,et al.  Capacity of Multi-antenna Gaussian Channels , 1999, Eur. Trans. Telecommun..

[26]  Lizhong Zheng,et al.  Communication on the Grassmann manifold: A geometric approach to the noncoherent multiple-antenna channel , 2002, IEEE Trans. Inf. Theory.

[27]  Taoka Hidekazu,et al.  Scenarios for 5G mobile and wireless communications: the vision of the METIS project , 2014, IEEE Communications Magazine.

[28]  Petar Popovski,et al.  Ultra-reliable communication in 5G wireless systems , 2014, 1st International Conference on 5G for Ubiquitous Connectivity.

[29]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[30]  P. Vijay Kumar,et al.  Explicit Space–Time Codes Achieving the Diversity–Multiplexing Gain Tradeoff , 2006, IEEE Transactions on Information Theory.

[31]  Michael Langberg,et al.  One-shot capacity of discrete channels , 2010, 2010 IEEE International Symposium on Information Theory.

[32]  Andrea J. Goldsmith,et al.  Generalizing Capacity: New Definitions and Capacity Theorems for Composite Channels , 2010, IEEE Transactions on Information Theory.

[33]  Robert W. Heath,et al.  Five disruptive technology directions for 5G , 2013, IEEE Communications Magazine.

[34]  Vincent Yan Fu Tan,et al.  Asymptotic Estimates in Information Theory with Non-Vanishing Error Probabilities , 2014, Found. Trends Commun. Inf. Theory.

[35]  Giuseppe Caire,et al.  Optimum Power Control at Finite Blocklength , 2014, IEEE Transactions on Information Theory.

[36]  Richard D. Wesel,et al.  Variable-Length Convolutional Coding for Short Blocklengths With Decision Feedback , 2014, IEEE Transactions on Communications.

[37]  H. Vincent Poor,et al.  Feedback in the Non-Asymptotic Regime , 2011, IEEE Transactions on Information Theory.

[38]  H. Vincent Poor,et al.  Channel coding: non-asymptotic fundamental limits , 2010 .

[39]  Behrooz Makki,et al.  Finite block-length analysis of spectrum sharing networks , 2015, 2015 IEEE International Conference on Communications (ICC).

[40]  Lizhong Zheng,et al.  The Diversity-Multiplexing Tradeoff for Non-Coherent Multiple Antenna Channels∗ , 2002 .

[41]  Shu Lin,et al.  Soft-decision decoding of linear block codes based on ordered statistics , 1994, IEEE Trans. Inf. Theory.

[42]  T. Richardson,et al.  Multi-Edge Type LDPC Codes , 2004 .

[43]  Behrooz Makki,et al.  Finite Block-Length Analysis of Spectrum Sharing Networks: Interference-Constrained Scenario , 2015, IEEE Wireless Communications Letters.

[44]  Alhussein A. Abouzeid,et al.  On the Cost of Knowledge of Mobility in Dynamic Networks: An Information-Theoretic Approach , 2012, IEEE Transactions on Mobile Computing.

[45]  Erik G. Ström,et al.  Finite-blocklength analysis of the ARQ-protocol throughput over the Gaussian collision channel , 2014, 2014 6th International Symposium on Communications, Control and Signal Processing (ISCCSP).

[46]  Rüdiger L. Urbanke,et al.  Finite-Length Scaling for Polar Codes , 2013, IEEE Transactions on Information Theory.

[47]  Daniel J. Costello,et al.  Low Latency Coding: Convolutional Codes vs. LDPC Codes , 2012, IEEE Transactions on Communications.

[48]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[49]  Dimitri P. Bertsekas,et al.  Data networks (2nd ed.) , 1992 .

[50]  Zoran Utkovski,et al.  Finite-SNR Bounds on the Sum-Rate Capacity of Rayleigh Block-Fading Multiple-Access Channels With No A Priori CSI , 2015, IEEE Transactions on Communications.

[51]  Hiroki Koga,et al.  Information-Spectrum Methods in Information Theory , 2002 .

[52]  Yury Polyanskiy,et al.  Orthogonal designs optimize achievable dispersion for coherent MISO channels , 2014, 2014 IEEE International Symposium on Information Theory.

[53]  Richard D. Wesel,et al.  Feedback Communication Systems with Limitations on Incremental Redundancy , 2013, ArXiv.

[54]  Alexander Vardy,et al.  List decoding of polar codes , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[55]  Anthony Ephremides,et al.  Information Theory and Communication Networks: An Unconsummated Union , 1998, IEEE Trans. Inf. Theory.

[56]  Siavash M. Alamouti,et al.  A simple transmit diversity technique for wireless communications , 1998, IEEE J. Sel. Areas Commun..

[57]  C. Shannon Probability of error for optimal codes in a Gaussian channel , 1959 .

[58]  Lizhong Zheng Diversity-Multiplexing Tradeo: A Comprehensive View of Multiple Antenna Systems , 2002 .

[59]  J. Nicholas Laneman,et al.  On the second-order coding rate of non-ergodic fading channels , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[60]  Giuseppe Caire,et al.  Optimum power control over fading channels , 1999, IEEE Trans. Inf. Theory.

[61]  Nihar Jindal,et al.  Transmit diversity vs. spatial multiplexing in modern MIMO systems , 2008, IEEE Transactions on Wireless Communications.

[62]  Stefan Parkvall,et al.  5G radio access , 2014 .

[63]  Aggelos Bletsas,et al.  Coherent Detection and Channel Coding for Bistatic Scatter Radio Sensor Networking , 2015, IEEE Trans. Commun..

[64]  Rüdiger L. Urbanke,et al.  Unified scaling of polar codes: Error exponent, scaling exponent, moderate deviations, and error floors , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[65]  Giuseppe Durisi,et al.  Short-Packet Communications Over Multiple-Antenna Rayleigh-Fading Channels , 2016, IEEE Transactions on Communications.

[66]  Giuseppe Durisi,et al.  Short-Packet Communications with Multiple Antennas: Transmit Diversity, Spatial Multiplexing, and Channel Estimation Overhead , 2014, ArXiv.