Understanding Operational 5G: A First Measurement Study on Its Coverage, Performance and Energy Consumption

5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. On the other hand, as 5G has been deployed for only a few months, it is unclear how well and whether 5G can eventually meet its prospects. In this paper, we demystify operational 5G networks through a first-of-its-kind cross-layer measurement study. Our measurement focuses on four major perspectives: (i) Physical layer signal quality, coverage and hand-off performance; (ii) End-to-end throughput and latency; (iii) Quality of experience of 5G's niche applications (e.g., 4K/5.7K panoramic video telephony); (iv) Energy consumption on smartphones. The results reveal that the 5G link itself can approach Gbps throughput, but legacy TCP leads to surprisingly low capacity utilization (< 32%), latency remains too high to support tactile applications and power consumption escalates to 2 - 3x over 4G. Our analysis suggests that the wireline paths, upper-layer protocols, computing and radio hardware architecture need to co-evolve with 5G to form an ecosystem, in order to fully unleash its potential.

[1]  Xinyu Zhang,et al.  POI360: Panoramic Mobile Video Telephony over LTE Cellular Networks , 2017, CoNEXT.

[2]  Marco Sousa,et al.  Tracking Down High Interference and Low Coverage in 3G/4G Radio Networks Using Automatic RF Measurement Extraction , 2016, ICETE.

[3]  ZhouYuanyuan,et al.  An in-depth study of LTE , 2013 .

[4]  Swarun Kumar,et al.  LTE radio analytics made easy and accessible , 2014 .

[5]  Christian Bonnet,et al.  OpenAirInterface: A Flexible Platform for 5G Research , 2014, CCRV.

[6]  Larry L. Peterson,et al.  TCP Vegas: new techniques for congestion detection and avoidance , 1994 .

[7]  Lili Qiu,et al.  Jigsaw: Robust Live 4K Video Streaming , 2019, MobiCom.

[8]  Songwu Lu,et al.  Instability in Distributed Mobility Management: Revisiting Configuration Management in 3G/4G Mobile Networks , 2016, SIGMETRICS.

[9]  Yu Liu,et al.  A First Look at Commercial 5G Performance on Smartphones , 2020, WWW.

[10]  Yong Li,et al.  System architecture and key technologies for 5G heterogeneous cloud radio access networks , 2015, IEEE Netw..

[11]  Manu Bansal,et al.  Detecting if LTE is the Bottleneck with BurstTracker , 2019, MobiCom.

[12]  Chin-Feng Lai,et al.  Integration of SDR and SDN for 5G , 2014, IEEE Access.

[13]  Sujit Dey,et al.  X-Array: approximating omnidirectional millimeter-wave coverage using an array of phased arrays , 2020, MobiCom.

[14]  Christos Bouras,et al.  SDN & NFV in 5G: Advancements and challenges , 2017, 2017 20th Conference on Innovations in Clouds, Internet and Networks (ICIN).

[15]  Donald F. Towsley,et al.  Part II: control theory for buffer sizing , 2005, CCRV.

[16]  Samuel B. Williams,et al.  Association for Computing Machinery , 2009 .

[17]  Xiufeng Xie,et al.  Learning to Coordinate Video Codec with Transport Protocol for Mobile Video Telephony , 2019, MobiCom.

[18]  Songwu Lu,et al.  Supporting Mobile VR in LTE Networks: How Close Are We? , 2018, SIGMETRICS.

[19]  Van Jacobson,et al.  BBR: Congestion-Based Congestion Control , 2016, ACM Queue.

[20]  Soung Chang Liew,et al.  TCP Veno: TCP enhancement for transmission over wireless access networks , 2003, IEEE J. Sel. Areas Commun..

[21]  Guido Appenzeller,et al.  Sizing router buffers , 2004, SIGCOMM '04.

[22]  Injong Rhee,et al.  CUBIC: a new TCP-friendly high-speed TCP variant , 2008, OPSR.

[23]  Injong Rhee,et al.  Understanding bufferbloat in cellular networks , 2012, CellNet '12.

[24]  Tao Wang,et al.  MobileInsight: Analyzing Cellular Network Information on Smartphones , 2017, GETMBL.

[25]  M. O. Vinogradov Tools for web developers , 2016 .

[26]  Junchen Jiang,et al.  Pano: optimizing 360° video streaming with a better understanding of quality perception , 2019, SIGCOMM.

[27]  Xu Zhang,et al.  E2E: embracing user heterogeneity to improve quality of experience on the web , 2019, SIGCOMM.

[28]  Li Wang,et al.  Fast Pairing of Device-to-Device Link Underlay for Spectrum Sharing With Cellular Users , 2014, IEEE Communications Letters.

[29]  Fa-Long Luo,et al.  5G Standard Development: Technology and Roadmap , 2016 .

[30]  Geoffrey Ye Li,et al.  An Overview of Massive MIMO: Benefits and Challenges , 2014, IEEE Journal of Selected Topics in Signal Processing.

[31]  Nikolajs Toropovs,et al.  Reflection and Transmission Properties of Common Construction Materials at 2.4 GHz Frequency , 2017 .

[32]  M. R. M. Rizk,et al.  Study of LTE-R X2 handover based on A3 event algorithm using MATLAB , 2015, 2015 International Conference on Information and Communication Technology Convergence (ICTC).

[33]  Xinyu Zhang,et al.  Accelerating Mobile Web Loading Using Cellular Link Information , 2017, MobiSys.

[34]  Xiqi Gao,et al.  Cellular architecture and key technologies for 5G wireless communication networks , 2014, IEEE Communications Magazine.

[35]  Li Li,et al.  A measurement study on multi-path TCP with multiple cellular carriers on high speed rails , 2018, SIGCOMM.

[36]  Navrati Saxena,et al.  Next Generation 5G Wireless Networks: A Comprehensive Survey , 2016, IEEE Communications Surveys & Tutorials.

[37]  Swarun Kumar,et al.  piStream: Physical Layer Informed Adaptive Video Streaming over LTE , 2015, MobiCom.

[38]  Karan Gupta,et al.  Offloading distributed applications onto smartNICs using iPipe , 2019, SIGCOMM.

[39]  Feng Qian,et al.  A First Measurement Study of Commercial mmWave 5G Performance on Smartphones , 2019, ArXiv.

[40]  J Gettys,et al.  Bufferbloat: Dark Buffers in the Internet , 2011, IEEE Internet Computing.

[41]  Xinyu Zhang,et al.  Facilitating Robust 60 GHz Network Deployment By Sensing Ambient Reflectors , 2017, NSDI.

[42]  Geoffrey Ye Li,et al.  Recent advances in energy-efficient networks and their application in 5G systems , 2015, IEEE Wireless Communications.

[43]  Feng Qian,et al.  An Active-Passive Measurement Study of TCP Performance over LTE on High-speed Rails , 2018, MobiCom.

[44]  Nick McKeown,et al.  Part I: buffer sizes for core routers , 2005, CCRV.

[45]  Songwu Lu,et al.  Control-plane protocol interactions in cellular networks , 2014, SIGCOMM.

[46]  Preben E. Mogensen,et al.  Path loss validation for urban micro cell scenarios at 3.5 GHz compared to 1.9 GHz , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[47]  Qi Zhang,et al.  Towards 5G Enabled Tactile Robotic Telesurgery , 2018, ArXiv.

[48]  Shichang Xu,et al.  Mobilyzer: An Open Platform for Controllable Mobile Network Measurements , 2015, MobiSys.

[49]  Lakshminarayanan Subramanian,et al.  Adaptive Congestion Control for Unpredictable Cellular Networks , 2015, Comput. Commun. Rev..

[50]  S. K. Patel,et al.  5G technology of mobile communication: A survey , 2013, 2013 International Conference on Intelligent Systems and Signal Processing (ISSP).

[51]  Lei Zhou,et al.  Performance Analysis of Power Saving Mechanism with Adjustable DRX Cycles in 3GPP LTE , 2008, 2008 IEEE 68th Vehicular Technology Conference.

[52]  Ke Liu,et al.  On Queue Length and Link Buffer Size Estimation in 3G/4G Mobile Data Networks , 2014, IEEE Transactions on Mobile Computing.

[53]  Ben Y. Zhao,et al.  Demystifying 60GHz outdoor picocells , 2014, MobiCom.

[54]  David D. Clark,et al.  The design philosophy of the DARPA internet protocols , 1988, SIGCOMM '88.

[55]  Suman Nath,et al.  WebPerf: Evaluating What-If Scenarios for Cloud-hosted Web Applications , 2016, SIGCOMM.

[56]  Mohammad Rostami,et al.  Braidio: An Integrated Active-Passive Radio for Mobile Devices with Asymmetric Energy Budgets , 2016, SIGCOMM.

[57]  Feng Qian,et al.  Understanding On-device Bufferbloat for Cellular Upload , 2016, Internet Measurement Conference.

[58]  Felix Wortmann,et al.  Internet of Things , 2015, Business & Information Systems Engineering.

[59]  Feng Qian,et al.  A close examination of performance and power characteristics of 4G LTE networks , 2012, MobiSys '12.

[60]  J. Wigard,et al.  On the User Performance of LTE UE Power Savings Schemes with Discontinuous Reception in LTE , 2009, 2009 IEEE International Conference on Communications Workshops.

[61]  Ning Ding,et al.  Characterizing and modeling the impact of wireless signal strength on smartphone battery drain , 2013, SIGMETRICS '13.

[62]  Feng Qian,et al.  An in-depth study of LTE: effect of network protocol and application behavior on performance , 2013, SIGCOMM.

[63]  Cheng-Xiang Wang,et al.  Spectral efficiency analysis of mobile Femtocell based cellular systems , 2011, 2011 IEEE 13th International Conference on Communication Technology.

[64]  Song Wang,et al.  Robot Navigation in Radio Beam Space: Leveraging Robotic Intelligence for Seamless mmWave Network Coverage , 2019, MobiHoc.