Integrating Sub-6 GHz and Millimeter Wave to Combat Blockage: Delay-Optimal Scheduling

Millimeter wave (mmWave) technologies have the potential to achieve very high data rates, but suffer from intermittent connectivity. In this paper, we provision an architecture to integrate sub-6 GHz and mmWave technologies, where we incorporate the sub-6 GHz interface as a fallback data transfer mechanism to combat blockage and intermittent connectivity of the mmWave communications. To this end, we investigate the problem of scheduling data packets across the mmWave and sub-6 GHz interfaces such that the average delay of system is minimized. This problem can be formulated as Markov Decision Process. We first investigate the problem of discounted delay minimization, and prove that the optimal policy is of the threshold-type, i.e., data packets should always be routed to the mmWave interface as long as the number of packets in the system is smaller than a threshold. Then, we show that the results of the discounted delay problem hold for the average delay problem as well. Through numerical results, we demonstrate that under heavy traffic, integrating sub-6 GHz with mmWave can reduce the average delay by up to 70%. Further, our scheduling policy substantially reduces the delay over the celebrated MaxWeight policy.

[1]  Ness B. Shroff,et al.  Energy-Efficient Power and Bandwidth Allocation in an Integrated Sub-6 GHz - Millimeter Wave System , 2017, ArXiv.

[2]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[3]  Jean Walrand,et al.  A note on optimal control of a queuing system with two heterogeneous servers , 1984 .

[4]  Takeshi Manabe,et al.  Estimation of propagation-path visibility for indoor wireless LAN systems under shadowing condition by human bodies , 1998, VTC '98. 48th IEEE Vehicular Technology Conference. Pathway to Global Wireless Revolution (Cat. No.98CH36151).

[5]  Ashok K. Agrawala,et al.  Control of a Heterogeneous Two-Server Exponential Queueing System , 1983, IEEE Transactions on Software Engineering.

[6]  Jörg Widmer,et al.  Steering with eyes closed: Mm-Wave beam steering without in-band measurement , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[7]  Anthony Ephremides,et al.  Extension of the optimality of the threshold policy in heterogeneous multiserver queueing systems , 1988 .

[8]  Ness B. Shroff,et al.  Out-of-Band Millimeter Wave Beamforming and Communications to Achieve Low Latency and High Energy Efficiency in 5G Systems , 2018, IEEE Transactions on Communications.

[9]  P. R. Kumar,et al.  Optimal control of a queueing system with two heterogeneous servers , 1984 .

[10]  Jeffrey P. Kharoufeh,et al.  OPTIMAL CONTROL OF A TWO-SERVER QUEUEING SYSTEM WITH FAILURES , 2014, Probability in the Engineering and Informational Sciences.

[11]  Leandros Tassiulas,et al.  Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks , 1992 .

[12]  Sergey Andreev,et al.  Empirical Effects of Dynamic Human-Body Blockage in 60 GHz Communications , 2018, IEEE Communications Magazine.

[13]  G. Koole A simple proof of the optimality of a threshold policy in a two-server queueing system , 1995 .

[14]  Farooq Khan,et al.  mmWave mobile broadband (MMB): Unleashing the 3–300GHz spectrum , 2011, 34th IEEE Sarnoff Symposium.

[15]  Robert W. Heath,et al.  Estimating millimeter wave channels using out-of-band measurements , 2016, 2016 Information Theory and Applications Workshop (ITA).

[16]  Upamanyu Madhow,et al.  Millimeter Wave WPAN: Cross-Layer Modeling and Multi-Hop Architecture , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[17]  Upamanyu Madhow,et al.  Blockage and directivity in 60 GHz wireless personal area networks: from cross-layer model to multihop MAC design , 2009, IEEE Journal on Selected Areas in Communications.

[18]  V. V. Rykov Monotone Control of Queueing Systems with Heterogeneous Servers , 2001, Queueing Syst. Theory Appl..

[19]  G. E. Zein,et al.  Influence of the human activity on wide-band characteristics of the 60 GHz indoor radio channel , 2004, IEEE Transactions on Wireless Communications.

[20]  Ignas Niemegeers,et al.  Robust 60 GHz Indoor Connectivity: Is It Possible with Reflections? , 2010, 2010 IEEE 71st Vehicular Technology Conference.

[21]  Li Su,et al.  Blockage Robust and Efficient Scheduling for Directional mmWave WPANs , 2015, IEEE Transactions on Vehicular Technology.

[22]  S. Lippman Semi-Markov Decision Processes with Unbounded Rewards , 1973 .

[23]  Lujain Dabouba,et al.  Millimeter Wave Mobile Communication for 5 G Cellular , 2017 .

[24]  Theodore S. Rappaport,et al.  Millimeter Wave Mobile Communications for 5G Cellular: It Will Work! , 2013, IEEE Access.

[25]  Ness B. Shroff,et al.  Efficient Beam Alignment in Millimeter Wave Systems Using Contextual Bandits , 2017, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[26]  Parameswaran Ramanathan,et al.  60 GHz Indoor Networking through Flexible Beams: A Link-Level Profiling , 2015, SIGMETRICS 2015.

[27]  Kyu-Han Kim,et al.  WiFi-Assisted 60 GHz Wireless Networks , 2017, MobiCom.