Rate Adaptation With Thompson Sampling in 802.11ac WLAN

Rate adaptation (RA) is an essential mechanism in 802.11 WLAN. In the latest 802.11ac protocol, there are two emerging problems that need to be addressed for the RA. First, 802.11ac supporting more rate selections requires more efforts to find the optimal rate. Finally, 802.11ac supports higher rate. The difference between optimal rate and non-optimal rate can be so great that non-optimal rate would severely deteriorate the throughput of the WLAN. In order to tackle these problems, we develop a novel RA algorithm termed rate adaptation with Thompson sampling (RATS) for stationary and non-stationary channel environments. In this algorithm, we first consider compacting the search space by removing some rates to accelerate the convergence of the algorithm. Moreover, inspired by multi-armed bandit problem, we design RA algorithm based on Thompson sampling. Simulation results demonstrate that the performance of the proposed RATS outperforms the existing method.

[1]  Shipra Agrawal,et al.  Further Optimal Regret Bounds for Thompson Sampling , 2012, AISTATS.

[2]  Shipra Agrawal,et al.  Analysis of Thompson Sampling for the Multi-armed Bandit Problem , 2011, COLT.

[3]  John C. Bicket,et al.  Bit-rate selection in wireless networks , 2005 .

[4]  Songwu Lu,et al.  MIMO rate adaptation in 802.11n wireless networks , 2010, MobiCom.

[5]  Alexandre Proutière,et al.  Optimal Rate Sampling in 802.11 systems , 2013, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[6]  Atilla Eryilmaz,et al.  Link Rate Selection using Constrained Thompson Sampling , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[7]  Kevin C. Almeroth,et al.  Joint rate and channel width adaptation for 802.11 MIMO wireless networks , 2013, 2013 IEEE International Conference on Sensing, Communications and Networking (SECON).

[8]  Deepak Agarwal,et al.  LASER: a scalable response prediction platform for online advertising , 2014, WSDM.

[9]  Leo Monteban,et al.  WaveLAN®-II: A high-performance wireless LAN for the unlicensed band , 1997, Bell Labs Technical Journal.

[10]  Edward W. Knightly,et al.  OAR: An Opportunistic Auto-Rate Media Access Protocol for Ad Hoc Networks , 2005, Wirel. Networks.

[11]  Kang G. Shin,et al.  Post-CCA and Reinforcement Learning Based Bandwidth Adaptation in 802.11ac Networks , 2018, IEEE Transactions on Mobile Computing.

[12]  Paramvir Bahl,et al.  A rate-adaptive MAC protocol for multi-Hop wireless networks , 2001, MobiCom '01.

[13]  Benjamin Van Roy,et al.  A Tutorial on Thompson Sampling , 2017, Found. Trends Mach. Learn..

[14]  R. Srikant,et al.  Low-Complexity, Low-Regret Link Rate Selection in Rapidly-Varying Wireless Channels , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[15]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.