Machine Learning in Radio Resource Scheduling

In access networks, the radio resource management is designed to deal with the system capacity maximization while the quality of service (QoS) requirements need be satisfied for different types of applications. In particular, the radio resource scheduling aims to allocate users' data packets in frequency domain at each predefined transmission time intervals (TTIs), time windows used to trigger the user requests and to respond them accordingly. At each TTI, the scheduling procedure is conducted based on a scheduling rule that aims to focus only on particular scheduling objective such as fairness, delay, packet loss, or throughput requirements. The purpose of this chapter is to formulate and solve an aggregate optimization problem that selects at each TTI the most convenient scheduling rule in order to maximize the satisfaction of all scheduling objectives concomitantly TTI-by-TTI. The use of reinforcement learning is proposed to solve such complex multi-objective optimization problem and to ease the decision making on which scheduling rule should be applied at each TTI.

[1]  Gabriel-Miro Muntean,et al.  A utility-based priority scheduling scheme for multimedia delivery over LTE networks , 2013, 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[2]  Hajo Bakker,et al.  Adaptive fairness control for a proportional fair LTE scheduler , 2010, 21st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.

[3]  Ness B. Shroff,et al.  Opportunistic transmission scheduling with resource-sharing constraints in wireless networks , 2001, IEEE J. Sel. Areas Commun..

[4]  Markus Rupp,et al.  Throughput Maximizing Multiuser Scheduling with Adjustable Fairness , 2011, 2011 IEEE International Conference on Communications (ICC).

[5]  Chung-Ju Chang,et al.  An Intelligent Priority Resource Allocation Scheme for LTE-A Downlink Systems , 2012, IEEE Wireless Communications Letters.

[6]  George Ghinea,et al.  360° Mulsemedia Experience over Next Generation Wireless Networks - A Reinforcement Learning Approach , 2018, 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).

[7]  Frida Eng,et al.  Streaming applications over HSDPA in mixed service scenarios , 2004, IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004.

[8]  Raymond Knopp,et al.  Multi-User Scheduling and Interference Coordination , 2011, LTE - The UMTS Long Term Evolution.

[9]  Wang Ying,et al.  A MC-GMR Scheduler for Shared Data Channel in 3GPP LTE System , 2006, IEEE Vehicular Technology Conference.

[10]  Karim Djouani,et al.  A Survey of Resource Management Toward 5G Radio Access Networks , 2016, IEEE Communications Surveys & Tutorials.

[11]  Jalel Ben-Othman,et al.  An enhanced two level scheduler to increase multimedia services performance in LTE networks , 2014, 2014 IEEE International Conference on Communications (ICC).

[12]  Jeroen Wigard,et al.  Dynamic Packet Scheduling for Traffic Mixes of Best Effort and VoIP Users in E-UTRAN Downlink , 2010, 2010 IEEE 71st Vehicular Technology Conference.

[13]  Giuseppe Piro,et al.  Downlink Packet Scheduling in LTE Cellular Networks: Key Design Issues and a Survey , 2013, IEEE Communications Surveys & Tutorials.

[14]  Ashwin Sampath,et al.  Downlink Scheduling for Multiclass Traffic in LTE , 2009, EURASIP J. Wirel. Commun. Netw..

[15]  Sijing Zhang,et al.  Scheduling policies based on dynamic throughput and fairness tradeoff control in LTE-A networks , 2014, 39th Annual IEEE Conference on Local Computer Networks.

[16]  Jianping Chen,et al.  Adaptive proportional fair parameterization based LTE scheduling using continuous actor-critic reinforcement learning , 2014, 2014 IEEE Global Communications Conference.

[17]  Quoc-Tuan Vien,et al.  A Hybrid Double-Threshold Based Cooperative Spectrum Sensing over Fading Channels , 2016, IEEE Transactions on Wireless Communications.

[18]  Sijing Zhang,et al.  Towards 5G: A Reinforcement Learning-Based Scheduling Solution for Data Traffic Management , 2018, IEEE Transactions on Network and Service Management.

[19]  Ramona Trestian,et al.  Seamless Multimedia Delivery Within a Heterogeneous Wireless Networks Environment: Are We There Yet? , 2018, IEEE Communications Surveys & Tutorials.

[20]  Giuseppe Caire,et al.  Radio Resource Management Considerations for 5G Millimeter Wave Backhaul and Access Networks , 2017, IEEE Communications Magazine.

[21]  Gabriel-Miro Muntean,et al.  On the impact of wireless network traffic location and access technology on mobile device energy consumption , 2012, 37th Annual IEEE Conference on Local Computer Networks.

[22]  Sijing Zhang,et al.  Multi Objective Resource Scheduling in LTE Networks Using Reinforcement Learning , 2012, Int. J. Distributed Syst. Technol..

[23]  Cyril Leung,et al.  Resource Allocation in an LTE Cellular Communication System , 2009, 2009 IEEE International Conference on Communications.

[24]  Jeffrey G. Andrews,et al.  What Will 5G Be? , 2014, IEEE Journal on Selected Areas in Communications.

[25]  Dimitri Ktenas,et al.  QoS-Driven Scheduling in 5G Radio Access Networks - A Reinforcement Learning Approach , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[26]  Gunther Auer,et al.  Opportunistic packet loss fair scheduling for delay-sensitive applications over LTE systems , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[27]  Frank Kelly,et al.  Charging and rate control for elastic traffic , 1997, Eur. Trans. Telecommun..

[28]  Gabriel-Miro Muntean,et al.  Signal Strength-based Adaptive Multimedia Delivery Mechanism , 2009, 2009 IEEE 34th Conference on Local Computer Networks.

[29]  Hong Ji,et al.  Heterogeneous traffic scheduling in downlink high speed railway LTE systems , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[30]  Sueng Jae Bae,et al.  Delay-aware packet scheduling algorithm for multiple traffic classes in 3GPP LTE system , 2011, The 17th Asia Pacific Conference on Communications.

[31]  Raj Jain,et al.  A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems , 1998, ArXiv.

[32]  Quoc-Tuan Vien,et al.  On the coverage and power allocation for downlink in heterogeneous wireless cellular networks , 2015, 2015 IEEE International Conference on Communications (ICC).