QoS-Aware Joint Access Control and Duty Cycle Control for Machine-to-Machine Communications

Massive devices and various applications imposes new challenges for Machine-to-Machine (M2M) communications to enable Internet of Things (IoT). In this paper, we investigate a QoS-aware joint access control and duty cycle control problem for M2M communications to optimise the overall network performance, including energy efficiency, end-to-end delay, reliability, throughput and fairness. We first model a practical hybrid M2M communication network and measure the overall network performance through a cost function. Then, an optimisation problem is formulated to minimise the long-term aggregated network cost. Further more, we overcome the non-convexity of the cost function and mathematically derive the optimal access control. Finally, we propose a distributed access control followed by a reinforcement learning (RL) based duty cycle control which adapts to various network dynamics without priori network information. Simulation results show that, the proposed joint access control and duty cycle control minimise the network long-term aggregated cost, while achieving fairness among cluster heads with QoS differentiation.

[1]  Xiaoli Chu,et al.  Energy-Efficient Uplink Resource Allocation in LTE Networks With M2M/H2H Co-Existence Under Statistical QoS Guarantees , 2014, IEEE Transactions on Communications.

[2]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[3]  Zhenzhen Liu,et al.  RL-MAC: a reinforcement learning based MAC protocol for wireless sensor networks , 2006, Int. J. Sens. Networks.

[4]  Wei Xiang,et al.  Radio resource allocation in LTE-advanced cellular networks with M2M communications , 2012, IEEE Communications Magazine.

[5]  Wook Hyun Kwon,et al.  Throughput and energy consumption analysis of IEEE 802.15.4 slotted CSMA/CA , 2005 .

[6]  Guoliang Xing,et al.  Dynamic duty cycle control for end-to-end delay guarantees in wireless sensor networks , 2010, 2010 IEEE 18th International Workshop on Quality of Service (IWQoS).

[7]  Marimuthu Palaniswami,et al.  Handling inelastic traffic in wireless sensor networks , 2010, IEEE Journal on Selected Areas in Communications.

[8]  Dirk Pesch,et al.  Duty cycle learning algorithm (DCLA) for IEEE 802.15.4 beacon-enabled wireless sensor networks , 2012, Ad Hoc Networks.

[9]  Zhu Han,et al.  Distributed massive wireless access for cellular machine-to-machine communication , 2014, 2014 IEEE International Conference on Communications (ICC).

[10]  Jonathan Loo,et al.  Smart duty cycle control with reinforcement learning for machine to machine communications , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[11]  Junglok Yu,et al.  Adaptive Duty Cycle Control with Queue Management in Wireless Sensor Networks , 2013, IEEE Transactions on Mobile Computing.