Q-learning based collaborative cache allocation in mobile edge computing

Abstract The rapid development of  Augmented Reality (AR), Virtual Reality(VR), Internet of Things (IoT), and high-definition video has caught the attention of low latency and high bandwidth network requirements. For huge data transmission, cache technology has been regarded as an effective solution for reducing transmission time from users to remote clouds. However, the increasing variety of cached data has caused the challenge of cache performance. Based on high flexibility, scalability, and deployability of the characteristics of Software-Defined Networking (SDN), this study proposes a collaborative cache mechanism in multiple Remote Radio Heads (RRHs) to multiple Baseband Units (BBUs). In addition, the traditional rule-based and metaheuristics methods are difficult to consider all environmental factors. To reduce the traffic load of backhaul and transmission latency from the remote cloud, we use Q-learning to design the cache mechanism and propose an action selection strategy for the cache problem. Through reinforcement learning to find the appropriate cache state. The simulation results show that the proposed method can effectively improve the cache performance.

[1]  Min Chen,et al.  Wearable Affective Robot , 2018, IEEE Access.

[2]  M. Shamim Hossain,et al.  Edge-CoCaCo: Toward Joint Optimization of Computation, Caching, and Communication on Edge Cloud , 2018, IEEE Wireless Communications.

[3]  Majd Latah,et al.  Application of Artificial Intelligence to Software Defined Networking A Survey , 2016 .

[4]  Rajkumar Buyya,et al.  Next generation cloud computing: New trends and research directions , 2017, Future Gener. Comput. Syst..

[5]  Wei Li,et al.  A Dynamic Service Migration Mechanism in Edge Cognitive Computing , 2018, ACM Trans. Internet Techn..

[6]  Min Chen,et al.  Label-less Learning for Traffic Control in an Edge Network , 2018, IEEE Network.

[7]  Kezhi Wang,et al.  Joint Cache Content Placement and Task Offloading in C-RAN Enabled by Multi-Layer MEC , 2018, Sensors.

[8]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[9]  Chin-Feng Lai,et al.  Dynamic Resource Prediction and Allocation in C-RAN With Edge Artificial Intelligence , 2019, IEEE Transactions on Industrial Informatics.

[10]  L. Velasco,et al.  Meeting the requirements to deploy cloud RAN over optical networks , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[11]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[12]  Gary King,et al.  Logistic Regression in Rare Events Data , 2001, Political Analysis.

[13]  Yuefeng Ji,et al.  Baseband unit cloud interconnection enabled by flexible grid optical networks with software defined elasticity , 2015, IEEE Communications Magazine.

[14]  Yan Zhang,et al.  Mobile Edge Computing: A Survey , 2018, IEEE Internet of Things Journal.

[15]  Xing Zhang,et al.  Mobility-Aware Coded Probabilistic Caching Scheme for MEC-Enabled Small Cell Networks , 2017, IEEE Access.

[16]  Chin-Feng Lai,et al.  A SFC-based access point switching mechanism for Software-Defined Wireless Network in IoV , 2019, Future Gener. Comput. Syst..

[17]  Kostas E. Psannis,et al.  Secure integration of IoT and Cloud Computing , 2018, Future Gener. Comput. Syst..

[18]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[19]  Wei Li,et al.  Edge cognitive computing based smart healthcare system , 2018, Future Gener. Comput. Syst..

[20]  Chin-Feng Lai,et al.  A SDN-SFC-based service-oriented load balancing for the IoT applications , 2018, J. Netw. Comput. Appl..

[21]  Xiaofeng Tao,et al.  Mobile Edge Computing Enhanced Adaptive Bitrate Video Delivery With Joint Cache and Radio Resource Allocation , 2017, IEEE Access.

[22]  Min Chen,et al.  Narrow Band Internet of Things , 2017, IEEE Access.

[23]  Min Chen,et al.  Task Offloading for Mobile Edge Computing in Software Defined Ultra-Dense Network , 2018, IEEE Journal on Selected Areas in Communications.

[24]  Reza Malekian,et al.  Software defined wireless sensor networks application opportunities for efficient network management: A survey , 2017, Comput. Electr. Eng..

[25]  Kenichi Tsuchida,et al.  GPGPU-Based High Performance Parallel Computation Method for Valve Body Failure Mode , 2016 .