Caching-at-STARS: the Next Generation Edge Caching

A simultaneously transmitting and reflecting surface (STARS) enabled edge caching system is proposed for reducing backhaul traffic and ensuring the quality of service. A novel Caching-at-STARS structure, where a dedicated smart controller and cache memory are installed at the STARS, is proposed to satisfy user demands with fewer hops and desired channel conditions. Then, a joint caching replacement and information-centric hybrid beamforming optimization problem is formulated for minimizing the network power consumption. As long-term decision processes, the optimization problems based on independent and coupled phase-shift models of Caching-at-STARS contain both continuous and discrete decision variables, and are suitable for solving with deep reinforcement learning (DRL) algorithm. For the independent phase-shift Caching-at-STARS model, we develop a frequency-aware based twin delayed deep deterministic policy gradient (FA-TD3) algorithm that leverages user historical request information to serialize high-dimensional caching replacement decision variables. For the coupled phase-shift Caching-at-STARS model, we conceive a cooperative TD3 \&deep-Q network (TD3-DQN) algorithm comprised of FA-TD3 and DQN agents to decide on continuous and discrete variables respectively by observing the network external and internal environment. The numerical results demonstrate that: 1) The Caching-at-STARS-enabled edge caching system has advantages over traditional edge caching, especially in scenarios where Zipf skewness factors or cache capacity is large; 2) Caching-at-STARS outperforms the RIS-assisted edge caching systems; 3) The proposed FA-TD3 and cooperative TD3-DQN algorithms are superior in reducing network power consumption than conventional TD3.

[1]  D. Yuan,et al.  Learning-Based Hierarchical Edge Caching for Cloud-Aided Heterogeneous Networks , 2023, IEEE Transactions on Wireless Communications.

[2]  Youlong Luo,et al.  A Federated Learning-Based Edge Caching Approach for Mobile Edge Computing-Enabled Intelligent Connected Vehicles , 2023, IEEE Transactions on Intelligent Transportation Systems.

[3]  Keshav Sood,et al.  Efficient Federated DRL-Based Cooperative Caching for Mobile Edge Networks , 2023, IEEE Transactions on Network and Service Management.

[4]  Yuanwei Liu,et al.  STAR-RISs Assisted NOMA Networks: A Distributed Learning Approach , 2023, IEEE Journal of Selected Topics in Signal Processing.

[5]  Juan Luis Herrera,et al.  QoS-Aware Fog Node Placement for Intensive IoT Applications in SDN-Fog Scenarios , 2022, IEEE Internet of Things Journal.

[6]  A. Nallanathan,et al.  Joint Optimization of Caching Placement and Trajectory for UAV-D2D Networks , 2022, IEEE Transactions on Communications.

[7]  L. Hanzo,et al.  Hybrid Reinforcement Learning for STAR-RISs: A Coupled Phase-Shift Model Based Beamformer , 2022, IEEE Journal on Selected Areas in Communications.

[8]  Tony Q. S. Quek,et al.  Joint Content Caching, Recommendation, and Transmission Optimization for Next Generation Multiple Access Networks , 2022, IEEE Journal on Selected Areas in Communications.

[9]  Gabriel-Miro Muntean,et al.  A Transcoding-Enabled 360° VR Video Caching and Delivery Framework for Edge-Enhanced Next-Generation Wireless Networks , 2022, IEEE Journal on Selected Areas in Communications.

[10]  Lingyang Song,et al.  AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning? , 2022, IEEE Journal on Selected Areas in Communications.

[11]  Yuanwei Liu,et al.  Deep Learning for Latent Events Forecasting in Content Caching Networks , 2022, IEEE Transactions on Wireless Communications.

[12]  Tony Q. S. Quek,et al.  Exploiting Coding and Recommendation to Improve Cache Efficiency of Reliability-Aware Wireless Edge Caching Networks , 2021, IEEE Transactions on Wireless Communications.

[13]  L. Hanzo,et al.  NOMA-Aided Joint Radar and Multicast-Unicast Communication Systems , 2021, IEEE Journal on Selected Areas in Communications.

[14]  D. Manjunath,et al.  Towards a Distributed Caching Service at the WiFi Edge Using Wi-Cache , 2021, IEEE Transactions on Network and Service Management.

[15]  Haibo Mei,et al.  Joint Trajectory-Task-Cache Optimization With Phase-Shift Design of RIS-Assisted UAV for MEC , 2021, IEEE Wireless Communications Letters.

[16]  H. Poor,et al.  STAR: Simultaneous Transmission and Reflection for 360° Coverage by Intelligent Surfaces , 2021, IEEE Wireless Communications.

[17]  Tony Q. S. Quek,et al.  A Hybrid DQN and Optimization Approach for Strategy and Resource Allocation in MEC Networks , 2021, IEEE Transactions on Wireless Communications.

[18]  Dusit Niyato,et al.  Deep Learning-Based Edge Caching in Fog Radio Access Networks , 2020, IEEE Transactions on Wireless Communications.

[19]  Ali Ghrayeb,et al.  Optimizing Age of Information Through Aerial Reconfigurable Intelligent Surfaces: A Deep Reinforcement Learning Approach , 2020, IEEE Transactions on Vehicular Technology.

[20]  Miaowen Wen,et al.  Exploiting Reconfigurable Intelligent Surfaces in Edge Caching: Joint Hybrid Beamforming and Content Placement Optimization , 2020, IEEE Transactions on Wireless Communications.

[21]  Yuanwei Liu,et al.  Multi-Agent Reinforcement Learning in NOMA-Aided UAV Networks for Cellular Offloading , 2020, IEEE Transactions on Wireless Communications.

[22]  N. Al-Dhahir,et al.  Reconfigurable Intelligent Surfaces: Principles and Opportunities , 2020, IEEE Communications Surveys & Tutorials.

[23]  Theofanis P. Raptis,et al.  Distributed Data Access in Industrial Edge Networks , 2020, IEEE Journal on Selected Areas in Communications.

[24]  Srinivas Shakkottai,et al.  Learning to Cache and Caching to Learn: Regret Analysis of Caching Algorithms , 2020, IEEE/ACM Transactions on Networking.

[25]  Meixia Tao,et al.  Content Caching and Delivery in MIMO Fog-RANs With Wireless Fronthaul at Small Cache Size , 2020, IEEE Wireless Communications Letters.

[26]  Liang Xiao,et al.  Deep Reinforcement Learning-Based Intelligent Reflecting Surface for Secure Wireless Communications , 2020, IEEE Transactions on Wireless Communications.

[27]  Yongming Huang,et al.  Coordinated Fronthaul Data Assignment and Multicast Beamforming for Cache-Enabled Wireless Networks , 2019, IEEE Wireless Communications Letters.

[28]  Lei Jiao,et al.  Learning Automata Based Q-Learning for Content Placement in Cooperative Caching , 2019, IEEE Transactions on Communications.

[29]  Chunxiao Jiang,et al.  Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks , 2019, IEEE Communications Surveys & Tutorials.

[30]  Yan Zhang,et al.  Cooperative Content Caching in 5G Networks with Mobile Edge Computing , 2018, IEEE Wireless Communications.

[31]  Shi Jin,et al.  Random caching based cooperative transmission in heterogeneous wireless networks , 2017, 2017 IEEE International Conference on Communications (ICC).

[32]  F. Richard Yu,et al.  A Survey of Green Information-Centric Networking: Research Issues and Challenges , 2015, IEEE Communications Surveys & Tutorials.

[33]  Abbas Mehrabi,et al.  Video Caching, Analytics, and Delivery at the Wireless Edge: A Survey and Future Directions , 2021, IEEE Communications Surveys & Tutorials.

[34]  C. Yuen,et al.  Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning , 2020, IEEE Journal on Selected Areas in Communications.