Twin-Timescale Artificial Intelligence Aided Mobility-Aware Edge Caching and Computing in Vehicular Networks

In this paper, we propose a joint communication, caching and computing strategy for achieving cost efficiency in vehicular networks. In particular, the resource allocation policy is specifically designed by considering the vehicle's mobility and the hard service deadline constraint. An artificial intelligence-based multi-timescale framework is proposed for tackling these challenges. To mitigate the complexity associated with the large action and search space in the sophisticated multi-timescale framework considered, we propose to maximize a carefully constructed mobility-aware reward function using the classic particle swarm optimization scheme at the associated large timescale level, while we employ deep reinforcement learning at the small timescale level of our sophisticated twin-timescale solution. Numerical results are presented to illustrate the theoretical findings and to quantify the performance gains attained.

[1]  Long Bao Le,et al.  Design and Optimal Configuration of Full-Duplex MAC Protocol for Cognitive Radio Networks Considering Self-Interference , 2015, IEEE Access.

[2]  Deniz Gündüz,et al.  Wireless Content Caching for Small Cell and D2D Networks , 2016, IEEE Journal on Selected Areas in Communications.

[3]  Lajos Hanzo,et al.  Performance Analysis of NOMA-SM in Vehicle-to-Vehicle Massive MIMO Channels , 2017, IEEE Journal on Selected Areas in Communications.

[4]  Giuseppe Caire,et al.  Fundamental Limits of Caching in Wireless D2D Networks , 2014, IEEE Transactions on Information Theory.

[5]  Long Bao Le,et al.  Multi-channel MAC protocol for full-duplex cognitive radio networks with optimized access control and load balancing , 2016, 2016 IEEE International Conference on Communications (ICC).

[6]  Geoffrey I. Webb,et al.  Encyclopedia of Machine Learning , 2011, Encyclopedia of Machine Learning.

[7]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[8]  Zhu Han,et al.  Internet of Vehicles: Sensing-Aided Transportation Information Collection and Diffusion , 2018, IEEE Transactions on Vehicular Technology.

[9]  Alexandros G. Dimakis,et al.  Femtocaching and device-to-device collaboration: A new architecture for wireless video distribution , 2012, IEEE Communications Magazine.

[10]  Long Bao Le,et al.  Wireless Communications and Mobile Computing 1 Joint Data Compression and Mac Protocol Design for Smartgrids with Renewable Energy , 2022 .

[11]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[12]  Lajos Hanzo,et al.  Deferred-Iteration Aided Low-Complexity Turbo Hybrid ARQ Relying on a Look-Up Table , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[13]  Jia Wang,et al.  A survey of web caching schemes for the Internet , 1999, CCRV.

[14]  Athanasios V. Vasilakos,et al.  Full-Duplex Wireless Communications: Challenges, Solutions, and Future Research Directions , 2016, Proceedings of the IEEE.

[15]  Lajos Hanzo,et al.  Hybrid-ARQ-Aided Short Fountain Codes Designed for Block-Fading Channels , 2015, IEEE Transactions on Vehicular Technology.

[16]  Jun Li,et al.  Probabilistic Small-Cell Caching: Performance Analysis and Optimization , 2017, IEEE Transactions on Vehicular Technology.

[17]  Sheldon M. Ross,et al.  Introduction to probability models , 1975 .

[18]  Long Bao Le,et al.  Compressed sensing based data processing and MAC protocol design for smartgrids , 2015, 2015 IEEE Wireless Communications and Networking Conference (WCNC).

[19]  Nan Zhao,et al.  Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach , 2018, IEEE Transactions on Vehicular Technology.

[20]  Rose Qingyang Hu,et al.  Mobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning , 2018, IEEE Transactions on Vehicular Technology.

[21]  Lajos Hanzo,et al.  Low-Complexity Multiple-Component Turbo-Decoding-Aided Hybrid ARQ , 2011, IEEE Transactions on Vehicular Technology.

[22]  Rose Qingyang Hu,et al.  An energy efficient and spectrum efficient wireless heterogeneous network framework for 5G systems , 2014, IEEE Communications Magazine.

[23]  Jun Li,et al.  Distributed Caching for Data Dissemination in the Downlink of Heterogeneous Networks , 2015, IEEE Transactions on Communications.

[24]  Mehdi Bennis,et al.  Living on the edge: The role of proactive caching in 5G wireless networks , 2014, IEEE Communications Magazine.

[25]  Sergey Levine,et al.  Continuous Deep Q-Learning with Model-based Acceleration , 2016, ICML.

[26]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[27]  Rose Qingyang Hu,et al.  D2D Communications in Heterogeneous Networks With Full-Duplex Relays and Edge Caching , 2018, IEEE Transactions on Industrial Informatics.

[28]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[29]  Lie-Liang Yang,et al.  Energy-Efficient Cross-Layer Design of Wireless Mesh Networks for Content Sharing in Online Social Networks , 2017, IEEE Transactions on Vehicular Technology.

[30]  Osvaldo Simeone,et al.  Harnessing cloud and edge synergies: toward an information theory of fog radio access networks , 2016, IEEE Communications Magazine.

[31]  Konstantinos Poularakis,et al.  Code, Cache and Deliver on the Move: A Novel Caching Paradigm in Hyper-Dense Small-Cell Networks , 2017, IEEE Transactions on Mobile Computing.

[32]  Rose Qingyang Hu,et al.  Hierarchical Collaborative Cloud and Fog Computing in IoT Networks , 2018, 2018 10th International Conference on Wireless Communications and Signal Processing (WCSP).

[33]  Vikas Wasade,et al.  Mobility-Aware Caching in D2D Networks , 2018 .

[34]  Bengt Ahlgren,et al.  A survey of information-centric networking , 2012, IEEE Communications Magazine.

[35]  V. N. Q. Bao,et al.  Projected Barzilai-Borwein Methods Applied to Distributed Compressive Spectrum Sensing , 2010, 2010 IEEE Symposium on New Frontiers in Dynamic Spectrum (DySPAN).

[36]  Zbigniew Michalewicz,et al.  Particle Swarm Optimization for Single Objective Continuous Space Problems: A Review , 2017, Evolutionary Computation.

[37]  Jeffrey G. Andrews,et al.  Femtocells: Past, Present, and Future , 2012, IEEE Journal on Selected Areas in Communications.

[38]  Mark A. Shayman,et al.  Multitime scale Markov decision processes , 2003, IEEE Trans. Autom. Control..

[39]  Konstantinos Poularakis,et al.  Approximation Algorithms for Mobile Data Caching in Small Cell Networks , 2014, IEEE Transactions on Communications.

[40]  He Chen,et al.  Pricing and Resource Allocation via Game Theory for a Small-Cell Video Caching System , 2016, IEEE Journal on Selected Areas in Communications.

[41]  Yaoliang Yu,et al.  Petuum: A New Platform for Distributed Machine Learning on Big Data , 2015, IEEE Trans. Big Data.

[42]  Khaled Ben Letaief,et al.  Mobility-aware caching for content-centric wireless networks: modeling and methodology , 2016, IEEE Communications Magazine.

[43]  Jeffrey G. Andrews,et al.  A Tractable Approach to Coverage and Rate in Cellular Networks , 2010, IEEE Transactions on Communications.

[44]  Lajos Hanzo,et al.  A Survey and Tutorial on Low-Complexity Turbo Coding Techniques and a Holistic Hybrid ARQ Design Example , 2013, IEEE Communications Surveys & Tutorials.

[45]  Zhu Han,et al.  Machine Learning Paradigms for Next-Generation Wireless Networks , 2017, IEEE Wireless Communications.

[46]  Yong-Yeol Ahn,et al.  Analyzing the Video Popularity Characteristics of Large-Scale User Generated Content Systems , 2009, IEEE/ACM Transactions on Networking.

[47]  Hyung Yun Kong,et al.  A novel and efficient mixed-signal compressed sensing for wide-band cognitive radio , 2010, International Forum on Strategic Technology 2010.